* config update Signed-off-by: arendu <adithya.r@gmail.com> * save embeddings and some refac Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * entry point script for dumping embeddings to disk Signed-off-by: arendu <adithya.r@gmail.com> * normalize query and pos_doc even if no soft negatives are used Signed-off-by: arendu <adithya.r@gmail.com> * yaml for generation script Signed-off-by: arendu <adithya.r@gmail.com> * all possible negatives Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * updates Signed-off-by: arendu <adithya.r@gmail.com> * logging Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * need to update docstrings Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * headers and rename Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * log diff and fix cs logging Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * non-standard solution to get wandb logger to have the config Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * check for rank Signed-off-by: arendu <adithya.r@gmail.com> * cfg working for multi gpu Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * MCoreMixin chages. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * using new commit of meg-LM Signed-off-by: arendu <adithya.r@gmail.com> * default to use all layers for lora Signed-off-by: arendu <adithya.r@gmail.com> * validation only uses hard negatives, val scores are batch agnostic Signed-off-by: arendu <adithya.r@gmail.com> * minor reorg Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * metadata and bug fixes Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * dump embeddings with tracable ids, disabled val logs for the moment Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * val ids Signed-off-by: arendu <adithya.r@gmail.com> * val ids by consumed samples Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * don't gather if not saving embs Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * init global step to allow consumed samples to be called in test time Signed-off-by: arendu <adithya.r@gmail.com> * enable adapters with packed seq Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add the following changes for PTL 2.1 1) Remove LightningModuleWrapperBase around model as its not required with PTL 2.1 2) Make precision as None when using precision plugin in MegatronTrainerBuilder 3) Change dataloader_iter API for some megatron model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change dataloader_iter API and remove val_iterator_done 1) Change dataloader_iter API according to PTl 2.1 for bert and gpt model 2) Comment self._val_iterator_done for all megatron models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override format_checkpoint_nae and fix dataloader_iter API Signed-off-by: Abhishree <abhishreetm@gmail.com> * Update PTL version in requirements Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add the following changes for PTL 2.1 1) Remove LightningModuleWrapperBase around model as its not required with PTL 2.1 2) Make precision as None when using precision plugin in MegatronTrainerBuilder 3) Change dataloader_iter API for some megatron model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change dataloader_iter API and remove val_iterator_done 1) Change dataloader_iter API according to PTl 2.1 for bert and gpt model 2) Comment self._val_iterator_done for all megatron models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override format_checkpoint_nae and fix dataloader_iter API Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Remove unused import and comment val_iterator_done Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override _link_checkpoint Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable GPU unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Temporarily comment out CPU Unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove precision arg from Trainer in convert_hf_llama_to_nemo.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix dataloader_iter API for megatron_lm_encoder_decoder_model.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable NMT Training TP=2 test Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix val_step, test_step func API MegatronLMEncoderDecoderModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Enable NMT training TP=2 test Signed-off-by: Abhishree <abhishreetm@gmail.com> * Disable some unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment CI tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment resume part of BART Signed-off-by: Abhishree <abhishreetm@gmail.com> * Uncomment few lines from JenkinsFile Signed-off-by: Abhishree <abhishreetm@gmail.com> * Return len of dataloader in microbatches Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix _link_checkpoint 1) Add inject_model_parallel_rank to _link_checkpoint 2) Override super._link_checkpoint to remove condition check for rank 0 Signed-off-by: Abhishree <abhishreetm@gmail.com> * Check if using dist ckpt in _link_checkpoint Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable GPT with PP=2 Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove batch_idx arg from validation_step megatron_gpt_sft_model.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Use PTL bug fix branch Test unit tests with PTL bug fix https://github.com/Lightning-AI/pytorch-lightning/pull/19344/files Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable test_ema_saved_state in test_ema.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Skip test_beam_decoding_preserve_alignments in test_rnnt_decoding.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Use PTL with fs.lexists Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment _link_checkpoint related overrides In order to test with PTL without symbolic links Signed-off-by: Abhishree <abhishreetm@gmail.com> * Return only batch for dataloader_iter in DFT model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Modify get_batch in GPTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition checks for batch extraction from dataloader_iter Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add missing condition check for batch extraction in GPTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for dataloader_iter extraction in MegatronLMEncoderDecoder Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment test_invalid_checkpoints_removed_from_topk in test_exp_manager.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix test invalid ckpts in test_exp_manager.py Also uncomment some of the commented out tests in JenkinsFile and test_ema.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix bug in test_invalid_checkpoints_removed_from_topk Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix validation step of GPTModel for finetuning case with multi dataloaders Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * multi dataloaders for validation query and docs Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * validation loop made more efficient with 2 dataloders Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * WIP test set generation Signed-off-by: arendu <adithya.r@gmail.com> * generate working for multi dataloaders Signed-off-by: arendu <adithya.r@gmail.com> * Add the following changes for PTL 2.1 1) Remove LightningModuleWrapperBase around model as its not required with PTL 2.1 2) Make precision as None when using precision plugin in MegatronTrainerBuilder 3) Change dataloader_iter API for some megatron model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change dataloader_iter API and remove val_iterator_done 1) Change dataloader_iter API according to PTl 2.1 for bert and gpt model 2) Comment self._val_iterator_done for all megatron models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override format_checkpoint_nae and fix dataloader_iter API Signed-off-by: Abhishree <abhishreetm@gmail.com> * Update PTL version in requirements Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add the following changes for PTL 2.1 1) Remove LightningModuleWrapperBase around model as its not required with PTL 2.1 2) Make precision as None when using precision plugin in MegatronTrainerBuilder 3) Change dataloader_iter API for some megatron model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change dataloader_iter API and remove val_iterator_done 1) Change dataloader_iter API according to PTl 2.1 for bert and gpt model 2) Comment self._val_iterator_done for all megatron models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override format_checkpoint_nae and fix dataloader_iter API Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Remove unused import and comment val_iterator_done Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override _link_checkpoint Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable GPU unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Temporarily comment out CPU Unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove precision arg from Trainer in convert_hf_llama_to_nemo.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix dataloader_iter API for megatron_lm_encoder_decoder_model.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable NMT Training TP=2 test Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix val_step, test_step func API MegatronLMEncoderDecoderModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Enable NMT training TP=2 test Signed-off-by: Abhishree <abhishreetm@gmail.com> * Disable some unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment CI tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment resume part of BART Signed-off-by: Abhishree <abhishreetm@gmail.com> * Uncomment few lines from JenkinsFile Signed-off-by: Abhishree <abhishreetm@gmail.com> * Return len of dataloader in microbatches Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix _link_checkpoint 1) Add inject_model_parallel_rank to _link_checkpoint 2) Override super._link_checkpoint to remove condition check for rank 0 Signed-off-by: Abhishree <abhishreetm@gmail.com> * Check if using dist ckpt in _link_checkpoint Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable GPT with PP=2 Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove batch_idx arg from validation_step megatron_gpt_sft_model.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Use PTL bug fix branch Test unit tests with PTL bug fix https://github.com/Lightning-AI/pytorch-lightning/pull/19344/files Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable test_ema_saved_state in test_ema.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Skip test_beam_decoding_preserve_alignments in test_rnnt_decoding.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Use PTL with fs.lexists Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment _link_checkpoint related overrides In order to test with PTL without symbolic links Signed-off-by: Abhishree <abhishreetm@gmail.com> * Return only batch for dataloader_iter in DFT model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Modify get_batch in GPTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition checks for batch extraction from dataloader_iter Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add missing condition check for batch extraction in GPTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for dataloader_iter extraction in MegatronLMEncoderDecoder Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment test_invalid_checkpoints_removed_from_topk in test_exp_manager.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix test invalid ckpts in test_exp_manager.py Also uncomment some of the commented out tests in JenkinsFile and test_ema.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix bug in test_invalid_checkpoints_removed_from_topk Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix validation step of GPTModel for finetuning case with multi dataloaders Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix test_step_outputs for SFT in GPTMOdel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Pass dataloader_idx for val_step of GPTModel and remove unwanted code 1) Pass dataloader_idx to val_step of GPTModel as its required for GPTSFTModel in case multi dataloaders to append the outputs correctly val/test_step_output 2) Remove val_iterator_done check from all megatron GPT models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for extraction of batch in T5SFTModel & LMEncoderDecoder Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for extracting batch in MegatronNMTModel Also uncomment GPT PP=2 and NMT tests from JenkinsFIle Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix typo and uncomment multimodel tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * default names Signed-off-by: arendu <adithya.r@gmail.com> * Add the following changes for PTL 2.1 1) Remove LightningModuleWrapperBase around model as its not required with PTL 2.1 2) Make precision as None when using precision plugin in MegatronTrainerBuilder 3) Change dataloader_iter API for some megatron model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change dataloader_iter API and remove val_iterator_done 1) Change dataloader_iter API according to PTl 2.1 for bert and gpt model 2) Comment self._val_iterator_done for all megatron models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override format_checkpoint_nae and fix dataloader_iter API Signed-off-by: Abhishree <abhishreetm@gmail.com> * Update PTL version in requirements Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add the following changes for PTL 2.1 1) Remove LightningModuleWrapperBase around model as its not required with PTL 2.1 2) Make precision as None when using precision plugin in MegatronTrainerBuilder 3) Change dataloader_iter API for some megatron model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change dataloader_iter API and remove val_iterator_done 1) Change dataloader_iter API according to PTl 2.1 for bert and gpt model 2) Comment self._val_iterator_done for all megatron models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override format_checkpoint_nae and fix dataloader_iter API Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Remove unused import and comment val_iterator_done Signed-off-by: Abhishree <abhishreetm@gmail.com> * Override _link_checkpoint Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Temporarily comment out CPU Unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove precision arg from Trainer in convert_hf_llama_to_nemo.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix dataloader_iter API for megatron_lm_encoder_decoder_model.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable NMT Training TP=2 test Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix val_step, test_step func API MegatronLMEncoderDecoderModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Enable NMT training TP=2 test Signed-off-by: Abhishree <abhishreetm@gmail.com> * Disable some unit tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment CI tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment resume part of BART Signed-off-by: Abhishree <abhishreetm@gmail.com> * Uncomment few lines from JenkinsFile Signed-off-by: Abhishree <abhishreetm@gmail.com> * Return len of dataloader in microbatches Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix _link_checkpoint 1) Add inject_model_parallel_rank to _link_checkpoint 2) Override super._link_checkpoint to remove condition check for rank 0 Signed-off-by: Abhishree <abhishreetm@gmail.com> * Check if using dist ckpt in _link_checkpoint Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove batch_idx arg from validation_step megatron_gpt_sft_model.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Use PTL bug fix branch Test unit tests with PTL bug fix https://github.com/Lightning-AI/pytorch-lightning/pull/19344/files Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily disable test_ema_saved_state in test_ema.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Skip test_beam_decoding_preserve_alignments in test_rnnt_decoding.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Use PTL with fs.lexists Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment _link_checkpoint related overrides In order to test with PTL without symbolic links Signed-off-by: Abhishree <abhishreetm@gmail.com> * Return only batch for dataloader_iter in DFT model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Modify get_batch in GPTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition checks for batch extraction from dataloader_iter Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add missing condition check for batch extraction in GPTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for dataloader_iter extraction in MegatronLMEncoderDecoder Signed-off-by: Abhishree <abhishreetm@gmail.com> * Comment test_invalid_checkpoints_removed_from_topk in test_exp_manager.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix test invalid ckpts in test_exp_manager.py Also uncomment some of the commented out tests in JenkinsFile and test_ema.py Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix bug in test_invalid_checkpoints_removed_from_topk Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix validation step of GPTModel for finetuning case with multi dataloaders Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix test_step_outputs for SFT in GPTMOdel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Pass dataloader_idx for val_step of GPTModel and remove unwanted code 1) Pass dataloader_idx to val_step of GPTModel as its required for GPTSFTModel in case multi dataloaders to append the outputs correctly val/test_step_output 2) Remove val_iterator_done check from all megatron GPT models Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for extraction of batch in T5SFTModel & LMEncoderDecoder Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add condition check for extracting batch in MegatronNMTModel Also uncomment GPT PP=2 and NMT tests from JenkinsFIle Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix typo and uncomment multimodel tests Signed-off-by: Abhishree <abhishreetm@gmail.com> * Change to new dataloader_iter API for MultiModal Signed-off-by: Abhishree <abhishreetm@gmail.com> * Fix new dataloader_api for MegatronLatenDiffusion Model Signed-off-by: Abhishree <abhishreetm@gmail.com> * Store and restore precision value in MegatronGPTSFTModel Signed-off-by: Abhishree <abhishreetm@gmail.com> * Temporarily comment Multimodal Stable Diffusion Train Signed-off-by: Abhishree <abhishreetm@gmail.com> * Update JenkinsFile for multimodal with latest main Signed-off-by: Abhishree <abhishreetm@gmail.com> * Upgrade PTL to version 2.2 in reqs Signed-off-by: Abhishree <abhishreetm@gmail.com> * Install PTL 2.2 from fork Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add strict arg to load_model_state_dict func in NLPDDPStrategy Signed-off-by: Abhishree <abhishreetm@gmail.com> * Delete megatron_t5_adapter_tuning.py, megatron_t5_ia3_tuning.py These files were added in the branch by mistake Signed-off-by: Abhishree <abhishreetm@gmail.com> * Delete megatron_t5_prompt_learning.py that got added by mistake Signed-off-by: Abhishree <abhishreetm@gmail.com> * Add appropriate comments, code clean up Signed-off-by: Abhishree <abhishreetm@gmail.com> * Remove PTL installation from JenkinsFile Signed-off-by: Abhishree <abhishreetm@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update Signed-off-by: arendu <adithya.r@gmail.com> * llm embeddings with ptl2.2 Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * global in batch negatives using all gather Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * remove old files Signed-off-by: arendu <adithya.r@gmail.com> * remove changes in untouched files Signed-off-by: arendu <adithya.r@gmail.com> * inference for embedding model from ckpt Signed-off-by: arendu <adithya.r@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: arendu <adithya.r@gmail.com> Signed-off-by: Jiaqi Zeng <jiaqiz@nvidia.com> Signed-off-by: Adi Renduchintala <adithyare@nvidia.com> Signed-off-by: Abhishree <abhishreetm@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Jiaqi Zeng <jiaqiz@nvidia.com> Co-authored-by: Tugrul Konuk <ertkonuk@gmail.com> Co-authored-by: Abhishree <abhishreetm@gmail.com> Co-authored-by: Abhishree Thittenamane <47577437+athitten@users.noreply.github.com> Co-authored-by: Eric Harper <complex451@gmail.com>

Breadcrumbs

User selector

Datepicker

Commit history

Commits on Mar 14, 2024

LLM Embedding model (#8622)