Commits

Commit history

1. Commits on Sep 26, 2024

   • Support LoRA in TensorRTMMExporter (#10347)

     Show description for 5e66cad
     meatybobby

     authored
     5e66cadView commit details

     Copy full SHA for 5e66cad

     View code at this pointBrowse repository at this point
2. Commits on Sep 3, 2024

   • Bugfix: export to trt-llm multi_block_mode flag (#10334)

     Show description for ab6aba3
     Laplasjan107

     authored
     ab6aba3View commit details

     Copy full SHA for ab6aba3

     View code at this pointBrowse repository at this point
3. Commits on Aug 30, 2024

   • Add support for LoRA on vLLM (#10009)

     Show description for d886151
     

     4 peopleauthored
     d886151View commit details

     Copy full SHA for d886151

     View code at this pointBrowse repository at this point
4. Commits on Aug 26, 2024

   • salm export trtllm (#10245)

     Show description for 69973f9
     Slyne

     authored
     69973f9View commit details

     Copy full SHA for 69973f9

     View code at this pointBrowse repository at this point
5. Commits on Aug 22, 2024

   • Update TRTLLM 0.12 (#10215)

     Show description for 5269caf
     

     meatybobby

     and

     oyilmaz-nvidia

     authored
     5269cafView commit details

     Copy full SHA for 5269caf

     View code at this pointBrowse repository at this point
6. Commits on Aug 17, 2024

   • Add deploy and REST API support to NeMo 2.0 (#9834) (#10002)

     Show description for a8c95dc
     

     github-actions[bot]

     and

     athitten

     authored
     a8c95dcView commit details

     Copy full SHA for a8c95dc

     View code at this pointBrowse repository at this point
7. Commits on Jul 26, 2024

   • Integrate TRT-LLM v0.11 (#9705)

     Show description for c81f7cf
     oyilmaz-nvidia

     authored
     c81f7cfView commit details

     Copy full SHA for c81f7cf

     View code at this pointBrowse repository at this point
8. Commits on Jul 19, 2024

   • Add Lita, Vila and Vita TRTLLM export (#9734)

     Show description for ab8988e
     

     xuanzic

     and

     Vivian Chen

     authored
     ab8988eView commit details

     Copy full SHA for ab8988e

     View code at this pointBrowse repository at this point
9. Commits on Jul 18, 2024

   • Add option to convert PyTriton response to OpenAI format (#9726)

     Show description for 234ac8b
     athitten

     authored
     234ac8bView commit details

     Copy full SHA for 234ac8b

     View code at this pointBrowse repository at this point
10. Commits on Jul 9, 2024

    • Triton deployment improvements for in-framework models (#9600)

      Show description for 8898b76
      

      jukim-nv

      and

      oyilmaz-nvidia

      authored
      8898b76View commit details

      Copy full SHA for 8898b76

      View code at this pointBrowse repository at this point
11. Commits on Jul 8, 2024

    • Add REST API to deploy module (#9539)

      Show description for b4fe4a5
      

      athitten

      and

      pre-commit-ci[bot]

      authored
      b4fe4a5View commit details

      Copy full SHA for b4fe4a5

      View code at this pointBrowse repository at this point
12. Commits on Jul 3, 2024

    • vLLM Export Improvements (#9596)

      Show description for 590b762
      

      3 peopleauthored
      590b762View commit details

      Copy full SHA for 590b762

      View code at this pointBrowse repository at this point
13. Commits on Jul 1, 2024

    • PTQ refinements (#9574)

      Show description for f64e77d
      janekl

      authored
      f64e77dView commit details

      Copy full SHA for f64e77d

      View code at this pointBrowse repository at this point
14. Commits on Jun 28, 2024

    • Add Multimodal Exporter (#9256)

      Show description for d0efd34
      meatybobby

      authored
      d0efd34View commit details

      Copy full SHA for d0efd34

      View code at this pointBrowse repository at this point

    • Add tps and pps params to the export script (#9558)

      Show description for ba1968f
      oyilmaz-nvidia

      authored
      ba1968fView commit details

      Copy full SHA for ba1968f

      View code at this pointBrowse repository at this point
15. Commits on Jun 25, 2024

    • vLLM Export Support (#9381)

      Show description for 9e979d4
      

      3 peopleauthored
      9e979d4View commit details

      Copy full SHA for 9e979d4

      View code at this pointBrowse repository at this point
16. Commits on Jun 17, 2024

    • In framework deploy using deploy script (#9468)

      Show description for d13e532
      

      oyilmaz-nvidia

      and

      artbataev

      authored
      d13e532View commit details

      Copy full SHA for d13e532

      View code at this pointBrowse repository at this point
17. Commits on Jun 13, 2024

    • In-framework deployment (#9438)

      Show description for a01fa6d
      

      4 peopleauthored
      a01fa6dView commit details

      Copy full SHA for a01fa6d

      View code at this pointBrowse repository at this point
18. Commits on Jun 10, 2024

    • Use TensorRT-LLM native parameter names in nemo.export module (#9424)

      Show description for 69954ef
      janekl

      authored
      69954efView commit details

      Copy full SHA for 69954ef

      View code at this pointBrowse repository at this point
19. Commits on May 30, 2024

    • Fix P-tuning for Llama based models (#9300)

      Show description for b6595cb
      

      4 peopleauthored
      b6595cbView commit details

      Copy full SHA for b6595cb

      View code at this pointBrowse repository at this point
20. Commits on May 29, 2024

    • fix lora and ptuning and isort/black (#9290) (#9295)

      Show description for 4aba557
      

      github-actions[bot]

      and

      oyilmaz-nvidia

      authored
      4aba557View commit details

      Copy full SHA for 4aba557

      View code at this pointBrowse repository at this point
21. Commits on May 21, 2024

    • Add TRT-LLM params like max_num_tokens and opt_num_tokens (#9210)

      Show description for 2e1814c
      

      oyilmaz-nvidia

      and

      pablo-garay

      authored
      2e1814cView commit details

      Copy full SHA for 2e1814c

      View code at this pointBrowse repository at this point
22. Commits on Apr 10, 2024

    • Add deploy triton and query scripts (#8852)

      Show description for 4d0ae36
      oyilmaz-nvidia

      authored
      4d0ae36View commit details

      Copy full SHA for 4d0ae36

      View code at this pointBrowse repository at this point
23. Loading