Commits

Commit history

1. Commits on May 2, 2025

   • Enabling flash decode for in-framework inference deplo… (#13098)

     Show description for 77f9744
     

     3 peopleauthored
     77f9744View commit details

     Copy full SHA for 77f9744

     View code at this pointBrowse repository at this point
2. Commits on Apr 29, 2025

   • Add Llama4 Scout and Maverick Support (#12898)

     Show description for 6107266
     

     6 peopleauthored
     6107266View commit details

     Copy full SHA for 6107266

     View code at this pointBrowse repository at this point
3. Commits on Apr 27, 2025

   • Use first_value decorator for triton_infer_fn plus minor changes (#12773)

     Show description for f25cd58
     

     3 peopleauthored
     f25cd58View commit details

     Copy full SHA for f25cd58

     View code at this pointBrowse repository at this point
4. Commits on Apr 12, 2025

   • Enable async requests for in-fw deployment with OAI compatible server (#12980)

     Show description for 413e6e7
     marta-sd

     authored
     413e6e7View commit details

     Copy full SHA for 413e6e7

     View code at this pointBrowse repository at this point
5. Commits on Apr 10, 2025

   • Hugging Face model deployment support (#12628)

     Show description for 772311c
     oyilmaz-nvidia

     authored
     772311cView commit details

     Copy full SHA for 772311c

     View code at this pointBrowse repository at this point
6. Commits on Apr 6, 2025

   • Support huggingface export to tensorrtllm (#12889)

     Show description for f43a45f
     

     pthombre

     and

     chtruong814

     authored
     f43a45fView commit details

     Copy full SHA for f43a45f

     View code at this pointBrowse repository at this point

   • Enable in-fw deployment for eval with OAI compatible server (#12101)

     Show description for 57baba6
     athitten

     authored
     57baba6View commit details

     Copy full SHA for 57baba6

     View code at this pointBrowse repository at this point
7. Commits on Mar 3, 2025

   • Support mllama TRTLLM (#12357)

     Show description for d2c4cdf
     meatybobby

     authored
     d2c4cdfView commit details

     Copy full SHA for d2c4cdf

     View code at this pointBrowse repository at this point
8. Commits on Feb 13, 2025

   • Fix multi-GPU in-framework deployment (#12090)

     Show description for 3f6871a
     oyilmaz-nvidia

     authored
     3f6871aView commit details

     Copy full SHA for 3f6871a

     View code at this pointBrowse repository at this point
9. Commits on Jan 3, 2025

   • Fix 'http_port' parameter name in DeployPyTriton usages and update .qnemo compress=True path (#11747)

     Show description for 98f0b76
     janekl

     authored
     98f0b76View commit details

     Copy full SHA for 98f0b76

     View code at this pointBrowse repository at this point
10. Commits on Dec 23, 2024

    • Use explicit imports from megatronllm_deployable.py to avoid depedency chain (#11705)

      Show description for cbb5ff4
      janekl

      authored
      cbb5ff4View commit details

      Copy full SHA for cbb5ff4

      View code at this pointBrowse repository at this point
11. Commits on Dec 14, 2024

    • NIM supporting changes for nemo.export for NeMo 2.0 (#11488)

      Show description for 2c59771
      

      janekl

      and

      meatybobby

      authored
      2c59771View commit details

      Copy full SHA for 2c59771

      View code at this pointBrowse repository at this point
12. Commits on Dec 12, 2024

    • NeMo 2.0 In-framework deployment support (#11523)

      Show description for ef68b1b
      

      oyilmaz-nvidia

      and

      hemildesai

      authored
      ef68b1bView commit details

      Copy full SHA for ef68b1b

      View code at this pointBrowse repository at this point
13. Commits on Nov 29, 2024

    • Handle import errors in virtual environment when running vLLM tests (#11435)

      Show description for 8becd57
      janekl

      authored
      8becd57View commit details

      Copy full SHA for 8becd57

      View code at this pointBrowse repository at this point
14. Commits on Nov 21, 2024

    • Export & deploy updates (part II) (#11344)

      Show description for ffdccaf
      janekl

      authored
      ffdccafView commit details

      Copy full SHA for ffdccaf

      View code at this pointBrowse repository at this point
15. Commits on Nov 16, 2024

    • Integrate lm-eval-harness for evaluations in NeMo (#10621)

      Show description for f67f9ef
      

      athitten

      and

      ananthsub

      authored
      f67f9efView commit details

      Copy full SHA for f67f9ef

      View code at this pointBrowse repository at this point
16. Commits on Oct 29, 2024

    • Export & deploy updates (part I) (#10941)

      Show description for a8832b8
      janekl

      authored
      a8832b8View commit details

      Copy full SHA for a8832b8

      View code at this pointBrowse repository at this point
17. Commits on Oct 25, 2024

    • Basic online dynamic FP8 quantization with vLLM (#10904)

      Show description for 14fed45
      janekl

      authored
      14fed45View commit details

      Copy full SHA for 14fed45

      View code at this pointBrowse repository at this point
18. Commits on Sep 26, 2024

    • Support LoRA in TensorRTMMExporter (#10347)

      Show description for 5e66cad
      meatybobby

      authored
      5e66cadView commit details

      Copy full SHA for 5e66cad

      View code at this pointBrowse repository at this point
19. Commits on Sep 3, 2024

    • Bugfix: export to trt-llm multi_block_mode flag (#10334)

      Show description for ab6aba3
      Laplasjan107

      authored
      ab6aba3View commit details

      Copy full SHA for ab6aba3

      View code at this pointBrowse repository at this point
20. Commits on Aug 30, 2024

    • Add support for LoRA on vLLM (#10009)

      Show description for d886151
      

      4 peopleauthored
      d886151View commit details

      Copy full SHA for d886151

      View code at this pointBrowse repository at this point
21. Commits on Aug 26, 2024

    • salm export trtllm (#10245)

      Show description for 69973f9
      Slyne

      authored
      69973f9View commit details

      Copy full SHA for 69973f9

      View code at this pointBrowse repository at this point
22. Commits on Aug 22, 2024

    • Update TRTLLM 0.12 (#10215)

      Show description for 5269caf
      

      meatybobby

      and

      oyilmaz-nvidia

      authored
      5269cafView commit details

      Copy full SHA for 5269caf

      View code at this pointBrowse repository at this point
23. Commits on Aug 17, 2024

    • Add deploy and REST API support to NeMo 2.0 (#9834) (#10002)

      Show description for a8c95dc
      

      github-actions[bot]

      and

      athitten

      authored
      a8c95dcView commit details

      Copy full SHA for a8c95dc

      View code at this pointBrowse repository at this point
24. Commits on Jul 26, 2024

    • Integrate TRT-LLM v0.11 (#9705)

      Show description for c81f7cf
      oyilmaz-nvidia

      authored
      c81f7cfView commit details

      Copy full SHA for c81f7cf

      View code at this pointBrowse repository at this point
25. Commits on Jul 19, 2024

    • Add Lita, Vila and Vita TRTLLM export (#9734)

      Show description for ab8988e
      

      xuanzic

      and

      Vivian Chen

      authored
      ab8988eView commit details

      Copy full SHA for ab8988e

      View code at this pointBrowse repository at this point
26. Commits on Jul 18, 2024

    • Add option to convert PyTriton response to OpenAI format (#9726)

      Show description for 234ac8b
      athitten

      authored
      234ac8bView commit details

      Copy full SHA for 234ac8b

      View code at this pointBrowse repository at this point
27. Commits on Jul 9, 2024

    • Triton deployment improvements for in-framework models (#9600)

      Show description for 8898b76
      

      jukim-nv

      and

      oyilmaz-nvidia

      authored
      8898b76View commit details

      Copy full SHA for 8898b76

      View code at this pointBrowse repository at this point
28. Commits on Jul 8, 2024

    • Add REST API to deploy module (#9539)

      Show description for b4fe4a5
      

      athitten

      and

      pre-commit-ci[bot]

      authored
      b4fe4a5View commit details

      Copy full SHA for b4fe4a5

      View code at this pointBrowse repository at this point
29. Commits on Jul 3, 2024

    • vLLM Export Improvements (#9596)

      Show description for 590b762
      

      3 peopleauthored
      590b762View commit details

      Copy full SHA for 590b762

      View code at this pointBrowse repository at this point
30. Commits on Jul 1, 2024

    • PTQ refinements (#9574)

      Show description for f64e77d
      janekl

      authored
      f64e77dView commit details

      Copy full SHA for f64e77d

      View code at this pointBrowse repository at this point
31. Commits on Jun 28, 2024

    • Add Multimodal Exporter (#9256)

      Show description for d0efd34
      meatybobby

      authored
      d0efd34View commit details

      Copy full SHA for d0efd34

      View code at this pointBrowse repository at this point

    • Add tps and pps params to the export script (#9558)

      Show description for ba1968f
      oyilmaz-nvidia

      authored
      ba1968fView commit details

      Copy full SHA for ba1968f

      View code at this pointBrowse repository at this point
32. Commits on Jun 25, 2024

    • vLLM Export Support (#9381)

      Show description for 9e979d4
      

      3 peopleauthored
      9e979d4View commit details

      Copy full SHA for 9e979d4

      View code at this pointBrowse repository at this point
33. Commits on Jun 17, 2024

    • In framework deploy using deploy script (#9468)

      Show description for d13e532
      

      oyilmaz-nvidia

      and

      artbataev

      authored
      d13e532View commit details

      Copy full SHA for d13e532

      View code at this pointBrowse repository at this point