Commits

Commit history

1. Commits on Dec 17, 2025

   • common : restore grammar-based rejection sampling (#18137)

     Show description for 4301e27
     ggerganov

     authored
     4301e27View commit details

     Copy full SHA for 4301e27

     View code at this pointBrowse repository at this point
2. Commits on Dec 14, 2025

   • common : refactor common_sampler + grammar logic changes (#17937)

     Show description for 254098a
     ggerganov

     authored
     254098aView commit details

     Copy full SHA for 254098a

     View code at this pointBrowse repository at this point
3. Commits on Nov 20, 2025

   • common : more accurate sampling timing (#17382)

     Show description for 196f508
     ggerganov

     authored
     196f508View commit details

     Copy full SHA for 196f508

     View code at this pointBrowse repository at this point
4. Commits on Sep 24, 2025

   • llama: print memory breakdown on exit (#15860)

     Show description for e789095
     JohannesGaessler

     authored
     e789095View commit details

     Copy full SHA for e789095

     View code at this pointBrowse repository at this point
5. Commits on Aug 31, 2025

   • sampling : optimize samplers by reusing bucket sort (#15665)

     Show description for e92d53b
     

     ggerganov

     and

     JohannesGaessler

     authored
     e92d53bView commit details

     Copy full SHA for e92d53b

     View code at this pointBrowse repository at this point
6. Commits on May 25, 2025

   • `server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)

     Show description for f5cd27b
     

     ochafik

     and

     ochafik

     authored
     f5cd27bView commit details

     Copy full SHA for f5cd27b

     View code at this pointBrowse repository at this point
7. Commits on May 7, 2025

   • common : Add a warning when we can't match samplers from a string or char. (#13330)

     ycros

     authored
     39e73aeView commit details

     Copy full SHA for 39e73ae

     View code at this pointBrowse repository at this point
8. Commits on May 5, 2025

   • sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)

     Show description for 233461f
     

     oobabooga

     and

     CasualAutopsy

     authored
     233461fView commit details

     Copy full SHA for 233461f

     View code at this pointBrowse repository at this point
9. Commits on Mar 28, 2025

   • llama: fix error on bad grammar (#12628)

     JohannesGaessler

     authored
     dd373ddView commit details

     Copy full SHA for dd373dd

     View code at this pointBrowse repository at this point
10. Commits on Mar 5, 2025

    • `tool-call`: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)

      Show description for 669912d
      

      ochafik

      and

      ggerganov

      authored
      669912dView commit details

      Copy full SHA for 669912d

      View code at this pointBrowse repository at this point
11. Commits on Mar 4, 2025

    • ggml : portability fixes for VS 2017 (#12150)

      Show description for 5bbe6a9
      

      mgroeber9110

      and

      Marcus Groeber

      authored
      5bbe6a9View commit details

      Copy full SHA for 5bbe6a9

      View code at this pointBrowse repository at this point
12. Commits on Feb 13, 2025

    • `server`: fix tool-call of DeepSeek R1 Qwen, return reasoning_content (Command 7RB & DeepSeek R1) unless `--reasoning-format none` (#11607)

      Show description for c7f460a
      

      ochafik

      and

      ggerganov

      authored
      c7f460aView commit details

      Copy full SHA for c7f460a

      View code at this pointBrowse repository at this point

    • sampling: add Top-nσ sampler (#11223)

      Show description for 27e8a23
      

      VJHack

      and

      ggerganov

      authored
      27e8a23View commit details

      Copy full SHA for 27e8a23

      View code at this pointBrowse repository at this point
13. Commits on Feb 2, 2025

    • sampling : support for llguidance grammars (#10224)

      Show description for ff22770
      mmoskal

      authored
      ff22770View commit details

      Copy full SHA for ff22770

      View code at this pointBrowse repository at this point
14. Commits on Jan 30, 2025

    • Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)

      Show description for 8b576b6
      

      3 peopleauthored
      8b576b6View commit details

      Copy full SHA for 8b576b6

      View code at this pointBrowse repository at this point
15. Commits on Jan 12, 2025

    • llama : add `llama_vocab`, functions -> methods, naming (#11110)

      Show description for afa8a9e
      

      ggerganov

      and

      slaren

      authored
      afa8a9eView commit details

      Copy full SHA for afa8a9e

      View code at this pointBrowse repository at this point
16. Commits on Dec 16, 2024

    • sampling : refactor + optimize penalties sampler (#10803)

      Show description for 644fd71
      

      ggerganov

      and

      slaren

      authored
      644fd71View commit details

      Copy full SHA for 644fd71

      View code at this pointBrowse repository at this point
17. Commits on Nov 25, 2024

    • speculative : refactor and add a simpler example (#10362)

      Show description for d9d54e4
      ggerganov

      authored
      d9d54e4View commit details

      Copy full SHA for d9d54e4

      View code at this pointBrowse repository at this point
18. Commits on Oct 29, 2024

    • llama : remove Tail-Free sampling (#10071)

      Show description for 8d8ff71
      ggerganov

      authored
      8d8ff71View commit details

      Copy full SHA for 8d8ff71

      View code at this pointBrowse repository at this point
19. Commits on Oct 25, 2024

    • llama : add DRY sampler (#9702)

      Show description for ff252ea
      

      3 peopleauthored
      ff252eaView commit details

      Copy full SHA for ff252ea

      View code at this pointBrowse repository at this point
20. Commits on Oct 21, 2024

    • llama : default sampling changes + greedy update (#9897)

      Show description for 55e4778
      ggerganov

      authored
      55e4778View commit details

      Copy full SHA for 55e4778

      View code at this pointBrowse repository at this point
21. Commits on Oct 15, 2024

    • llama : add infill sampler (#9896)

      Show description for 755a9b2
      ggerganov

      authored
      755a9b2View commit details

      Copy full SHA for 755a9b2

      View code at this pointBrowse repository at this point

    • sampling : add XTC sampler (#9742)

      Show description for fbc98b7
      MaggotHATE

      authored
      fbc98b7View commit details

      Copy full SHA for fbc98b7

      View code at this pointBrowse repository at this point
22. Commits on Oct 10, 2024

    • common : use common_ prefix for common library functions (#9805)

      Show description for 7eee341
      

      slaren

      and

      ggerganov

      authored
      7eee341View commit details

      Copy full SHA for 7eee341

      View code at this pointBrowse repository at this point
23. Commits on Sep 24, 2024

    • sampling : avoid expensive softmax during greedy sampling (#9605)

      Show description for b0f2736
      

      ggerganov

      and

      slaren

      authored
      b0f2736View commit details

      Copy full SHA for b0f2736

      View code at this pointBrowse repository at this point
24. Commits on Sep 15, 2024

    • common : reimplement logging (#9418)

      Show description for 6262d13
      ggerganov

      authored
      6262d13View commit details

      Copy full SHA for 6262d13

      View code at this pointBrowse repository at this point
25. Commits on Sep 13, 2024

    • llama : llama_perf + option to disable timings during decode (#9355)

      Show description for 0abc6a2
      

      ggerganov

      and

      ngxson

      authored
      0abc6a2View commit details

      Copy full SHA for 0abc6a2

      View code at this pointBrowse repository at this point
26. Commits on Sep 10, 2024

    • llama : move random seed generation to the samplers (#9398)

      Show description for 49006c6
      slaren

      authored
      49006c6View commit details

      Copy full SHA for 49006c6

      View code at this pointBrowse repository at this point
27. Commits on Sep 9, 2024

    • common : move arg parser code to `arg.cpp` (#9388)

      Show description for bfe76d4
      

      ngxson

      and

      ggerganov

      authored
      bfe76d4View commit details

      Copy full SHA for bfe76d4

      View code at this pointBrowse repository at this point
28. Commits on Sep 7, 2024

    • llama : fix empty ring buffer push (#9358)

      ggerganov

      authored
      f12295bView commit details

      Copy full SHA for f12295b

      View code at this pointBrowse repository at this point

    • llama : refactor sampling v2 (#9294)

      Show description for df270ef
      ggerganov

      authored
      df270efView commit details

      Copy full SHA for df270ef

      View code at this pointBrowse repository at this point
29. Commits on Jul 23, 2024

    • llama : move vocab, grammar and sampling into separate files (#8508)

      Show description for 938943c
      ggerganov

      authored
      938943cView commit details

      Copy full SHA for 938943c

      View code at this pointBrowse repository at this point
30. Commits on Jul 8, 2024

    • common : preallocate sampling token data vector (#8363)

      Show description for 470939d
      kevmo314

      authored
      470939dView commit details

      Copy full SHA for 470939d

      View code at this pointBrowse repository at this point

    • common : avoid unnecessary logits fetch (#8358)

      kevmo314

      authored
      ffd0079View commit details

      Copy full SHA for ffd0079

      View code at this pointBrowse repository at this point
31. Commits on Jun 25, 2024

    • llama : return nullptr from llama_grammar_init (#8093)

      Show description for e6bf007
      

      danbev

      and

      HanClinto

      authored
      e6bf007View commit details

      Copy full SHA for e6bf007

      View code at this pointBrowse repository at this point