Commits

Commit history

1. Commits on Oct 10, 2026

   • server: leave a busy slot untouched when a request pins it (#30295)

     Show description for 23b0202
     ServeurpersoCom

     authored
     23b0202View commit details

     Copy full SHA for 23b0202

     View code at this pointBrowse repository at this point
2. Commits on Oct 9, 2026

   • chat : refactor API (#30210)

     aldehir

     authored
     8b54361View commit details

     Copy full SHA for 8b54361

     View code at this pointBrowse repository at this point
3. Commits on Oct 8, 2026

   • server : preserve context checkpoints across slot save/restore (#26004)

     Show description for 033df86
     

     Tough-Respawn

     and

     okigan

     authored
     033df86View commit details

     Copy full SHA for 033df86

     View code at this pointBrowse repository at this point

   • model : add LiquidAI/d1-omni-600M decision model (#30114)

     Show description for a657f7e
     tdakhran

     authored
     a657f7eView commit details

     Copy full SHA for a657f7e

     View code at this pointBrowse repository at this point
4. Commits on Oct 7, 2026

   • model : add LiquidAI/d1-3B decision model (#30110)

     Show description for 88dcc46
     tdakhran

     authored
     88dcc46View commit details

     Copy full SHA for 88dcc46

     View code at this pointBrowse repository at this point

   • server : accumulate generated text and tokens as parse input (#29876)

     Show description for 18b5f8b
     aldehir

     authored
     18b5f8bView commit details

     Copy full SHA for 18b5f8b

     View code at this pointBrowse repository at this point
5. Commits on Oct 5, 2026

   • common, server : report model input/output modalities in GET /models (#29987)

     Show description for 4d60b4d
     angt

     authored
     4d60b4dView commit details

     Copy full SHA for 4d60b4d

     View code at this pointBrowse repository at this point

   • server: support vision input for Clef (#29969)

     Show description for 9871df5
     ngxson

     authored
     9871df5View commit details

     Copy full SHA for 9871df5

     View code at this pointBrowse repository at this point
6. Commits on Oct 3, 2026

   • model: add support for clef decision model (text-only) (#29831)

     Show description for 99b9548
     

     ngxson

     and

     CISC

     authored
     99b9548View commit details

     Copy full SHA for 99b9548

     View code at this pointBrowse repository at this point
7. Commits on Oct 2, 2026

   • spec : add probabilistic sampling for simple draft and MTP (#27694)

     Show description for 1fb7ef3
     

     praneshgo

     and

     Pranesh Gonegandla

     authored
     1fb7ef3View commit details

     Copy full SHA for 1fb7ef3

     View code at this pointBrowse repository at this point

   • model: support nimble decision model (#29844)

     ngxson

     authored
     46ca246View commit details

     Copy full SHA for 46ca246

     View code at this pointBrowse repository at this point

   • llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) (#29818)

     Show description for a4cb4c6
     ngxson

     authored
     a4cb4c6View commit details

     Copy full SHA for a4cb4c6

     View code at this pointBrowse repository at this point
8. Commits on Oct 1, 2026

   • mtmd: cap max_image to ubatch for non_causal models (#29773)

     ngxson

     authored
     552f18fView commit details

     Copy full SHA for 552f18f

     View code at this pointBrowse repository at this point
9. Commits on Sep 29, 2026

   • tests : adjust server string regex to also match m2 utlra results (#29648)

     ggerganov

     authored
     c85b92cView commit details

     Copy full SHA for c85b92c

     View code at this pointBrowse repository at this point
10. Commits on Sep 28, 2026

    • server : support typed content (vision/audio/video) input for /v1/embeddings endpoint (#29556)

      Show description for 680a036
      

      timothywang21

      and

      ngxson

      authored
      680a036View commit details

      Copy full SHA for 680a036

      View code at this pointBrowse repository at this point

    • batch: migrate speculative, mtmd and server to batch_ext (#29385)

      Show description for f1ea206
      ngxson

      authored
      f1ea206View commit details

      Copy full SHA for f1ea206

      View code at this pointBrowse repository at this point
11. Commits on Sep 27, 2026

    • server : allow RANK pooling batch splitting for causal LLM rerankers (ie. Qwen3 and Qwen3-VL) (#28876)

      Show description for 4da6337
      timothywang21

      authored
      4da6337View commit details

      Copy full SHA for 4da6337

      View code at this pointBrowse repository at this point
12. Commits on Sep 24, 2026

    • server,common : fix the GCC 12 stringop-overread false positive (again) (#29325)

      Show description for 2b70583
      angt

      authored
      2b70583View commit details

      Copy full SHA for 2b70583

      View code at this pointBrowse repository at this point
13. Commits on Sep 23, 2026

    • server: fix token counting API crash on sleep (#29309)

      Show description for 42916d8
      willweimike

      authored
      42916d8View commit details

      Copy full SHA for 42916d8

      View code at this pointBrowse repository at this point
14. Commits on Sep 11, 2026

    • server: fix speculation after an image (#28715)

      Show description for b0dcb81
      jesdga95

      authored
      b0dcb81View commit details

      Copy full SHA for b0dcb81

      View code at this pointBrowse repository at this point
15. Commits on Sep 8, 2026

    • server : apply checkpoint min-step eviction only when the checkpoint list is full (#28302)

      Show description for 5d806aa
      masterFoad

      authored
      5d806aaView commit details

      Copy full SHA for 5d806aa

      View code at this pointBrowse repository at this point
16. Commits on Sep 2, 2026

    • common, server : enable preserve_reasoning kwarg by default, log its effective state (#28174)

      Show description for e750b88
      

      ggerganov

      and

      ngxson

      authored
      e750b88View commit details

      Copy full SHA for e750b88

      View code at this pointBrowse repository at this point
17. Commits on Aug 27, 2026

    • server: add ctx-per-slot (--kv-unified-per-slot) (#24124)

      Show description for 1844325
      

      bartowski1182

      and

      ngxson

      authored
      1844325View commit details

      Copy full SHA for 1844325

      View code at this pointBrowse repository at this point

    • spec: Add benchmark-only synthetic speculative acceptance options (#27711)

      Show description for 2bb9bdd
      gaugarg-nv

      authored
      2bb9bddView commit details

      Copy full SHA for 2bb9bdd

      View code at this pointBrowse repository at this point

    • args: add --video-* CLI arguments (#24318)

      Show description for f295512
      ngxson

      authored
      f295512View commit details

      Copy full SHA for f295512

      View code at this pointBrowse repository at this point
18. Commits on Aug 23, 2026

    • server : add LLAMA_SERVER_SLOTS_N_DIFF (#27600)

      ggerganov

      authored
      e8eed45View commit details

      Copy full SHA for e8eed45

      View code at this pointBrowse repository at this point
19. Commits on Aug 22, 2026

    • common: add json.h abstraction (#27511)

      Show description for d9f918d
      ngxson

      authored
      d9f918dView commit details

      Copy full SHA for d9f918d

      View code at this pointBrowse repository at this point

    • fit: also take into account n_streams (#27496)

      Show description for 2fb989b
      

      ngxson

      and

      ServeurpersoCom

      authored
      2fb989bView commit details

      Copy full SHA for 2fb989b

      View code at this pointBrowse repository at this point
20. Commits on Aug 20, 2026

    • mtmd: add --mmproj-device argument (#23255)

      Show description for 681c29d
      

      Interpause

      and

      ngxson

      authored
      681c29dView commit details

      Copy full SHA for 681c29d

      View code at this pointBrowse repository at this point
21. Commits on Aug 19, 2026

    • server: refactor sleep handling, allow access /metrics during sleep (#27376)

      Show description for 947fd9b
      ngxson

      authored
      947fd9bView commit details

      Copy full SHA for 947fd9b

      View code at this pointBrowse repository at this point
22. Commits on Aug 17, 2026

    • server: save processed mtmd chunks as placeholder (#27278)

      ngxson

      authored
      533b182View commit details

      Copy full SHA for 533b182

      View code at this pointBrowse repository at this point
23. Commits on Aug 15, 2026

    • server: re-design yield_to_queue thread model (#27133)

      Show description for 22b8e31
      ngxson

      authored
      22b8e31View commit details

      Copy full SHA for 22b8e31

      View code at this pointBrowse repository at this point
24. Commits on Aug 14, 2026

    • server: allow accessing /metrics and /slots during llama_decode() (#27041)

      Show description for 77918ca
      ngxson

      authored
      77918caView commit details

      Copy full SHA for 77918ca

      View code at this pointBrowse repository at this point
25. Commits on Aug 13, 2026

    • server: refactor + correctness fixes for metrics (#26920)

      Show description for decaf50
      ngxson

      authored
      decaf50View commit details

      Copy full SHA for decaf50

      View code at this pointBrowse repository at this point
26. Commits on Aug 12, 2026

    • server : support slot save/restore with media inputs (#26640)

      Show description for 5d9e5ac
      CHIPMUNK-T0T

      authored
      5d9e5acView commit details

      Copy full SHA for 5d9e5ac

      View code at this pointBrowse repository at this point