Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: ggml-org/llama.cpp
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: SoftwareRenderer/llama.cpp
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 3 commits
  • 1 file changed
  • 2 contributors

Commits on Mar 13, 2026

  1. server: reset kill-switch on client error 

    This avoids triggering a server kill switch.

If the client sends a request that exceeds the configured context size, an appropriate HTTP 400 response is provided and no tokens are generated.

However since no tokens are generated, update_slots() increments n_empty_consecutive. If the client sends 3 such messages in a row, the server terminates.
    @SoftwareRenderer
    SoftwareRenderer committed Mar 13, 2026
    Configuration menu
    Copy the full SHA
    4909dc6 View commit details
    Browse the repository at this point in the history

  2. moved counter reset as per recommendation

    @SoftwareRenderer
    SoftwareRenderer committed Mar 13, 2026
    Configuration menu
    Copy the full SHA
    a3050a5 View commit details
    Browse the repository at this point in the history

  3. cont : minor

    @ggerganov
    ggerganov committed Mar 13, 2026
    Configuration menu
    Copy the full SHA
    1794a7b View commit details
    Browse the repository at this point in the history
Loading