fix(bedrock_mantle): price GovCloud regions from the regional cost row and accept region-prefixed model names by mateo-berri · Pull Request #39846 · BerriAI/litellm

mateo-berri · 2026-09-05T01:35:02Z

TLDR

Problem this solves:

Mantle calls served in us-gov-west-1 were billed at the commercial rate
bedrock_mantle/us-gov-west-1/<model> deployments returned 404 or went to us-east-1

How it solves it:

Cost lookup now keys on the served region: bedrock_mantle/<region>/<model>
A region prefix in the model name routes there and is stripped before sending
An explicit aws_region_name still wins over the model prefix
A deployment with base_model or custom pricing keeps pricing from that row, the same as before this PR

Decision on base_model: a deployment that sets base_model (or input_cost_per_token / output_cost_per_token) is priced from that row alone and the served region is not applied on top of it, which is what the merge base does for regional Bedrock today (a Claude Instant base_model in eu-central-1 prices at the flat 8e-07 per input token on both sides, not the 2.48e-06 eu-central-1 row). The alternative, pricing from bedrock/<region>/<base_model> whenever that row exists, was rejected because base_model is the admin's explicit cost key and repricing every regional base_model deployment is its own billing change. An admin who wants the regional rate sets base_model to that row's key (bedrock/eu-central-1/anthropic.claude-instant-v1 prices at 2.48e-06)

User Flow

Before: a GovCloud admin's Mantle deployment is billed at the commercial rate, and the region-prefixed name the GovCloud price is published under does not work at all

The admin adds mantle-gov-grok (bedrock_mantle/xai.grok-4.3, aws_region_name: us-gov-west-1, GovCloud IAM keys) to the proxy config and restarts
A developer sends POST https://litellm-domain/v1/chat/completions with "model": "mantle-gov-grok", a 38-token prompt, and "max_tokens": 20
The response is 200 with usage of 38 prompt and 20 completion tokens and the header x-litellm-response-cost: 9.750000000000001e-05, the commercial rate (1.25 / 2.5 per million tokens) instead of the GovCloud rate (1.5 / 3 per million, 0.000117 for this call)
The same call with "stream": true, and the same prompt over POST https://litellm-domain/v1/responses and POST https://litellm-domain/v1/messages (streaming or not), all report cost 9.75e-05 too
The admin switches the deployment to the name the GovCloud price is published under, bedrock_mantle/us-gov-west-1/xai.grok-4.3: with aws_region_name still set every call returns 404 The model 'us-gov-west-1/xai.grok-4.3' does not exist, and without it 401 The security token included in the request is invalid. because the call went to us-east-1

After: the same deployment is billed at the GovCloud rate, and the region-prefixed name routes to that region

The admin adds mantle-gov-grok (bedrock_mantle/xai.grok-4.3, aws_region_name: us-gov-west-1, GovCloud IAM keys) to the proxy config and restarts
A developer sends POST https://litellm-domain/v1/chat/completions with "model": "mantle-gov-grok", a 38-token prompt, and "max_tokens": 20
The response is 200 with the same usage and the header x-litellm-response-cost: 0.000117, the GovCloud rate
The streaming call, POST https://litellm-domain/v1/responses, and POST https://litellm-domain/v1/messages (streaming or not) all report cost 0.000117
A deployment on bedrock_mantle/us-gov-west-1/xai.grok-4.3 returns 200 at 0.000117 with or without aws_region_name, served by the GovCloud endpoint (the deployment's GovCloud-only keys were rejected anywhere else in step 5 above)

Relevant issues

Linear ticket

Resolves LIT-6946

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

I have added meaningful tests
The handful of test files covering my change pass locally, e.g. uv run pytest tests/test_litellm/<your_test_file>.py -v. Leave the suites (make test-unit-*, make test-unit) to CI: it finishes in ~15 minutes where a laptop takes an hour or more
My PR passes all required CI/CD checks (e.g., lint, schema.d.ts sync check, etc.)
My PR's scope is as isolated as possible; it only solves 1 specific problem
I have received a Greptile Confidence Score of at least 4/5 before requesting a maintainer review (Greptile reviews automatically once the PR is opened; only comment @greptileai to re-request a review after pushing changes)

Delays in PR merge?

If you're seeing a delay in your PR being merged, ping the LiteLLM Team on Slack (#pr-review).

Screenshots / Proof of Fix

Shared setup for both legs: one proxy process with 2 uvicorn workers, each leg backed by its own Postgres, calling the real Bedrock Mantle GovCloud endpoint over SigV4 with GovCloud IAM keys (no AWS_BEARER_TOKEN_BEDROCK in the environment). LITELLM_LOCAL_MODEL_COST_MAP=True so the price rows come from the checkout. Every successful call below came back with 38 prompt and 20 completion tokens, so the commercial row bedrock_mantle/xai.grok-4.3 (1.25e-06 / 2.5e-06) prices it at 9.75e-05 and the GovCloud row bedrock_mantle/us-gov-west-1/xai.grok-4.3 (1.5e-06 / 3e-06) at 0.000117. include_cost_in_streaming_usage is on so streams report the cost in their final usage chunk

qa_config.yaml:

model_list:
  - model_name: mantle-gov-grok
    litellm_params:
      model: bedrock_mantle/xai.grok-4.3
      aws_region_name: us-gov-west-1
      aws_access_key_id: os.environ/AWS_GOV_ACCESS_KEY_ID
      aws_secret_access_key: os.environ/AWS_GOV_SECRET_ACCESS_KEY
  - model_name: mantle-gov-grok-prefixed
    litellm_params:
      model: bedrock_mantle/us-gov-west-1/xai.grok-4.3
      aws_region_name: us-gov-west-1
      aws_access_key_id: os.environ/AWS_GOV_ACCESS_KEY_ID
      aws_secret_access_key: os.environ/AWS_GOV_SECRET_ACCESS_KEY
  - model_name: mantle-gov-grok-prefix-only
    litellm_params:
      model: bedrock_mantle/us-gov-west-1/xai.grok-4.3
      aws_access_key_id: os.environ/AWS_GOV_ACCESS_KEY_ID
      aws_secret_access_key: os.environ/AWS_GOV_SECRET_ACCESS_KEY
general_settings:
  master_key: os.environ/LITELLM_MASTER_KEY
litellm_settings:
  include_cost_in_streaming_usage: true

Boot (Before from a worktree at e5da593, the merge base, After from a worktree at a6bd4c0, this PR's head):

DATABASE_URL="$DATABASE_URL_BEFORE" python litellm/proxy/proxy_cli.py --config qa_config.yaml --port 16092 --num_workers 2   # Before
DATABASE_URL="$DATABASE_URL_AFTER" python litellm/proxy/proxy_cli.py --config qa_config.yaml --port 16093 --num_workers 2    # After
H=(-H "Authorization: Bearer $LITELLM_MASTER_KEY" -H 'Content-Type: application/json')

Every output below is trimmed to the status line, the x-litellm-response-cost header, and the usage object (or the error body); streams are trimmed to their final usage chunk, and the /spend/logs rows to their identifying fields. The Before leg waits 6 seconds after each failed call so the router's cooldown does not turn the next call into a 429

Before (`e5da593`)

Bare model with `aws_region_name`, `mantle-gov-grok`

Chat completions

curl -si -X POST http://127.0.0.1:16092/v1/chat/completions "${H[@]}" \
  -d '{"model": "mantle-gov-grok", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 9.750000000000001e-05
"usage": {"completion_tokens":20,"prompt_tokens":38,"total_tokens":58}

Chat completions stream (same body plus "stream": true, "stream_options": {"include_usage": true})

data: {"id":"chatcmpl-icg2saa...","model":"mantle-gov-grok","usage":{"completion_tokens":20,"prompt_tokens":38,"total_tokens":58,"cost":0.00009750000000000001}}

/v1/responses

curl -si -X POST http://127.0.0.1:16092/v1/responses "${H[@]}" \
  -d '{"model": "mantle-gov-grok", "input": "Reply with the single word GovCloud.", "max_output_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 9.750000000000001e-05
"usage": {"input_tokens":38,"output_tokens":20,"total_tokens":58,"cost":null}

/v1/messages

curl -si -X POST http://127.0.0.1:16092/v1/messages "${H[@]}" \
  -d '{"model": "mantle-gov-grok", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 9.750000000000001e-05
"usage": {"input_tokens":38,"output_tokens":20}

/v1/messages stream (same body plus "stream": true)

data: {"type": "message_delta", "delta": {"stop_reason": "max_tokens"}, "usage": {"input_tokens": 38, "output_tokens": 20, "cost": 9.750000000000001e-05}}

Region-prefixed model with `aws_region_name`, `mantle-gov-grok-prefixed`

Chat completions

curl -si -X POST http://127.0.0.1:16092/v1/chat/completions "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefixed", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 404 Not Found
{"error":{"message":"litellm.NotFoundError: BedrockException - {\"error\":{\"code\":\"not_found_error\",\"message\":\"The model 'us-gov-west-1/xai.grok-4.3' does not exist\",\"param\":null,\"type\":\"invalid_request_error\"}}. Received Model Group=mantle-gov-grok-prefixed\nAvailable Model Group Fallbacks=None","type":"invalid_request_error","param":null,"code":"404"}}

Chat completions stream (same body plus "stream": true, "stream_options": {"include_usage": true})

HTTP/1.1 404 Not Found
{"error":{"message":"litellm.NotFoundError: BedrockException - {\"error\":{\"code\":\"not_found_error\",\"message\":\"The model 'us-gov-west-1/xai.grok-4.3' does not exist\",\"param\":null,\"type\":\"invalid_request_error\"}}. Received Model Group=mantle-gov-grok-prefixed\nAvailable Model Group Fallbacks=None","type":"invalid_request_error","param":null,"code":"404"}}

/v1/responses

curl -si -X POST http://127.0.0.1:16092/v1/responses "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefixed", "input": "Reply with the single word GovCloud.", "max_output_tokens": 20}'

HTTP/1.1 404 Not Found
{"error":{"message":"litellm.NotFoundError: BedrockException - {\"error\":{\"code\":\"not_found_error\",\"message\":\"The model 'us-gov-west-1/xai.grok-4.3' does not exist\",\"param\":null,\"type\":\"invalid_request_error\"}}. Received Model Group=mantle-gov-grok-prefixed\nAvailable Model Group Fallbacks=None","type":"invalid_request_error","param":null,"code":"404"}}

/v1/messages

curl -si -X POST http://127.0.0.1:16092/v1/messages "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefixed", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 404 Not Found
{"type":"error","error":{"type":"not_found_error","message":"litellm.NotFoundError: BedrockException - {\"error\":{\"code\":\"not_found_error\",\"message\":\"The model 'us-gov-west-1/xai.grok-4.3' does not exist\",\"param\":null,\"type\":\"invalid_request_error\"}}. Received Model Group=mantle-gov-grok-prefixed\nAvailable Model Group Fallbacks=None"}}

/v1/messages stream (same body plus "stream": true)

HTTP/1.1 404 Not Found
{"type":"error","error":{"type":"not_found_error","message":"litellm.NotFoundError: BedrockException - {\"error\":{\"code\":\"not_found_error\",\"message\":\"The model 'us-gov-west-1/xai.grok-4.3' does not exist\",\"param\":null,\"type\":\"invalid_request_error\"}}. Received Model Group=mantle-gov-grok-prefixed\nAvailable Model Group Fallbacks=None"}}

Region-prefixed model alone, `mantle-gov-grok-prefix-only`

Chat completions

curl -si -X POST http://127.0.0.1:16092/v1/chat/completions "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefix-only", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 401 Unauthorized
{"error":{"message":"litellm.AuthenticationError: BedrockException Invalid Authentication - {\"error\":{\"code\":\"invalid_api_key\",\"message\":\"The security token included in the request is invalid.\",\"param\":null,\"type\":\"permission_denied_error\"}}. Received Model Group=mantle-gov-grok-prefix-only\nAvailable Model Group Fallbacks=None","type":"authentication_error","param":null,"code":"401"}}

Chat completions stream (same body plus "stream": true, "stream_options": {"include_usage": true})

HTTP/1.1 401 Unauthorized
{"error":{"message":"litellm.AuthenticationError: BedrockException Invalid Authentication - {\"error\":{\"code\":\"invalid_api_key\",\"message\":\"The security token included in the request is invalid.\",\"param\":null,\"type\":\"permission_denied_error\"}}. Received Model Group=mantle-gov-grok-prefix-only\nAvailable Model Group Fallbacks=None","type":"authentication_error","param":null,"code":"401"}}

/v1/responses

curl -si -X POST http://127.0.0.1:16092/v1/responses "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefix-only", "input": "Reply with the single word GovCloud.", "max_output_tokens": 20}'

HTTP/1.1 401 Unauthorized
{"error":{"message":"litellm.AuthenticationError: BedrockException Invalid Authentication - {\"error\":{\"code\":\"invalid_api_key\",\"message\":\"The security token included in the request is invalid.\",\"param\":null,\"type\":\"permission_denied_error\"}}. Received Model Group=mantle-gov-grok-prefix-only\nAvailable Model Group Fallbacks=None","type":"authentication_error","param":null,"code":"401"}}

/v1/messages

curl -si -X POST http://127.0.0.1:16092/v1/messages "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefix-only", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 401 Unauthorized
{"type":"error","error":{"type":"authentication_error","message":"litellm.AuthenticationError: BedrockException Invalid Authentication - {\"error\":{\"code\":\"invalid_api_key\",\"message\":\"The security token included in the request is invalid.\",\"param\":null,\"type\":\"permission_denied_error\"}}. Received Model Group=mantle-gov-grok-prefix-only\nAvailable Model Group Fallbacks=None"}}

/v1/messages stream (same body plus "stream": true)

HTTP/1.1 401 Unauthorized
{"type":"error","error":{"type":"authentication_error","message":"litellm.AuthenticationError: BedrockException Invalid Authentication - {\"error\":{\"code\":\"invalid_api_key\",\"message\":\"The security token included in the request is invalid.\",\"param\":null,\"type\":\"permission_denied_error\"}}. Received Model Group=mantle-gov-grok-prefix-only\nAvailable Model Group Fallbacks=None"}}

GET /spend/logs for the calls above

mantle-gov-grok, the chat completion above ("id": "chatcmpl-uydfodoyukxdmcjhgcgg72c6kk6dfliwrk2wgnczml54urnw5rtq")

curl -si "http://127.0.0.1:16092/spend/logs?request_id=chatcmpl-uydfodoyukxdmcjhgcgg72c6kk6dfliwrk2wgnczml54urnw5rtq" "${H[@]}"

HTTP/1.1 200 OK
{"request_id":"chatcmpl-uydfodoyukxdmcjhgcgg72c6kk6dfliwrk2wgnczml54urnw5rtq","model":"bedrock_mantle/xai.grok-4.3","model_group":"mantle-gov-grok","spend":0.00009750000000000001,"prompt_tokens":38,"completion_tokens":20}

mantle-gov-grok-prefixed: no spend row, the chat call above failed
mantle-gov-grok-prefix-only: no spend row, the chat call above failed

After (`a6bd4c0`)

Bare model with `aws_region_name`, `mantle-gov-grok`

Chat completions

curl -si -X POST http://127.0.0.1:16093/v1/chat/completions "${H[@]}" \
  -d '{"model": "mantle-gov-grok", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"completion_tokens":20,"prompt_tokens":38,"total_tokens":58}

Chat completions stream (same body plus "stream": true, "stream_options": {"include_usage": true})

data: {"id":"chatcmpl-64jr64w...","model":"mantle-gov-grok","usage":{"completion_tokens":20,"prompt_tokens":38,"total_tokens":58,"cost":0.000117}}

/v1/responses

curl -si -X POST http://127.0.0.1:16093/v1/responses "${H[@]}" \
  -d '{"model": "mantle-gov-grok", "input": "Reply with the single word GovCloud.", "max_output_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"input_tokens":38,"output_tokens":20,"total_tokens":58,"cost":null}

/v1/messages

curl -si -X POST http://127.0.0.1:16093/v1/messages "${H[@]}" \
  -d '{"model": "mantle-gov-grok", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"input_tokens":38,"output_tokens":20}

/v1/messages stream (same body plus "stream": true)

data: {"type": "message_delta", "delta": {"stop_reason": "max_tokens"}, "usage": {"input_tokens": 38, "output_tokens": 20, "cost": 0.000117}}

Region-prefixed model with `aws_region_name`, `mantle-gov-grok-prefixed`

Chat completions

curl -si -X POST http://127.0.0.1:16093/v1/chat/completions "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefixed", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"completion_tokens":20,"prompt_tokens":38,"total_tokens":58}

Chat completions stream (same body plus "stream": true, "stream_options": {"include_usage": true})

data: {"id":"chatcmpl-a326d4s...","model":"mantle-gov-grok-prefixed","usage":{"completion_tokens":20,"prompt_tokens":38,"total_tokens":58,"cost":0.000117}}

/v1/responses

curl -si -X POST http://127.0.0.1:16093/v1/responses "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefixed", "input": "Reply with the single word GovCloud.", "max_output_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"input_tokens":38,"output_tokens":20,"total_tokens":58,"cost":null}

/v1/messages

curl -si -X POST http://127.0.0.1:16093/v1/messages "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefixed", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"input_tokens":38,"output_tokens":20}

/v1/messages stream (same body plus "stream": true)

data: {"type": "message_delta", "delta": {"stop_reason": "max_tokens"}, "usage": {"input_tokens": 38, "output_tokens": 20, "cost": 0.000117}}

Region-prefixed model alone, `mantle-gov-grok-prefix-only`

Chat completions

curl -si -X POST http://127.0.0.1:16093/v1/chat/completions "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefix-only", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"completion_tokens":20,"prompt_tokens":38,"total_tokens":58}

Chat completions stream (same body plus "stream": true, "stream_options": {"include_usage": true})

data: {"id":"chatcmpl-tv6p3kz...","model":"mantle-gov-grok-prefix-only","usage":{"completion_tokens":20,"prompt_tokens":38,"total_tokens":58,"cost":0.000117}}

/v1/responses

curl -si -X POST http://127.0.0.1:16093/v1/responses "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefix-only", "input": "Reply with the single word GovCloud.", "max_output_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"input_tokens":38,"output_tokens":20,"total_tokens":58,"cost":null}

/v1/messages

curl -si -X POST http://127.0.0.1:16093/v1/messages "${H[@]}" \
  -d '{"model": "mantle-gov-grok-prefix-only", "messages": [{"role": "user", "content": "Reply with the single word GovCloud."}], "max_tokens": 20}'

HTTP/1.1 200 OK
x-litellm-response-cost: 0.000117
"usage": {"input_tokens":38,"output_tokens":20}

/v1/messages stream (same body plus "stream": true)

data: {"type": "message_delta", "delta": {"stop_reason": "max_tokens"}, "usage": {"input_tokens": 38, "output_tokens": 20, "cost": 0.000117}}

GET /spend/logs for the calls above

mantle-gov-grok, the chat completion above ("id": "chatcmpl-u6za3gjh5aq6bnnmsfkbckrebbfozy4mslakwvw352lyb6qtlwpa")

curl -si "http://127.0.0.1:16093/spend/logs?request_id=chatcmpl-u6za3gjh5aq6bnnmsfkbckrebbfozy4mslakwvw352lyb6qtlwpa" "${H[@]}"

HTTP/1.1 200 OK
{"request_id":"chatcmpl-u6za3gjh5aq6bnnmsfkbckrebbfozy4mslakwvw352lyb6qtlwpa","model":"bedrock_mantle/xai.grok-4.3","model_group":"mantle-gov-grok","spend":0.000117,"prompt_tokens":38,"completion_tokens":20}

mantle-gov-grok-prefixed, the chat completion above ("id": "chatcmpl-6jim3bycpas4rmcaes27j4q7x6tbdkczp7t573hdxfch6t5lmdqa")

curl -si "http://127.0.0.1:16093/spend/logs?request_id=chatcmpl-6jim3bycpas4rmcaes27j4q7x6tbdkczp7t573hdxfch6t5lmdqa" "${H[@]}"

HTTP/1.1 200 OK
{"request_id":"chatcmpl-6jim3bycpas4rmcaes27j4q7x6tbdkczp7t573hdxfch6t5lmdqa","model":"bedrock_mantle/us-gov-west-1/xai.grok-4.3","model_group":"mantle-gov-grok-prefixed","spend":0.000117,"prompt_tokens":38,"completion_tokens":20}

mantle-gov-grok-prefix-only, the chat completion above ("id": "chatcmpl-wles55j7kcwllgzfbrw7ormjw7gohnu6uecvmua27aj5oibe6kqq")

curl -si "http://127.0.0.1:16093/spend/logs?request_id=chatcmpl-wles55j7kcwllgzfbrw7ormjw7gohnu6uecvmua27aj5oibe6kqq" "${H[@]}"

HTTP/1.1 200 OK
{"request_id":"chatcmpl-wles55j7kcwllgzfbrw7ormjw7gohnu6uecvmua27aj5oibe6kqq","model":"bedrock_mantle/us-gov-west-1/xai.grok-4.3","model_group":"mantle-gov-grok-prefix-only","spend":0.000117,"prompt_tokens":38,"completion_tokens":20}

Observations from the run, each left alone by this PR:

GET /model/info shows 1.25e-06 for mantle-gov-grok on both legs
/v1/responses body has usage.cost: null on both legs; header carries it
grok-4.3 at 20 max tokens returns empty content, 17 reasoning tokens

Type

🐛 Bug Fix

Caveats (if any)

Low

/model/info prices aws_region_name deployments from the flat row; pre-existing, display only
/v1/responses body usage.cost stays null; the header carries the cost; pre-existing
A key or team allowed the wildcard bedrock_mantle/xai.* can now call bedrock_mantle/us-gov-west-1/xai.grok-4.3 (403 at the merge base, 200 here), because the access check strips the region prefix the same way routing does; exact-name allowlists are unchanged (403 on both sides). The region-prefixed name only became callable with this PR, and the wildcard already meant every xai Mantle model
bedrock_mantle/ap-southeast-3/<model> is not split as a region prefix because ap-southeast-3 is missing from the Bedrock region list the splitter uses; the prefix form never worked there before this PR either
base_model deployments in a regional Bedrock region keep the flat row price; see the decision note in the TLDR
Plain Bedrock (non-Mantle) streams are untouched; the region resolver is Mantle-only
The model_map_key and model_map_value metadata in the standard logging payload (what logging callbacks and spend log metadata carry) still name the flat bedrock_mantle/<model> row for an aws_region_name deployment, because that metadata is built without the region; the billed response_cost is the regional one, so this is reporting only
/spend/calculate, the cost quote endpoint, and the savings baselines price by model name with no region, so they quote the flat row for a regional Mantle deployment; the same is true for every other regional cost row today and this PR leaves it alone
The Bedrock Mantle docs page still describes the old region precedence and not the bedrock_mantle/<region>/<model> form; fixed by docs(bedrock_mantle): document region precedence, the region-prefixed model form, and GovCloud pricing litellm-docs#1405, merged
CircleCI llm_translation_testing and local_testing_part1 are red at a6bd4c0 and f6685b7 on four tests that fail identically on staging's own pipeline at the merge base (test_azure_gpt_4o_with_tool_call_and_response_format, test_openai_max_retries_0, test_openai_o_series_max_retries_0, test_completion_novita_ai, all provider returned a response with no 'choices' from Azure, OpenAI, and Novita); this PR touches none of those paths

Final Attestation

The tests check the right things, including the edge cases, and regressions in the respective real-world customer use-cases are not possible after this PR
f6685b7 rewrites only the author of a6bd4c0 (identical tree), so the QA and /live-pr-risk runs at a6bd4c0 still stand
a6bd4c0 passes /live-pr-risk

…w and accept region-prefixed model names

codspeed · 2026-09-05T01:37:12Z

Merging this PR will not alter performance

✅ 31 untouched benchmarks

_{Comparing litellm_bedrock_mantle_govcloud_cost_row (f6685b7) with litellm_internal_staging (c1a83fc)}

greptile-apps · 2026-09-05T01:37:48Z

Greptile Summary

This PR fixes Bedrock Mantle regional routing and cost attribution.

Resolves the served Mantle region from explicit configuration, region-prefixed model names, API base hosts, or existing defaults.
Strips recognized region prefixes before sending model identifiers to Mantle.
Uses regional cost rows while preserving explicit base_model and custom-pricing behavior.
Adds coverage for GovCloud routing, request signing, response paths, logging, and regional cost calculation.
No code changed since the previous review.

Confidence Score: 5/5

The PR appears safe to merge, with no outstanding blocking findings or new issues since the previous review.

The current implementation consistently uses the resolved serving region for Mantle routing and billing while preserving explicit pricing behavior. The first prior finding was correctly conceded, and the remaining prior test-mutation thread was manually resolved without explanation.

Important Files Changed

Filename	Overview
litellm/llms/bedrock_mantle/common_utils.py	Centralizes Mantle region-prefix parsing and applies bare model identifiers to capability and API-base resolution.
litellm/llms/bedrock_mantle/chat/transformation.py	Routes region-prefixed models to the selected Mantle endpoint while preserving explicit-region precedence.
litellm/cost_calculator.py	Propagates served-region context into cost selection without overriding explicit base-model or custom pricing.
litellm/litellm_core_utils/litellm_logging.py	Supplies the resolved Mantle serving region to response cost calculation.
litellm/litellm_core_utils/get_llm_provider_logic.py	Removes routing-only region prefixes before returning the provider model identifier.
tests/test_litellm/llms/bedrock_mantle/test_bedrock_mantle_transformation.py	Covers prefixed routing, precedence, SigV4 region selection, bare outbound model names, and regional pricing.
tests/test_litellm/test_cost_calculator.py	Covers regional Mantle rows, provider-prefixed inputs, and explicit base-model pricing behavior.
tests/test_litellm/litellm_core_utils/test_litellm_logging.py	Covers logging-layer resolution and regional response-cost attribution.

_{Reviews (9): Last reviewed commit: "fix(cost_calculator): keep base_model pr..." | Re-trigger Greptile}

mateo-berri · 2026-09-05T01:39:36Z

@greptileai

veria-ai · 2026-09-05T01:41:47Z

PR overview

This PR updates Bedrock Mantle cost calculation to use regional pricing rows for GovCloud regions and to recognize region-prefixed model names.

One issue has been addressed, but regional context can still be discarded when a base model is treated as explicit pricing. This can underbill regional Bedrock usage by more than threefold, allowing users to consume substantially more provider spend before budget limits take effect.

Open issues (1)

Medium: Regional pricing bypass — litellm/cost_calculator.py:1659

Fixed/addressed: 1 · PR risk: 6/10

codecov · 2026-09-05T01:43:26Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

mateo-berri · 2026-09-05T01:51:05Z

bugbot run

cursor

Stale Bugbot comment from a previous run.

… GovCloud pricing

mateo-berri · 2026-09-05T02:15:23Z

@greptileai

…able list

mateo-berri · 2026-09-05T02:22:12Z

@greptileai

mateo-berri · 2026-09-05T02:25:43Z

bugbot run

cursor

Stale Bugbot comment from a previous run.

…cloud_cost_row

mateo-berri · 2026-09-10T14:11:33Z

@greptileai

mateo-berri · 2026-09-10T14:35:24Z

@greptileai

veria-ai · 2026-09-10T14:40:13Z

                    custom_llm_provider=custom_llm_provider,
                    response_time_ms=total_time,
-                    region_name=region_name,
+                    region_name=None if explicit_pricing else region_name,


Medium: Regional pricing bypass

Treating base_model as explicit pricing drops the actual request region and underbills regional Bedrock traffic. For the case added by this PR, the flat Claude Instant row is 3.1–3.49× cheaper than the eu-central-1 row, allowing a user to consume substantially more provider spend before reaching their budget; only actual custom pricing should suppress regional lookup.

Suggested change

region_name=None if explicit_pricing else region_name,

region_name=None if custom_pricing is True else region_name,

Flat pricing for base_model deployments is the merge-base behavior, verified live on both sides. Repricing them regionally is a separate billing change, not this fix.

mateo-berri · 2026-09-10T14:46:08Z

bugbot run

cursor

Stale Bugbot comment from a previous run.

A deployment with base_model set was priced from the region's own row once completion_cost forwarded the response region into cost_per_token, which now strips the provider prefix and finds bedrock/<region>/<base_model>. Explicit pricing (base_model or custom pricing) suppresses the region for cost_per_token the same way _select_model_name_for_cost_calc already does

mateo-berri · 2026-09-10T15:12:48Z

@greptileai

mateo-berri · 2026-09-10T15:15:30Z

bugbot run

cursor

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

^{Reviewed by Cursor Bugbot for commit f6685b7. Configure here.}

…103.0) (#290) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [ghcr.io/berriai/litellm](https://images.chainguard.dev/directory/image/wolfi-base/overview) ([source](https://github.com/BerriAI/litellm)) | minor | `v1.102.1` → `v1.103.0` | --- ### Release Notes <details> <summary>BerriAI/litellm (ghcr.io/berriai/litellm)</summary> ### [`v1.103.0`](https://github.com/BerriAI/litellm/releases/tag/v1.103.0) [Compare Source](https://github.com/BerriAI/litellm/compare/v1.102.1...v1.103.0) #### Verify Docker Image Signature All LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0). **Verify using the pinned commit hash (recommended):** A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.0 ``` **Verify using the release tag (convenience):** Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.0 ``` Expected output: ``` The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key ``` *** #### What's Changed - fix(responses): translate the reasoning object into a chat-completion reasoning effort by [@joshgarnett](https://github.com/joshgarnett) in [#36363](https://github.com/BerriAI/litellm/pull/36363) - fix(proxy): bound tool and guardrail index create\_many by the spend-log statement budgets by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40561](https://github.com/BerriAI/litellm/pull/40561) - fix(mcp): require admission for delegated OAuth by [@joshua-berri](https://github.com/joshua-berri) in [#40923](https://github.com/BerriAI/litellm/pull/40923) - fix(logging): log one bounded summary for a burst of timed-out LoggingWorker callbacks by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40912](https://github.com/BerriAI/litellm/pull/40912) - fix(fireworks): resolve short model names to long cost map keys by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40929](https://github.com/BerriAI/litellm/pull/40929) - ci: remove main branch source guard by [@yuneng-berri](https://github.com/yuneng-berri) in [#40172](https://github.com/BerriAI/litellm/pull/40172) - chore(ci): promote internal staging to main by [@yuneng-berri](https://github.com/yuneng-berri) in [#40942](https://github.com/BerriAI/litellm/pull/40942) - fix(spend\_logs): store litellm\_call\_id and match it in request\_id lookups by [@mateo-berri](https://github.com/mateo-berri) in [#39068](https://github.com/BerriAI/litellm/pull/39068) - fix(auth): refresh lite login session token grants from the live user and team rows by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#40657](https://github.com/BerriAI/litellm/pull/40657) - feat(bedrock): support file delete and list for S3-backed managed files by [@mateo-berri](https://github.com/mateo-berri) in [#39836](https://github.com/BerriAI/litellm/pull/39836) - fix(proxy): gate the webhook test alert on proxy admins by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#40814](https://github.com/BerriAI/litellm/pull/40814) - fix(ui): hide admin write-form tabs on the models page from view-only admins by [@mateo-berri](https://github.com/mateo-berri) in [#38867](https://github.com/BerriAI/litellm/pull/38867) - fix(anthropic-adapter): surface mid-stream provider errors as Anthropic error events by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#33352](https://github.com/BerriAI/litellm/pull/33352) - docs(github): add an Affected release section to the PR template by [@mateo-berri](https://github.com/mateo-berri) in [#40618](https://github.com/BerriAI/litellm/pull/40618) - docs(e2e): ban unit tests under tests/e2e by [@yassin-berriai](https://github.com/yassin-berriai) in [#33852](https://github.com/BerriAI/litellm/pull/33852) - fix(router): preserve Azure Entra ID params in reusable credentials by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40889](https://github.com/BerriAI/litellm/pull/40889) - docs(user endpoints): remove unsupported soft\_budget param from user docstrings by [@shivamrawat1](https://github.com/shivamrawat1) in [#36585](https://github.com/BerriAI/litellm/pull/36585) - feat(friendli): auto-sync Friendli model metadata into price registry by [@Lee-Si-Yoon](https://github.com/Lee-Si-Yoon) in [#35918](https://github.com/BerriAI/litellm/pull/35918) - build(deps): bump smol-toml to 1.8.0 to clear GHSA-7w5x-hrqm-74c2 in osv-scan by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40478](https://github.com/BerriAI/litellm/pull/40478) - fix(bedrock\_mantle): price GovCloud regions from the regional cost row and accept region-prefixed model names by [@mateo-berri](https://github.com/mateo-berri) in [#39846](https://github.com/BerriAI/litellm/pull/39846) - chore(ci): remerge internal staging by [@yuneng-berri](https://github.com/yuneng-berri) in [#40943](https://github.com/BerriAI/litellm/pull/40943) - test(auth): freeze the cache clock in auth prefetch tests by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40996](https://github.com/BerriAI/litellm/pull/40996) - feat(jwt): allow virtual\_key\_claim\_field per issuer by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40927](https://github.com/BerriAI/litellm/pull/40927) - fix(cost): bill cached realtime audio tokens at the audio cache-read rate by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40627](https://github.com/BerriAI/litellm/pull/40627) - perf(logging): skip correlation contextvar stamping when request\_correlation\_in\_logs is off by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41054](https://github.com/BerriAI/litellm/pull/41054) - feat(pricing): add azure gpt-chat-latest rates and drop retired friendliai llama-3.1 entries by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40976](https://github.com/BerriAI/litellm/pull/40976) - build(deps): re-suppress GHSA-h7x2-h6g9-p789 in osv-scan on main, mlflow still has no fixed release by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41104](https://github.com/BerriAI/litellm/pull/41104) - fix(otel): cap per-index OpenInference message attributes span-wide by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40562](https://github.com/BerriAI/litellm/pull/40562) - feat(proxy): add general\_settings.allowed\_file\_extensions for /v1/files uploads by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41106](https://github.com/BerriAI/litellm/pull/41106) - fix(proxy): forward provider request id headers on mapped error responses by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40925](https://github.com/BerriAI/litellm/pull/40925) - fix(router): name the all-deployments-in-cooldown error on 429 responses by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40995](https://github.com/BerriAI/litellm/pull/40995) - fix(ui): show the team alias on the model info page and in its raw JSON by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40992](https://github.com/BerriAI/litellm/pull/40992) - feat(proxy): honor LITELLM\_DISABLE\_ACCESS\_LOG\_PATHS to drop noisy uvicorn access log lines by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41096](https://github.com/BerriAI/litellm/pull/41096) - fix(prometheus): label pre-call rate limit failures with the resolved api\_provider by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41059](https://github.com/BerriAI/litellm/pull/41059) - perf(proxy): serialize /model/info listing once with orjson by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41114](https://github.com/BerriAI/litellm/pull/41114) - fix(utils): stop wrapper\_async submitting the sync success handler twice by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41115](https://github.com/BerriAI/litellm/pull/41115) - fix(redis): log a timeout streak once per interval instead of one line per cache call by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40817](https://github.com/BerriAI/litellm/pull/40817) - fix(router): record flat retry attempts and cap retries from attempted\_retries by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40930](https://github.com/BerriAI/litellm/pull/40930) - refactor(prometheus): source PROXY\_LLM\_PROVIDER\_FALLBACK from litellm.constants by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41118](https://github.com/BerriAI/litellm/pull/41118) - fix(proxy): hide default credentials login hint when UI\_PASSWORD is set by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41107](https://github.com/BerriAI/litellm/pull/41107) - fix(cli): show routed models and session stats for LLM API keys by [@tin-berri](https://github.com/tin-berri) in [#41116](https://github.com/BerriAI/litellm/pull/41116) - fix(bedrock/realtime): propagate deferred Nova Sonic stream failures to the router by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41064](https://github.com/BerriAI/litellm/pull/41064) - fix(proxy): keep org admins' own team memberships in other orgs visible on team list by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41086](https://github.com/BerriAI/litellm/pull/41086) - feat(model\_info): provider-scoped fill\_missing\_for\_providers backfill from fallback generalization rules by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41093](https://github.com/BerriAI/litellm/pull/41093) - fix(auth): load team membership once per request and skip prisma on an L1 hit by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41102](https://github.com/BerriAI/litellm/pull/41102) - refactor(harness): expand independent trace coverage by [@yujonglee-berri](https://github.com/yujonglee-berri) in [#41120](https://github.com/BerriAI/litellm/pull/41120) - fix(proxy): release max\_parallel\_requests slot when a realtime session ends without LLM callbacks by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41113](https://github.com/BerriAI/litellm/pull/41113) - fix(router): cool down team deployments on 429 when a sibling serves the same public model by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40991](https://github.com/BerriAI/litellm/pull/40991) - fix(ui): move tags typed into key metadata JSON into the Tags field by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41023](https://github.com/BerriAI/litellm/pull/41023) - fix(ui): let team admins grant a team all proxy models by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#40196](https://github.com/BerriAI/litellm/pull/40196) - chore(lint): graduate 12 rules from the strict-gate ratchet by [@HUAHAODIA](https://github.com/HUAHAODIA) in [#41048](https://github.com/BerriAI/litellm/pull/41048) - test: add dedicated CircleCI integration contract foundation by [@yuneng-berri](https://github.com/yuneng-berri) in [#41066](https://github.com/BerriAI/litellm/pull/41066) - fix(utils): keep litellm params out of provider request bodies by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41018](https://github.com/BerriAI/litellm/pull/41018) - fix(openai): keep extra\_headers out of the chat request body on the httpx handler path by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41141](https://github.com/BerriAI/litellm/pull/41141) - test: cover persisted updates and warmed authorization policies by [@yuneng-berri](https://github.com/yuneng-berri) in [#41070](https://github.com/BerriAI/litellm/pull/41070) - fix(proxy): resolve x-litellm-call-id from response metadata when routes omit call\_id by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41056](https://github.com/BerriAI/litellm/pull/41056) - chore(prices): sync Vertex AI prices: 14 models by [@berriai-litellm-provider-info-sync](https://github.com/berriai-litellm-provider-info-sync)\[bot] in [#40955](https://github.com/BerriAI/litellm/pull/40955) - ci(codeql): exclude noisy Python quality queries by [@yuneng-berri](https://github.com/yuneng-berri) in [#41142](https://github.com/BerriAI/litellm/pull/41142) - feat(proxy): predict prompt-cache costs across deployments by [@tin-berri](https://github.com/tin-berri) in [#40877](https://github.com/BerriAI/litellm/pull/40877) - fix(prompt\_security): keep polling file sanitization through non-terminal statuses by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41131](https://github.com/BerriAI/litellm/pull/41131) - fix(health): skip background health check DB writes when the latest-row read fails by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41145](https://github.com/BerriAI/litellm/pull/41145) - feat(model\_armor): logging\_only mode scans completed streams after delivery by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40702](https://github.com/BerriAI/litellm/pull/40702) - fix(bedrock guardrails): derive contextual grounding source and query from plain messages by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41132](https://github.com/BerriAI/litellm/pull/41132) - fix(cli): drop enum.StrEnum so the CLI imports on Python 3.10 by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41046](https://github.com/BerriAI/litellm/pull/41046) - fix(responses): route mid-stream error events through exception\_type so content\_policy\_fallbacks fire by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40988](https://github.com/BerriAI/litellm/pull/40988) - fix(cost): bill gemini-embedding-2 per token and stop double charging audio by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41157](https://github.com/BerriAI/litellm/pull/41157) - test: bind management E2E callers and isolate JWT actors by [@yuneng-berri](https://github.com/yuneng-berri) in [#40892](https://github.com/BerriAI/litellm/pull/40892) - fix(headroom): protect cache\_control-marked rows anywhere in history by [@rad-p44](https://github.com/rad-p44) in [#40315](https://github.com/BerriAI/litellm/pull/40315) - test: add strict stateless provider replay identity by [@yuneng-berri](https://github.com/yuneng-berri) in [#41149](https://github.com/BerriAI/litellm/pull/41149) - fix(ci): test checked-out model pricing in unit jobs by [@yuneng-berri](https://github.com/yuneng-berri) in [#41181](https://github.com/BerriAI/litellm/pull/41181) - fix(guardrails): write per-message guardrail rewrites back onto Responses input items by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40939](https://github.com/BerriAI/litellm/pull/40939) - fix(proxy): log the provider usage on deferred /v1/messages calls and price cache writes without a creation rate by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41172](https://github.com/BerriAI/litellm/pull/41172) - fix(guardrails): record not\_run evaluation when scoping leaves nothing to scan by [@yucheng-berri](https://github.com/yucheng-berri) in [#39050](https://github.com/BerriAI/litellm/pull/39050) - fix(responses): preserve provider affinity by [@AaronHowell](https://github.com/AaronHowell) in [#40228](https://github.com/BerriAI/litellm/pull/40228) - fix(sdk): keep body and proxy headers on BadRequestError mapped from a litellm\_proxy 400 by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40994](https://github.com/BerriAI/litellm/pull/40994) - fix(responses): hoist Codex additional\_tools input items into the chat bridge tools by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40989](https://github.com/BerriAI/litellm/pull/40989) - fix(router): honor team and key provider weights by [@tin-berri](https://github.com/tin-berri) in [#41072](https://github.com/BerriAI/litellm/pull/41072) - test(e2e): verify streamed answers and tool continuation by [@yuneng-berri](https://github.com/yuneng-berri) in [#41194](https://github.com/BerriAI/litellm/pull/41194) - fix(cli): label router costs and simplify the routed-model header by [@tin-berri](https://github.com/tin-berri) in [#41186](https://github.com/BerriAI/litellm/pull/41186) - test(spend): reconcile concurrent requests and daily activity by [@yuneng-berri](https://github.com/yuneng-berri) in [#41188](https://github.com/BerriAI/litellm/pull/41188) - fix(guardrails): scan the Anthropic top-level system prompt and tool\_use arguments by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40984](https://github.com/BerriAI/litellm/pull/40984) - fix(router): count num\_retries\_per\_request across fallback hops by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41191](https://github.com/BerriAI/litellm/pull/41191) - fix(bedrock): grant rerank, retrieve, agent, and agentcore actions in the web identity session policy by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41168](https://github.com/BerriAI/litellm/pull/41168) - fix(vertex-live): bill Gemini Live sessions end to end (internal copy of [#37075](https://github.com/BerriAI/litellm/issues/37075)) by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40915](https://github.com/BerriAI/litellm/pull/40915) - fix(health): resolve litellm\_credential\_name in realtime health checks by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41173](https://github.com/BerriAI/litellm/pull/41173) - feat(proxy): unified custom\_key\_policy hook for key generate, update and regenerate by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40921](https://github.com/BerriAI/litellm/pull/40921) - fix(proxy): enforce custom\_key\_update policy on /key/regenerate by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40695](https://github.com/BerriAI/litellm/pull/40695) - fix(router): preserve session model choice within each complexity tier by [@tin-berri](https://github.com/tin-berri) in [#41174](https://github.com/BerriAI/litellm/pull/41174) - test(pricing): let synced GovCloud Bedrock rows cite the AWS price list by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41263](https://github.com/BerriAI/litellm/pull/41263) - docs(github): ask for interactive coding-tool proof in the PR template by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41257](https://github.com/BerriAI/litellm/pull/41257) - feat(proxy): add POST /management/v1/users/bulk for batched user and team membership creation by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41028](https://github.com/BerriAI/litellm/pull/41028) - fix(credentials): answer 409 on a credential name collision, make Terraform adoption opt-in by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#40917](https://github.com/BerriAI/litellm/pull/40917) - feat(proxy): add POST /management/v1/users/bulk\_delete and POST /management/v1/teams/{team\_id}/members/bulk\_delete by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41039](https://github.com/BerriAI/litellm/pull/41039) - fix(proxy): list directly assigned team models in model access errors by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41256](https://github.com/BerriAI/litellm/pull/41256) - feat(auto-router): allow opted-in team members to manage their routers by [@tin-berri](https://github.com/tin-berri) in [#41175](https://github.com/BerriAI/litellm/pull/41175) - build(rust-bridge): add typed \_native stub and validate it with mypy.stubtest by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41180](https://github.com/BerriAI/litellm/pull/41180) - feat(guardrails): add new upstream presidio pii entities including german set by [@MvdB](https://github.com/MvdB) in [#36775](https://github.com/BerriAI/litellm/pull/36775) - fix(responses): filter bridged kwargs like the native Responses path by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41144](https://github.com/BerriAI/litellm/pull/41144) - test(e2e): cover the reliability retry, cooldown, fallback, and routing-strategy cells by [@mateo-berri](https://github.com/mateo-berri) in [#39857](https://github.com/BerriAI/litellm/pull/39857) - fix(anthropic): add the per-turn-control beta when a message carries output\_config by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41189](https://github.com/BerriAI/litellm/pull/41189) - fix(router): bind per-request routing\_strategy override selectors to the request's callbacks by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41178](https://github.com/BerriAI/litellm/pull/41178) - feat(proxy): bind JWT claims to registered agents via agent\_id\_jwt\_field by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40904](https://github.com/BerriAI/litellm/pull/40904) - fix(proxy): enforce organization budgets when max\_budget is 0 by [@yassin-berriai](https://github.com/yassin-berriai) in [#41271](https://github.com/BerriAI/litellm/pull/41271) - fix(alerting): send llm\_exceptions Slack alert for 5xx HTTPException and ProxyException by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41125](https://github.com/BerriAI/litellm/pull/41125) - fix(headroom): protect the cached prefix through the last cache\_control breakpoint by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41161](https://github.com/BerriAI/litellm/pull/41161) - fix(utils): cache custom HuggingFace tokenizers across /utils/token\_counter requests by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41216](https://github.com/BerriAI/litellm/pull/41216) - fix(router): keep weighted routing when a deployment id equals a model\_name by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41156](https://github.com/BerriAI/litellm/pull/41156) - feat(router): add capability classifier as Fuse foundation by [@tin-berri](https://github.com/tin-berri) in [#41270](https://github.com/BerriAI/litellm/pull/41270) - fix(proxy): keep access-group raw SQL writes on the writer while writer\_unavailable is stale by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41283](https://github.com/BerriAI/litellm/pull/41283) - fix(prometheus): count 401 auth failures in litellm\_proxy\_failed\_requests\_metric by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41170](https://github.com/BerriAI/litellm/pull/41170) - test: drop tests that pin vendor facts and add the CLAUDE.md rule by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41269](https://github.com/BerriAI/litellm/pull/41269) - fix(proxy): run the remaining inline token counts off the event loop by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40262](https://github.com/BerriAI/litellm/pull/40262) - fix(proxy): log blocked streaming guardrail responses as failures, not success by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40191](https://github.com/BerriAI/litellm/pull/40191) - feat(proxy): add tpd\_limit (tokens per day) for batch submissions by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40997](https://github.com/BerriAI/litellm/pull/40997) - fix(proxy): reconcile budget reservation before enqueuing spend to the DB by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40310](https://github.com/BerriAI/litellm/pull/40310) - fix(xai): stop sending web\_search\_options to xAI's retired Live Search path by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#38278](https://github.com/BerriAI/litellm/pull/38278) - feat(terraform): add tpm\_limit, rpm\_limit, budget\_duration, allowed\_models to litellm\_team\_member\_add by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#38682](https://github.com/BerriAI/litellm/pull/38682) - fix(rerank): bill Vertex search\_units from input records and give every rerank response a unique id by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#35180](https://github.com/BerriAI/litellm/pull/35180) - fix(router): stop counting caller-set timeout 408s toward deployment cooldown by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41230](https://github.com/BerriAI/litellm/pull/41230) - feat(router): add Fuse V2 classifier after capability forecasting by [@tin-berri](https://github.com/tin-berri) in [#41272](https://github.com/BerriAI/litellm/pull/41272) - fix(proxy): keep client User-Agent on auth failure spend logs by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41291](https://github.com/BerriAI/litellm/pull/41291) - fix(proxy): reset budgets by decrementing pre-reset spend instead of zeroing rows by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41279](https://github.com/BerriAI/litellm/pull/41279) - fix(xai): honor nested web\_search filters on the xAI Responses API by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#38268](https://github.com/BerriAI/litellm/pull/38268) - fix(router): stop registering a caller-supplied credential as a router deployment by [@yassin-berriai](https://github.com/yassin-berriai) in [#41289](https://github.com/BerriAI/litellm/pull/41289) - fix(router): accept custom\_provider\_map providers before the first completion call by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41300](https://github.com/BerriAI/litellm/pull/41300) - fix(proxy): return 400 instead of 500 for lone surrogate escapes in request body by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41297](https://github.com/BerriAI/litellm/pull/41297) - fix(langsmith): keep events appended during an in-flight flush instead of clearing them by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41288](https://github.com/BerriAI/litellm/pull/41288) - fix(logging): track spend for streams a deployment hook converted to non-streaming by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41171](https://github.com/BerriAI/litellm/pull/41171) - fix(bedrock): sanitize client tool\_call ids to Bedrock toolUseId constraints by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40872](https://github.com/BerriAI/litellm/pull/40872) - fix(passthrough): attribute Vertex passthrough successes to the resolved router deployment by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41307](https://github.com/BerriAI/litellm/pull/41307) - feat(ui): persist Models table search, filters, sort and page in the URL by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41296](https://github.com/BerriAI/litellm/pull/41296) - fix(jwt-auth): scope JWT key mappings by issuer to prevent cross-issuer collisions by [@yassin-berriai](https://github.com/yassin-berriai) in [#41281](https://github.com/BerriAI/litellm/pull/41281) - feat(openai): add openai\_system\_messages\_first to put system messages first for prompt caching by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41304](https://github.com/BerriAI/litellm/pull/41304) - feat(ui): add custom request headers to the API Playground by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41309](https://github.com/BerriAI/litellm/pull/41309) - feat(cli): sync Codex /model picker from proxy /v1/models in lite codex by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40476](https://github.com/BerriAI/litellm/pull/40476) - chore: bump litellm-enterprise 0.1.67 -> 0.1.68, litellm-proxy-extras 0.4.97 -> 0.4.98, litellm 1.102.0 -> 1.103.0 by [@yuneng-berri](https://github.com/yuneng-berri) in [#41321](https://github.com/BerriAI/litellm/pull/41321) - feat: add aihubmix provider pricing entries by [@IToSSc](https://github.com/IToSSc) in [#41179](https://github.com/BerriAI/litellm/pull/41179) - feat(auto-router): add per-model Fast mode toggle by [@tin-berri](https://github.com/tin-berri) in [#41282](https://github.com/BerriAI/litellm/pull/41282) - fix(proxy): include litellm\_call\_id in LLM API exception logs by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41205](https://github.com/BerriAI/litellm/pull/41205) - fix(proxy): keep yaml pass-through endpoints visible to auth after db overlay by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41303](https://github.com/BerriAI/litellm/pull/41303) - fix(proxy): resolve router\_settings.model\_group\_alias before key/team model auth by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41308](https://github.com/BerriAI/litellm/pull/41308) - fix(ui): block usage export and flag the range when a spend page fails by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41294](https://github.com/BerriAI/litellm/pull/41294) - fix(vertex\_ai): bill Gemini Omni Interactions usage and Veo sampleCount on passthrough by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41322](https://github.com/BerriAI/litellm/pull/41322) - fix(proxy): honor LITELLM\_LOG for uvicorn and proxy extras loggers by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41306](https://github.com/BerriAI/litellm/pull/41306) - fix(cost): price native Responses WebSocket turns at their returned service\_tier by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41318](https://github.com/BerriAI/litellm/pull/41318) - fix(proxy): key model rpm/tpm override takes precedence over team model limit by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41302](https://github.com/BerriAI/litellm/pull/41302) - fix(proxy): track per-member organization spend by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41255](https://github.com/BerriAI/litellm/pull/41255) - feat(proxy): add /nvidia\_nim passthrough route for NIM object detection and OCR /v1/infer by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41316](https://github.com/BerriAI/litellm/pull/41316) - feat(model\_info): add provider-neutral Gemini 2.5+ chat baseline fallback generalization by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41320](https://github.com/BerriAI/litellm/pull/41320) - fix(spend): sum multi-round session duration in logs UI by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#35388](https://github.com/BerriAI/litellm/pull/35388) - feat(router): limit unlicensed Capability and Fuse v2 routers to one each by [@tin-berri](https://github.com/tin-berri) in [#41326](https://github.com/BerriAI/litellm/pull/41326) - fix(guardrails): resolve caller identity from metadata buckets in custom code guardrail by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41126](https://github.com/BerriAI/litellm/pull/41126) - fix(e2e): onboard dashboard users through invitations by [@yuneng-berri](https://github.com/yuneng-berri) in [#41319](https://github.com/BerriAI/litellm/pull/41319) - feat(guardrails): add Microsoft Agent 365 MCP tool-call guardrail by [@yucheng-berri](https://github.com/yucheng-berri) in [#38241](https://github.com/BerriAI/litellm/pull/38241) - test: drop remaining tests that pin cost-map vendor facts by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41298](https://github.com/BerriAI/litellm/pull/41298) - feat(ui): show average response time per model in usage model activity by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41313](https://github.com/BerriAI/litellm/pull/41313) - fix(proxy): preserve Anthropic pricing modifiers in router savings by [@tin-berri](https://github.com/tin-berri) in [#41341](https://github.com/BerriAI/litellm/pull/41341) - feat(guardrails): support pre\_call and during\_call modes for llm\_as\_a\_judge by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41128](https://github.com/BerriAI/litellm/pull/41128) - fix(gemini): propagate the provider's modelVersion to the response model by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41338](https://github.com/BerriAI/litellm/pull/41338) - fix(fireworks-ai): bill cache-write, reasoning and audio tokens via the shared cost calculator by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41339](https://github.com/BerriAI/litellm/pull/41339) - feat(guardrails): singulr v2 API contract with logging\_only, pre\_mcp\_call and post\_mcp\_call by [@yucheng-berri](https://github.com/yucheng-berri) in [#41329](https://github.com/BerriAI/litellm/pull/41329) - ci(image-scan): ignore zlib CVE-2026-85091 until Wolfi ships the fix by [@yuneng-berri](https://github.com/yuneng-berri) in [#41353](https://github.com/BerriAI/litellm/pull/41353) - feat(e2e): reuse exact provider responses for 24 hours by [@yuneng-berri](https://github.com/yuneng-berri) in [#41346](https://github.com/BerriAI/litellm/pull/41346) - fix(xai): keep 'instructions' on the xAI Responses API so system messages survive web search by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#38254](https://github.com/BerriAI/litellm/pull/38254) - feat(ui): configure capability and Fuse v2 classifiers by [@tin-berri](https://github.com/tin-berri) in [#41315](https://github.com/BerriAI/litellm/pull/41315) - fix(anthropic): tolerate message\_delta events without usage when streaming by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41336](https://github.com/BerriAI/litellm/pull/41336) - test(router): ignore deployment-selection logs in the fallback log assertion by [@yuneng-berri](https://github.com/yuneng-berri) in [#41358](https://github.com/BerriAI/litellm/pull/41358) - test(proxy): assert budget resets decrement the cleared spend by [@yuneng-berri](https://github.com/yuneng-berri) in [#41359](https://github.com/BerriAI/litellm/pull/41359) - fix(e2e): expect models filters to persist after reload by [@yuneng-berri](https://github.com/yuneng-berri) in [#41348](https://github.com/BerriAI/litellm/pull/41348) - fix(e2e): record cookie-setting provider responses and keep prompt-caching tests live by [@yuneng-berri](https://github.com/yuneng-berri) in [#41366](https://github.com/BerriAI/litellm/pull/41366) - fix(responses): recount tokens when a streamed response completes without usage by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41337](https://github.com/BerriAI/litellm/pull/41337) - fix(ui): simplify Capability and Fuse advanced routing options by [@tin-berri](https://github.com/tin-berri) in [#41371](https://github.com/BerriAI/litellm/pull/41371) - fix(mcp): authorize JWT OAuth credential persistence by [@joshua-berri](https://github.com/joshua-berri) in [#41314](https://github.com/BerriAI/litellm/pull/41314) - feat(router): stream shadow traffic and fan out silent\_model to multiple targets by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41368](https://github.com/BerriAI/litellm/pull/41368) - perf(content\_filter): scan a bounded window per streamed chunk by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41407](https://github.com/BerriAI/litellm/pull/41407) - fix(proxy): hide model allowlist from client-facing model access denied errors by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41310](https://github.com/BerriAI/litellm/pull/41310) - feat(http): opt-in outbound HTTP/2 for httpx clients by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41268](https://github.com/BerriAI/litellm/pull/41268) - refactor(rust): remove gateway, config, router, realtime, and Rust trace-parity instrumentation by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41432](https://github.com/BerriAI/litellm/pull/41432) - fix(guardrails): don't add post\_call output scan for MCP-only Presidio modes by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40571](https://github.com/BerriAI/litellm/pull/40571) - chore(prices): sync Azure, Azure AI, Gemini, OpenAI, Bedrock, Together AI, Fireworks and Vertex prices: 278 models, 59 new, 30 deprecated by [@berriai-litellm-provider-info-sync](https://github.com/berriai-litellm-provider-info-sync)\[bot] in [#41154](https://github.com/BerriAI/litellm/pull/41154) - fix(rag): forward retrieval\_filter from retrieval\_config to vector store search by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#34427](https://github.com/BerriAI/litellm/pull/34427) - refactor(rust): extract auth and cache crates by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41464](https://github.com/BerriAI/litellm/pull/41464) - fix(proxy): default litellm\_trace\_id to the OTel server span trace id by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41386](https://github.com/BerriAI/litellm/pull/41386) - chore(codeowners): add ryan and kerry as owners of the cost map by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41333](https://github.com/BerriAI/litellm/pull/41333) - fix(responses): guard empty-choices chunks in the Responses API streaming bridge by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#34455](https://github.com/BerriAI/litellm/pull/34455) - chore(prices): sync Google Gemini prices: 22 models by [@berriai-litellm-provider-info-sync](https://github.com/berriai-litellm-provider-info-sync)\[bot] in [#41457](https://github.com/BerriAI/litellm/pull/41457) - fix(bedrock): forward userContext in Knowledge Base Retrieve requests by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41475](https://github.com/BerriAI/litellm/pull/41475) - ci(rust): split rust jobs, use nextest and Swatinem/rust-cache by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41480](https://github.com/BerriAI/litellm/pull/41480) - fix(fireworks\_ai): flatten dict-form reasoning\_effort to its effort string by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41335](https://github.com/BerriAI/litellm/pull/41335) - fix(proxy): never forward the LiteLLM virtual key to Anthropic on the /anthropic passthrough by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41340](https://github.com/BerriAI/litellm/pull/41340) - fix(proxy): rename AWS Secrets Manager secret when key alias changes by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41468](https://github.com/BerriAI/litellm/pull/41468) - feat(otel): promote nested request metadata keys to litellm.metadata.\* span attributes by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41462](https://github.com/BerriAI/litellm/pull/41462) - fix(proxy): sync AWS Secrets Manager on body-less key regenerate and key alias changes by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41458](https://github.com/BerriAI/litellm/pull/41458) - fix(http\_handler): keep a handler alive while a response it issued is still reading by [@max-sixty](https://github.com/max-sixty) in [#34829](https://github.com/BerriAI/litellm/pull/34829) - fix(bedrock): make prompt caching work on the Nova InvokeModel route by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41343](https://github.com/BerriAI/litellm/pull/41343) - ci(migrations): flag defaulted ADD COLUMN on request-log tables by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41460](https://github.com/BerriAI/litellm/pull/41460) - feat(prometheus): add customer (end\_user) budget gauges by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41472](https://github.com/BerriAI/litellm/pull/41472) - fix(otel): drop None metric and event attributes before OTLP export by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#36815](https://github.com/BerriAI/litellm/pull/36815) - fix(anthropic): carry the served model from message\_start onto stream chunks by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41446](https://github.com/BerriAI/litellm/pull/41446) - fix(models): rolling registry audit: Gemini latest aliases, Nova cache pricing, OpenRouter/Together sync, Mistral GLM 5.3, Azure snapshots, Grok caching by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41112](https://github.com/BerriAI/litellm/pull/41112) - fix(router): count TPM/RPM usage before building rate-limit headers by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41474](https://github.com/BerriAI/litellm/pull/41474) - feat(guardrails): release buffered stream chunks after each passing scan by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41425](https://github.com/BerriAI/litellm/pull/41425) - fix!: re-check budget on router fallback targets by [@runjivu](https://github.com/runjivu) in [#41379](https://github.com/BerriAI/litellm/pull/41379) - refactor(ocr): move file preparation from the python bridge into litellm-core by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41489](https://github.com/BerriAI/litellm/pull/41489) - feat(s3): add s3\_log\_prompts\_only option to log prompts without responses by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41327](https://github.com/BerriAI/litellm/pull/41327) - feat(team): team-level model\_max\_budget with key-level overrides by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41330](https://github.com/BerriAI/litellm/pull/41330) - feat(keys): filter /key/list by active, expired, revoked or deleted status and serve deleted keys from /key/info by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41311](https://github.com/BerriAI/litellm/pull/41311) - feat(proxy): expose lifetime total\_spend on virtual keys by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41403](https://github.com/BerriAI/litellm/pull/41403) - fix(proxy): release completed max-parallel slots promptly by [@elifozdamar](https://github.com/elifozdamar) in [#40843](https://github.com/BerriAI/litellm/pull/40843) - feat(ui): accept ssh clone urls when registering a skill by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#35418](https://github.com/BerriAI/litellm/pull/35418) - fix(prices): dedupe Nova cache\_read\_input\_token\_cost keys left by a text merge by [@yuneng-berri](https://github.com/yuneng-berri) in [#41496](https://github.com/BerriAI/litellm/pull/41496) - fix(otel): propagate W3C trace context on HTTP and WebSocket passthrough by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40669](https://github.com/BerriAI/litellm/pull/40669) - fix(proxy): remove duplicate user budget hook that 429'd zero-cost models by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41345](https://github.com/BerriAI/litellm/pull/41345) - test(logging): pick this test's own records out of the shared log batch by [@yuneng-berri](https://github.com/yuneng-berri) in [#41487](https://github.com/BerriAI/litellm/pull/41487) - test(together\_ai): move request-shape checks to the mapped file, drop the live ones by [@yuneng-berri](https://github.com/yuneng-berri) in [#41360](https://github.com/BerriAI/litellm/pull/41360) - feat(ui): shared URL-state layer for tables and tabs by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41331](https://github.com/BerriAI/litellm/pull/41331) - feat(e2e): make the provider cache reusable across builds and mount Bedrock behind it by [@yuneng-berri](https://github.com/yuneng-berri) in [#41402](https://github.com/BerriAI/litellm/pull/41402) - fix(mcp): fail closed on missing upstream credentials by [@joshua-berri](https://github.com/joshua-berri) in [#41364](https://github.com/BerriAI/litellm/pull/41364) - feat(rust): scaffold Redis cache crate by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41501](https://github.com/BerriAI/litellm/pull/41501) - fix(dashscope): forward reasoning\_effort to the provider by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#37506](https://github.com/BerriAI/litellm/pull/37506) - fix(proxy): carry litellm\_call\_id through endpoint specific error logs and failure responses by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41356](https://github.com/BerriAI/litellm/pull/41356) - fix(proxy): retry rate-limit fallbacks from a pristine request snapshot by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40596](https://github.com/BerriAI/litellm/pull/40596) - fix(gemini): map minimal thinking to low for Gemini 3.7 and 3.8 Flash by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41201](https://github.com/BerriAI/litellm/pull/41201) - fix(proxy): stop forwarding LiteLLM credential headers on Bedrock agent-runtime passthrough by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41504](https://github.com/BerriAI/litellm/pull/41504) - fix(streaming): estimate interrupted Anthropic stream usage from reasoning\_content by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41503](https://github.com/BerriAI/litellm/pull/41503) - fix(azure\_ai): route Responses API to native /openai/v1/responses for Foundry Models by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#33856](https://github.com/BerriAI/litellm/pull/33856) - fix(proxy): show all model groups to proxy admins in /model\_group/info by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41094](https://github.com/BerriAI/litellm/pull/41094) - feat(proxy): let proxy admins choose which team fields team admins may edit by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#39996](https://github.com/BerriAI/litellm/pull/39996) - fix(bedrock): neutralize orphaned tool blocks instead of raising or injecting a dummy tool (internal copy of [#31400](https://github.com/BerriAI/litellm/issues/31400)) by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41513](https://github.com/BerriAI/litellm/pull/41513) - feat(ui): persist organizations and projects list, detail tab and key table state in the URL by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41445](https://github.com/BerriAI/litellm/pull/41445) - fix(bedrock\_mantle): accept and forward verbosity on gpt-5.x chat completions by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41509](https://github.com/BerriAI/litellm/pull/41509) - test: cover database transactions and persisted accounting by [@yuneng-berri](https://github.com/yuneng-berri) in [#41073](https://github.com/BerriAI/litellm/pull/41073) - test: provider wire contracts, streaming and recovery by [@yuneng-berri](https://github.com/yuneng-berri) in [#41075](https://github.com/BerriAI/litellm/pull/41075) - fix(mcp): count admin static headers as api\_key credential slots by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41514](https://github.com/BerriAI/litellm/pull/41514) - ci: auto-merge provider-info-sync PRs when CI, Greptile and Bugbot are clean by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41494](https://github.com/BerriAI/litellm/pull/41494) - feat(rust): add standalone framing crate by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41500](https://github.com/BerriAI/litellm/pull/41500) - fix(proxy): enforce tag budgets for tags added by guardrails by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40842](https://github.com/BerriAI/litellm/pull/40842) - fix(utils): run post-call deployment hook on converted chat streams by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41495](https://github.com/BerriAI/litellm/pull/41495) - fix(e2e): bind provider-cache recordings to the deployment's test, not the serving process by [@yuneng-berri](https://github.com/yuneng-berri) in [#41520](https://github.com/BerriAI/litellm/pull/41520) - test: add extension and browser integration contracts by [@yuneng-berri](https://github.com/yuneng-berri) in [#41078](https://github.com/BerriAI/litellm/pull/41078) - fix(logging): scan each log record once and collapse base64 payloads before the secret regex by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40934](https://github.com/BerriAI/litellm/pull/40934) - fix(spend\_tracking): attribute router-rejected requests to the model group provider by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41507](https://github.com/BerriAI/litellm/pull/41507) - feat(router): discover token limits for hosted OpenAI-compatible models by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41508](https://github.com/BerriAI/litellm/pull/41508) - feat(proxy): let team admins edit rpm\_limit and max\_budget when enabled by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41525](https://github.com/BerriAI/litellm/pull/41525) - fix(otel): fit per-index OpenInference messages to the span's remaining attribute budget by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41498](https://github.com/BerriAI/litellm/pull/41498) - test(aws): verify rotated secret value by [@yuneng-berri](https://github.com/yuneng-berri) in [#41524](https://github.com/BerriAI/litellm/pull/41524) - test(e2e): read a deleted key back as deleted, not as a 404 by [@yuneng-berri](https://github.com/yuneng-berri) in [#41551](https://github.com/BerriAI/litellm/pull/41551) - fix(otel v2): map the caller's Langfuse user, session and tags onto the root and generation spans by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41140](https://github.com/BerriAI/litellm/pull/41140) - test: fix seven tests left stale by [#41311](https://github.com/BerriAI/litellm/issues/41311), [#41337](https://github.com/BerriAI/litellm/issues/41337), [#39996](https://github.com/BerriAI/litellm/issues/39996), [#41310](https://github.com/BerriAI/litellm/issues/41310), [#41289](https://github.com/BerriAI/litellm/issues/41289) and [#41315](https://github.com/BerriAI/litellm/issues/41315) by [@yuneng-berri](https://github.com/yuneng-berri) in [#41527](https://github.com/BerriAI/litellm/pull/41527) - test(budgets): cover management null handling by [@yuneng-berri](https://github.com/yuneng-berri) in [#41563](https://github.com/BerriAI/litellm/pull/41563) - test(e2e): drop the auto-router select "opens below" spec by [@yuneng-berri](https://github.com/yuneng-berri) in [#41568](https://github.com/BerriAI/litellm/pull/41568) - fix(guardrails): stream Prompt Security post\_call redactions in incremental\_diff mode by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41558](https://github.com/BerriAI/litellm/pull/41558) - fix(guardrails): give post-call scans the scoped request conversation and tools by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41220](https://github.com/BerriAI/litellm/pull/41220) - feat(openrouter): add stealth/union-alpha to the model cost map by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41576](https://github.com/BerriAI/litellm/pull/41576) - test(management): cover project authorization lifecycle by [@yuneng-berri](https://github.com/yuneng-berri) in [#41573](https://github.com/BerriAI/litellm/pull/41573) - feat(rust): map Anthropic Messages transformations by [@yujonglee-berri](https://github.com/yujonglee-berri) in [#41531](https://github.com/BerriAI/litellm/pull/41531) - fix(e2e): clear the three standing errors in the scheduled Buildkite suite by [@yuneng-berri](https://github.com/yuneng-berri) in [#41616](https://github.com/BerriAI/litellm/pull/41616) - refactor(rust\_bridge): declarative route catalog and shared runtime selection by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41479](https://github.com/BerriAI/litellm/pull/41479) - fix(mock\_completion): keep the resolved provider so router custom pricing resolves for azure\_ai deployments by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41623](https://github.com/BerriAI/litellm/pull/41623) - fix(mcp): restrict health discovery to virtual key grants by [@joshua-berri](https://github.com/joshua-berri) in [#41609](https://github.com/BerriAI/litellm/pull/41609) - fix(mcp): preserve request-selected guardrails during tool execution by [@joshua-berri](https://github.com/joshua-berri) in [#41619](https://github.com/BerriAI/litellm/pull/41619) - refactor(ocr): mirror Python provider layout and preserve tests by [@yujonglee-berri](https://github.com/yujonglee-berri) in [#41550](https://github.com/BerriAI/litellm/pull/41550) - test(fireworks\_ai): stop pinning vision support on minimax-m3 by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41627](https://github.com/BerriAI/litellm/pull/41627) - perf(spend\_tracking): index LiteLLM\_SpendLogs by (api\_key, startTime) by [@etiennechabert](https://github.com/etiennechabert) in [#37983](https://github.com/BerriAI/litellm/pull/37983) - fix(proxy): reject non-string model with 400 and log its spend as unknown-model by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41633](https://github.com/BerriAI/litellm/pull/41633) - test(together\_ai): stop pinning successor deprecation status by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41635](https://github.com/BerriAI/litellm/pull/41635) - chore(prices): sync Together AI prices: 6 models, 6 deprecated \[sync failed: Google Gemini] by [@berriai-litellm-provider-info-sync](https://github.com/berriai-litellm-provider-info-sync)\[bot] in [#41570](https://github.com/BerriAI/litellm/pull/41570) - fix(budgets): page end-user cache invalidation after a budget reset by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41488](https://github.com/BerriAI/litellm/pull/41488) - chore: bump litellm-proxy-extras 0.4.98 -> 0.4.99 by [@yuneng-berri](https://github.com/yuneng-berri) in [#41659](https://github.com/BerriAI/litellm/pull/41659) - fix(tests): resolve the integration support package without run.py's PYTHONPATH by [@yuneng-berri](https://github.com/yuneng-berri) in [#41373](https://github.com/BerriAI/litellm/pull/41373) - fix(ui): keep untimed guardrail entries on the request lifecycle by [@yuneng-berri](https://github.com/yuneng-berri) in [#41374](https://github.com/BerriAI/litellm/pull/41374) - fix(anthropic-bridge): convert mid-conversation system turns to user turns on /v1/messages to chat completions by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41493](https://github.com/BerriAI/litellm/pull/41493) - fix(bedrock): support aws-sdk-bedrock-runtime 0.10/0.11 in Bedrock Realtime by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41542](https://github.com/BerriAI/litellm/pull/41542) - feat(cli): deprecate the litellm-proxy entrypoint in favour of lite by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41673](https://github.com/BerriAI/litellm/pull/41673) - fix(scim): align pagination `count` validation with RFC 7644 by [@zachbernstein-sdx](https://github.com/zachbernstein-sdx) in [#41444](https://github.com/BerriAI/litellm/pull/41444) - fix(bedrock): never emit Converse cachePoint for OpenAI-family models by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41419](https://github.com/BerriAI/litellm/pull/41419) - fix(images): stop forwarding the raw image\[] and mask\[] form keys by [@mateo-berri](https://github.com/mateo-berri) in [#39512](https://github.com/BerriAI/litellm/pull/39512) - feat(management\_v1): bulk update team member budgets by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41632](https://github.com/BerriAI/litellm/pull/41632) - refactor(rust): extract provider translations by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41690](https://github.com/BerriAI/litellm/pull/41690) - feat(cli): rename lite autoroute up/down to start/stop, keeping the old names as deprecated aliases by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41672](https://github.com/BerriAI/litellm/pull/41672) - fix(responses): keep the addressed response id off bridged provider requests by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41689](https://github.com/BerriAI/litellm/pull/41689) - fix(license): let a wildcard allowed\_features license grant the auto\_router feature by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41684](https://github.com/BerriAI/litellm/pull/41684) - fix(ui): list every provider in the cache leakage by-model table by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#40875](https://github.com/BerriAI/litellm/pull/40875) - fix(team): keep a forked member budget's reset window and audit bulk member budget writes by [@ryan-crabbe-berri](https://github.com/ryan-crabbe-berri) in [#41686](https://github.com/BerriAI/litellm/pull/41686) - feat(proxy): add TypeSafe AI Jev evaluate passthrough with registry-priced spend tracking by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41607](https://github.com/BerriAI/litellm/pull/41607) - test(e2e): cover bedrock batch file upload and create in the us-gov-west-1 partition by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41536](https://github.com/BerriAI/litellm/pull/41536) - feat(grafana): add all-metrics dashboard and fix stale dashboard\_v2 gauges by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41578](https://github.com/BerriAI/litellm/pull/41578) - fix(cost): price Azure PTU spillover requests at standard token rates by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41569](https://github.com/BerriAI/litellm/pull/41569) - build(deps): bump soupsieve to 2.9.2 to clear the osv-scan advisories by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41703](https://github.com/BerriAI/litellm/pull/41703) - fix(fireworks\_ai): restore supports\_vision on minimax-m3 in the cost map by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41699](https://github.com/BerriAI/litellm/pull/41699) - feat(policy\_engine): explicit priority for policy attachment execution order by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41571](https://github.com/BerriAI/litellm/pull/41571) - feat(router): add TypeSafe Jev as a complexity router classifier by [@devin-ai-integration](https://github.com/devin-ai-integration)\[bot] in [#41615](https://github.com…

fix(bedrock_mantle): price GovCloud regions from the regional cost ro…

ec3a5c7

…w and accept region-prefixed model names

mateo-berri requested a review from a team September 5, 2026 01:35

mateo-berri added the run-ci label Sep 5, 2026

greptile-apps Bot reviewed Sep 5, 2026

View reviewed changes

Comment thread litellm/litellm_core_utils/litellm_logging.py

veria-ai Bot reviewed Sep 5, 2026

View reviewed changes

Comment thread litellm/litellm_core_utils/litellm_logging.py

cursor Bot reviewed Sep 5, 2026

View reviewed changes

test(bedrock_mantle): cover region-prefixed /v1/responses routing and…

b2e0def

… GovCloud pricing

greptile-apps Bot reviewed Sep 5, 2026

View reviewed changes

Comment thread tests/test_litellm/llms/bedrock_mantle/test_bedrock_mantle_transformation.py Outdated

test(bedrock_mantle): record mock requests with Mock instead of a mut…

009a2bd

…able list

mateo-berri removed the run-ci label Sep 5, 2026

mateo-berri added the run-ci label Sep 5, 2026

cursor Bot reviewed Sep 5, 2026

View reviewed changes

mateo-berri requested a review from yucheng-berri September 5, 2026 02:38

mateo-berri enabled auto-merge September 5, 2026 02:38

mateo-berri closed this Sep 5, 2026

auto-merge was automatically disabled September 5, 2026 03:03
Pull request was closed

mateo-berri reopened this Sep 5, 2026

mateo-berri enabled auto-merge September 5, 2026 03:03

mateo-berri closed this Sep 5, 2026

auto-merge was automatically disabled September 5, 2026 03:23
Pull request was closed

mateo-berri reopened this Sep 5, 2026

mateo-berri enabled auto-merge September 5, 2026 03:23

merge: bring litellm_internal_staging into litellm_bedrock_mantle_gov…

0308b05

…cloud_cost_row

mateo-berri added run-ci and removed run-ci labels Sep 10, 2026

mateo-berri disabled auto-merge September 10, 2026 14:34

veria-ai Bot reviewed Sep 10, 2026

View reviewed changes

mateo-berri added run-ci and removed run-ci labels Sep 10, 2026

mateo-berri mentioned this pull request Sep 10, 2026

docs(bedrock_mantle): document region precedence, the region-prefixed model form, and GovCloud pricing BerriAI/litellm-docs#1405

Merged

cursor Bot reviewed Sep 10, 2026

View reviewed changes

mateo-berri force-pushed the litellm_bedrock_mantle_govcloud_cost_row branch from a6bd4c0 to f6685b7 Compare September 10, 2026 15:12

mateo-berri added run-ci and removed run-ci labels Sep 10, 2026

cursor Bot reviewed Sep 10, 2026

View reviewed changes

mateo-berri enabled auto-merge September 10, 2026 15:39

mateo-berri merged commit c2c2a62 into litellm_internal_staging Sep 13, 2026
128 of 131 checks passed

mateo-berri deleted the litellm_bedrock_mantle_govcloud_cost_row branch September 13, 2026 04:14

This was referenced Sep 13, 2026

fix(caching): forward request metadata in sync Valkey semantic-cache embedding (#32324) #40990

Open

fix(caching): valkey-semantic index_definition import compatibility with redis-py >= 6 #40863

Open

	region_name=None if explicit_pricing else region_name,
	region_name=None if custom_pricing is True else region_name,

Uh oh!

Conversation

mateo-berri commented Sep 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

TLDR

User Flow

Relevant issues

Linear ticket

Pre-Submission checklist

Delays in PR merge?

Screenshots / Proof of Fix

Before (e5da593)

Bare model with aws_region_name, mantle-gov-grok

Region-prefixed model with aws_region_name, mantle-gov-grok-prefixed

Region-prefixed model alone, mantle-gov-grok-prefix-only

GET /spend/logs for the calls above

After (a6bd4c0)

Bare model with aws_region_name, mantle-gov-grok

Region-prefixed model with aws_region_name, mantle-gov-grok-prefixed

Region-prefixed model alone, mantle-gov-grok-prefix-only

GET /spend/logs for the calls above

Type

Caveats (if any)

Low

Final Attestation

Uh oh!

codspeed Bot commented Sep 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will not alter performance

Uh oh!

greptile-apps Bot commented Sep 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Greptile Summary

Confidence Score: 5/5

Important Files Changed

Uh oh!

Uh oh!

mateo-berri commented Sep 5, 2026

Uh oh!

Uh oh!

veria-ai Bot commented Sep 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR overview

Open issues (1)

Uh oh!

codecov Bot commented Sep 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

mateo-berri commented Sep 5, 2026

Uh oh!

cursor Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mateo-berri commented Sep 5, 2026

Uh oh!

Uh oh!

mateo-berri commented Sep 5, 2026

Uh oh!

mateo-berri commented Sep 5, 2026

Uh oh!

cursor Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mateo-berri commented Sep 10, 2026

Uh oh!

mateo-berri commented Sep 10, 2026

Uh oh!

veria-ai Bot Sep 10, 2026

Choose a reason for hiding this comment

Uh oh!

mateo-berri Sep 10, 2026

Choose a reason for hiding this comment

Uh oh!

mateo-berri commented Sep 10, 2026

Uh oh!

cursor Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

mateo-berri commented Sep 5, 2026 •

edited

Loading

Before (`e5da593`)

Bare model with `aws_region_name`, `mantle-gov-grok`

Region-prefixed model with `aws_region_name`, `mantle-gov-grok-prefixed`

Region-prefixed model alone, `mantle-gov-grok-prefix-only`

After (`a6bd4c0`)

Bare model with `aws_region_name`, `mantle-gov-grok`

Region-prefixed model with `aws_region_name`, `mantle-gov-grok-prefixed`

Region-prefixed model alone, `mantle-gov-grok-prefix-only`

codspeed Bot commented Sep 5, 2026 •

edited

Loading

greptile-apps Bot commented Sep 5, 2026 •

edited

Loading

veria-ai Bot commented Sep 5, 2026 •

edited

Loading

codecov Bot commented Sep 5, 2026 •

edited

Loading

cursor Bot left a comment •

edited

Loading

cursor Bot left a comment •

edited

Loading

cursor Bot left a comment •

edited

Loading