Skip to content

config: model-provider selection - #205

Merged
jsam merged 1 commit into
mainfrom
fm/il-f08
Oct 3, 2026
Merged

jsam merged 1 commit into
mainfrom
fm/il-f08

Conversation

@jsam

@jsam jsam commented Oct 3, 2026

Copy link
Copy Markdown
Contributor

Draft for visibility. Stacked on the release checkpoint 1 branch (fm/il-rc1); it will be retargeted to main once checkpoint 1 lands, and validated through the no-mistakes pipeline before merge.

Tracker: #199

Extraction and completion stay behind the existing Extractor/Completer
traits; a new provider module reads GATEWAY_MODEL_PROVIDER and its
settings once at startup, validates them (a named provider with a
missing or malformed setting stops the gateway), builds the client and
owns model routing. An OpenAI-compatible client covers local model
servers (Ollama, vLLM, llama.cpp) with json_schema extraction, refusing
truncated, filtered or non-JSON answers and keeping the upstream status
on errors. ANTHROPIC_API_KEY alone keeps the previous behavior.

Part of #87 (provider selection).
@jsam
jsam changed the base branch from fm/il-rc1 to main October 3, 2026 20:37
@jsam
jsam marked this pull request as ready for review October 3, 2026 20:37
@jsam jsam closed this Oct 3, 2026
@jsam jsam reopened this Oct 3, 2026
@jsam
jsam merged commit e9e1352 into main Oct 3, 2026
14 checks passed
@jsam
jsam deleted the fm/il-f08 branch October 3, 2026 20:49
jsam added a commit that referenced this pull request Oct 3, 2026
Brings #205, #203 and #207. #207's test-only meta dispatch hook is
installed inside the supervised blocking job.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant