Repository navigation
FM: Router model — small local LLM for structural decisions #28
Description
A local 3–8B model (same endpoint as [inference.memory]) that makes structural payload decisions before each turn:
| Decision | Output |
|---|---|
| Recipe selection | recipe name |
| RAG query rewrite | search string |
| Subject-switch detection | continue / switch / branch |
| Summary-merge feasibility | merge_ok / start_new |
| Per-source budget nudges | widen/narrow list |
| Capture-worthiness | store / skip |
Open questions (carry as comments on this issue):
- Blocking vs. parallel/speculative execution?
- Cache recipe decisions per session?
- JSON / grammar-constrained decoding for safe outputs?
Fallback: if no router configured → deterministic rules, recipe = default.
Activity