Skip to content

MCP chat proxy: expose full chat-with-memory as an MCP tool #39

Open

Description

@diskerror

Summary

Add a chat tool to the MCP server so any MCP-capable client can send a
message and receive a memory-aware response — without needing the CLI or
an HTTP connection.

Behaviour

  1. Client calls chat tool with { "message": "...", "session_id": "..." }
  2. Ragger searches memory for relevant context
  3. Builds prompt: system prompt + injected memories + session history
  4. Calls configured LLM (inference provider in settings.ini)
  5. Captures both sides of the turn (same path as ragger chat)
  6. Returns response text as tool result

Streaming caveat

MCP tool results are returned whole. No token-by-token streaming unless
MCP adds a streaming tool-result mechanism in a future spec revision —
worth revisiting when the spec evolves. For now, suitable for automation
and headless agents; not ideal for interactive use.

Scope

  • New tool registered in the MCP server (src/mcp.cpp or equivalent)
  • Reuses existing chat/inference logic from ragger chat
  • Session history keyed by session_id (optional; defaults to a
    per-connection ephemeral session)
  • Turn capture unconditional (same as Tier 2 / Tier 3 — see issue Design note: memory capture tiers and MCP chat proxy #38)

Related

Activity

  1. diskerror commented on Jun 7, 2026

    @diskerror
    OwnerAuthor

    no longer has proxy mode

  2. added
    chatRagger Chat (Role 2) / proxy (Role 3)
    on Sep 5, 2026
  3. diskerror commented on Sep 5, 2026

    @diskerror
    OwnerAuthor

    Status note (2026-09-04): current direction is to solve this class of problem without Ragger proxying connections where possible. This issue depends on proxy/chat infrastructure that either doesn't exist yet or was removed (the old LM proxy was replaced by capture_turn — see commit 2b55ee9). Not closing — proxying remains a possible fallback if the non-proxy approach doesn't pan out — but deprioritized pending that exploration. Tagged chat (Ragger Chat / proxy) to track this cluster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    chatRagger Chat (Role 2) / proxy (Role 3)

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions