roboomp
9a07533924
Ollama, LM Studio, and llama.cpp / vLLM all do byte-prefix KV cache reuse on the model server side. The agent loop's non-append-only path rebuilds the system prompt and tool catalogue on every turn through fresh allocations (`normalizeTools`, `convertToLlm`, optional memory-backend `beforeAgentStartPrompt` injection), which dirties enough leading bytes to invalidate the cache and force a full prompt re-evaluation. `shouldAutoEnableAppendOnlyContext` previously only recognized DeepSeek and Xiaomi Token Plan. Extend the auto-detect: - Allowlist the known local-server provider ids (`ollama`, `ollama-cloud`, `lm-studio`). - Detect user-defined local servers by parsing `baseUrl`: loopback, RFC1918 private IPv4, and `.local` mDNS hostnames. - Keep the existing `compat.supportsStore` opt-in escape hatch and the explicit `provider.appendOnlyContext: on`/`off` override paths. Regression coverage in `append-only-context-mode.test.ts` exercises each new positive case plus negative samples (172.15/172.32 just outside RFC1918, public hosts, malformed URLs). Fixes #3033
@oh-my-pi/pi-coding-agent
Core implementation package for the omp coding agent in the oh-my-pi monorepo.
For installation, setup, provider configuration, model roles, slash commands, and full CLI reference, see:
Package-specific references:
Memory backends
The agent supports three mutually-exclusive memory backends, selected via the memory.backend setting (Settings → Memory tab, or ~/.omp/config.yml):
off(default) — no memory subsystem runs.local— existing rollout-summarisation pipeline; writesmemory_summary.mdand consolidated artifacts under the agent dir.hindsight— talks to a Hindsight server (Cloud or self-hosted Docker), retains transcripts every Nth user turn, recalls memories on the first turn of a session, and exposesretain,recall, andreflect.
Hindsight quickstart
- Run a Hindsight server (Cloud or
docker run -p 8888:8888 ghcr.io/vectorize-io/hindsight:latest). - Set
memory.backend = "hindsight"andhindsight.apiUrl = "http://localhost:8888"(or your Cloud URL). - Optional environment overrides (env wins over settings):
HINDSIGHT_API_URL,HINDSIGHT_API_TOKEN— connectionHINDSIGHT_BANK_ID,HINDSIGHT_DYNAMIC_BANK_ID,HINDSIGHT_AGENT_NAME— bank addressingHINDSIGHT_AUTO_RECALL,HINDSIGHT_AUTO_RETAIN,HINDSIGHT_RETAIN_MODE— lifecycleHINDSIGHT_RECALL_BUDGET,HINDSIGHT_RECALL_MAX_TOKENS— recall sizingHINDSIGHT_BANK_MISSION,HINDSIGHT_DEBUG
Switching backends mid-session is honoured on the next system-prompt rebuild and the next /memory slash command. Existing users with memories.enabled = true|false are migrated to memory.backend = "local"|"off" exactly once on first launch.