Architecture: Can Vitto achieve Jarvis-like persistent intelligence across...
Documentation for Sessions
🏗️ Architecture: Can Vitto achieve Jarvis-like persistent intelligence across...
Date: 2026-02-27
Time: 20:16:14 UTC
Session: gspace1-150.10
Agent: backend
Confidence: 88%
Status: ✅ Documented
📋 Decision Context
Question:
Can Vitto achieve Jarvis-like persistent intelligence across sessions, and what are the critical architectural gaps?
Task: Analyze Vitto Jarvis-like memory architecture feasibility
🎯 Decision Made
Chosen:
Yes, with 5 specific gaps to close: (1) Importance decay on memories (exponential, based on daysSinceLastAccess), (2) Request-aware cognitive load budgeting (classify request → budget tokens → retrieve strategically), (3) Auto-generated User Brief per user (200-token daily summary replacing raw memory dumps), (4) Knowledge graph for multi-hop reasoning (entities + typed relationships via MongoDB $graphLookup), (5) VM-as-memory integration (Chrome cookies/logins as a physical memory layer outside the context window). Current system is B+ — tiered recall, vector search, pattern promotion work well. The persistent VM on Hetzner is the missing physical layer that no competitor offers.
Options Considered:
- 5-gap fix roadmap (chosen)
- Full knowledge graph rewrite
- MemGPT-style self-editing memory
- Just increase context window and stuff everything in
- Keep current system as-is
💭 Reasoning
ROOT CAUSE ANALYSIS: The fundamental constraint is that LLMs are stateless — every API call starts from zero. The 'always on' feeling is an illusion built from memory injection. Current system injects ~2,000-3,000 tokens of context per call (user identity, memories, rules, patterns, decisions). Claude's 200K context window has room, but a user with 6 months of history has ~50,000 lines of context that cannot all fit. WHAT EXISTS (B+ grade): 3-tier memory (hot/warm/cold), vector embeddings (1536-dim OpenAI), execution traces (90-day TTL), strategy memories, Intelligence Pyramid (rules→patterns→decisions), memory consolidation (7-day merging). WHAT'S MISSING: (a) No importance decay — memories stay at initial importance forever, hot cache dominated by stale high-importance items after months; (b) No request-aware budgeting — same context injected whether user asks about TypeScript or their weekend; (c) Vector search is 1-hop only — misses tangential relevance (checkout→payment→Stripe→webhooks); (d) No pre-computed User Brief — raw memories injected instead of a 200-token summary; (e) VM Chrome state not queryable as memory. COMPETITORS: MemGPT/Letta self-edits memory (corruption risk), ChatGPT has flat fact list, no one combines persistent VM + knowledge graph + tiered recall. CONFIDENCE: 0.88 — high on the diagnosis, medium on the specific solutions (need validation with real user data).
📁 Files Involved
APIs/backend-vitto-api/src/app/mind/vitto-memory.service.tsAPIs/backend-vitto-api/src/app/mind/mind.service.tsAPIs/backend-ai-api/src/app/learning/learning.service.tsAPIs/backend-ai-api/src/app/chat/chat.service.ts
🔗 Related
- Decision ID:
dev_1772223374651_aetnl6r - Session: 150
- Workspace: gspace1
Auto-generated by MCP Smart Consolidation