David F GliddenandClaude Opus 4.8
3f9a89b00c
Basic Memory v0.21.6 first sync over the live memory dir (steward-authorized live-dir trial, Option A 2026-06-06): adds permalink: to frontmatter, refolds long YAML description lines, strips final newlines. Bodies untouched — verified via full diff classification. From this commit forward, any diff in claude/memory shows only what Basic Memory or the session writes. Trial design: MemPalace untouched as incumbent; git status check on this dir at every wrap; end-of-day evaluation (recall quality, sync robustness, rebuild-from-files, malformed-file behavior). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
90 lines
5.6 KiB
Markdown
90 lines
5.6 KiB
Markdown
---
|
|
name: Session 2026-03-21 — L1 reliability PR + audit + governance evolution
|
|
description: Major session establishing three-party governance model, four L1 bug
|
|
fixes, 43-finding silent degradation audit, executor agency directives. Replay running
|
|
overnight for canary test.
|
|
type: project
|
|
permalink: claude-memory/session-2026-03-21
|
|
---
|
|
|
|
# Session 2026-03-21
|
|
|
|
## What Happened
|
|
|
|
### Governance Evolution
|
|
- Three-party model (steward/jurist/executor) formalized in CLAUDE.md
|
|
- Authorization taxonomy: [FIX], [HARDENING], [PROPOSAL], [ESCALATE]
|
|
- Executor Agency Directives added — contamination-aware operational obligations
|
|
- PENDING.md / REVIEWED.md protocol established
|
|
- Session protocol: read CLAUDE.md → seed → REVIEWED → PENDING → empirical log before touching code
|
|
|
|
### Four Bug Fixes (branch: fix/replay-durability-contracts)
|
|
- **Bug A** — Vector reprobe condition mismatch: `startsWith('stub:')` → broadened to any degraded state. Added storage degradation recovery via SurrealDB probe.
|
|
- **Bug B** — Schema migration non-idempotency: `defineIdempotent()` wrapper applied to job-store.ts, checkpoint.ts, dedup.ts. Root cause was checkpoint.ts (bare `DEFINE FIELD` without `IF NOT EXISTS`), not job-store.ts as originally diagnosed.
|
|
- **Bug C** — Teacher worker retry storm: Terminal error detection (credit exhaustion → suspend), exponential backoff on transient failures, log rate limiting. Confirmed: 1 log line instead of 586.
|
|
- **Bug D (Option 2)** — Batch embedding during replay: Coalescing buffer in OllamaEmbeddingProvider + batched Phase 1 loop in replay coordinator. 16 events processed concurrently. ~2-3x speedup observed.
|
|
|
|
### Silent Degradation Audit
|
|
- 43 instances across 5 structural patterns
|
|
- 5 CRITICAL, 18 HIGH, 20 MEDIUM
|
|
- Root causes: fire-and-forget (22 instances), fixed-interval retry, recovery/degradation mismatch, state transitions that freeze, silent persistence failure
|
|
- Key finding: 4,974 vector-relevant events in logchain (not 221) — Phase 1 at single-event embedding takes ~83 hours
|
|
- Bug D (idle stall) identified as root cause of replay freezing every 5 minutes
|
|
|
|
### Key Discovery
|
|
- Logchain has 221 top-level events but payloads contain nested connector batch events
|
|
- Vector module processes each nested event → 4,974 total
|
|
- This was invisible without the audit — confirms executor agency directive is load-bearing
|
|
|
|
## Files Changed (BetterMemories.io)
|
|
- `src/modules/vector/index.ts` — Bug A fix (reprobe broadening + storage degradation)
|
|
- `src/factory/job-store.ts` — Bug B fix (defineIdempotent)
|
|
- `src/factory/checkpoint.ts` — Bug B fix (defineIdempotent)
|
|
- `src/factory/dedup.ts` — Bug B fix (defineIdempotent)
|
|
- `src/inference/teacher-enrichment.ts` — Bug C fix (suspension + backoff)
|
|
- `src/inference/ollama-embeddings.ts` — Bug D fix (coalescing buffer)
|
|
- `src/core/keystone/readiness/replay-coordinator.ts` — Bug D fix (batched Phase 1 loop)
|
|
|
|
## Files Created (CapableMind-AI)
|
|
- `docs/thinking/David/l1-reliability/` — all L1 reliability artifacts
|
|
- `docs/thinking/David/l1-reliability/l1-silent-degradation-audit-2026-03-21.md` — 43-finding audit
|
|
- `docs/thinking/David/l1-reliability/l1-session-seed-pr.md` — active seed from Claude.app
|
|
- `docs/thinking/David/l1-reliability/l1-gh-issue-bug-a.md` — GH issue template
|
|
- `docs/thinking/David/l1-reliability/l1-gh-issue-bug-b.md` — GH issue template
|
|
- `docs/thinking/David/l1-reliability/l1-gh-issue-bug-c.md` — GH issue template
|
|
- `docs/thinking/David/l1-reliability/l1-pipeline-full-picture-2026-03-21.md` — full pipeline analysis
|
|
- `docs/thinking/David/l1-reliability/l1-pr-description.md` — PR template
|
|
- `docs/thinking/David/l1-reliability/l1-claude-md-executor-agency-proposal.md` — PENDING-1
|
|
|
|
## PENDING Items (~/PENDING.md)
|
|
- PENDING-1: Executor Agency Directive — AUTHORIZED, integrated
|
|
- PENDING-2: Silent degradation audit — COMPLETE, authorized for follow-on
|
|
- PENDING-3: Factory schema scope extension — ACKNOWLEDGED
|
|
- PENDING-4: Bug D idle stall — AUTHORIZED, next PR
|
|
- PENDING-5 through PENDING-9: from audit findings (transport backoff, manifest persistence, Phase 2 handling, fire-and-forget replacement, hysteresis)
|
|
- PENDING-10: Option 1 (skip embedding during replay) — authorized for next PR
|
|
|
|
## Current State
|
|
- BMF running (PID 53403) with all 4 fixes
|
|
- caffeinate (PID 54925) preventing sleep for 12h
|
|
- nohup keepalive (PID 54926) sending MCP observe every 4 min
|
|
- nohup monitor (PID 54927) logging to ~/.capablemind/logs/replay-monitor.log every 10 min
|
|
- Vector cursor at 114 of ~4,974 at last check — advancing in bursts
|
|
- Phase 1 not yet complete — expected overnight
|
|
- MCP disabled in Claude Code to prevent BMF restart
|
|
|
|
## Next Session
|
|
1. Check `cat ~/.capablemind/logs/replay-monitor.log`
|
|
2. If Phase 1 complete: confirm canary, test recall, complete PR artifacts per seed instructions
|
|
3. If not complete: assess whether Bug D (idle stall) or volume is the bottleneck, consider reducing Phase 1 window
|
|
4. File GH issues A, B, C, D
|
|
5. Submit PR
|
|
6. Update PENDING.md with SESSION-LOG
|
|
|
|
## Seb Context (from thinking folder exploration)
|
|
- Spec-first methodology, 97 docs, 85k lines — runtime not yet held to same standard
|
|
- Architecture + historiography background — audit findings will be recognized as same discipline applied to runtime
|
|
- Giving-back document, public debt framing — this is a calling, not a job
|
|
- His biggest unknown: whether training flywheel produces meaningful quality improvement
|
|
- Three-entity structure (Skemantix, CapableMind Inc, WhySo Ltd) — long-term thinking
|
|
- Cold start, forgetting, multi-user, L1/L2 boundary — all have design-level answers in his specs |