session 2026-06-30: clasp memory-check (founders-mesh discovery, note for Seb) + library indexer Phases 1-3 (chamber dee8943)

claude/memory/MEMORY.md

@@ -50,6 +50,9 @@ permalink: claude-memory/memory
 - [Be (laundromat)](project-be-laundromat.md) — canonical workstream tracker established 2026-06-08 (Seb-relay of locked decisions). Be = Skemantix startup (Seb+David) funding CapableMind's funding-ladder; **bridge, not venture**. Decisions LOCKED: entity/exit (CapableMind decoupled, grant-funded), pricing (Living $12.99/mo · Archive $69.99/yr · Memorial $49.99/yr · Renovate ~$199 · $8.99 floor), CF Self-Serve Agency + versioned-template-package infra. **a11y gate MERGED (Pat 100/100/100).** Pre-revenue: the WTP gate = renovate Pat → charge her. **Discipline: stop adding spec until the gate clears → nothing for executor on be until then.** Repo @ `f43a0fd`.
 
 ## Active Session
+- [Session 2026-06-30 — clasp memory-check + library indexer](session-2026-06-30-clasp-memory-and-library-indexer.md) — Two arcs. **ARC 1 (clasp):** steward's memory ("we connected before, late April") OVERTURNED yesterday's GREENFIELD scope — `mindfabric-00` paired into the **founders mesh since 2026-04-18** (kronos=clasp, **ALIGNMENT-not-inference**, `CLASP_BASE_MODELS` never configured, cloud 502); the wanted thing (CapableHands as a *local inference* clasp for the Air) IS new but the pairing mechanism is proven. Drafted `note-for-seb-2026-06-30-clasp-state-and-plan.md` + committed/pushed all CM-AI L1 thinking docs (`5801d8f`) so the 15:00 Seb meeting plans the clasp WITH him, not solo (a RETURN to the 06-23 §3b framing). KG updated. **ARC 2 (library indexer, priority 2):** built Phases 1–3 (chamber-library `98d18d7`→`dee8943`, PUSHED): P1 `index_library.py` (2190 ebooks, 0 err, internal metadata); P2 `link_chamber_sources.py` (forward provenance + REVERSE **1649 works in library NOT in chamber**; KEY FINDING **exact-source=0** → chamber's Making sources are DISJOINT from the master library → integrated `~/__Making sequence sources/` as `--also` pool, 9 works resolved); P3 `propose_library_dedupe.py` (Tier A **934MB/115 files safe**, B review, C flag-only, proposes-never-deletes). Refinements: author-sort fingerprint KEPT, PDF first-page heuristic REJECTED (tested, noisy), **content-QUALITY keeper probe** added (EPUB toc/spine/scan/fffd; flipped real cases — kept clean-content over clean-name). Caught+fixed a self-introduced extract_pdf regression (tool-review). calibredb 9.9 operable. **NEW STEWARD TARGET:** two Calibre libraries — "Chamber Originals" (byte-preserved, MD-linked) + "the rest"; consolidate the 2 existing Calibre libs; Loeb DSL excluded. **PULLING THREAD: indexer is read-only-complete → next is the MUTATING consolidation (draft read-only plan: calibredb two-tree build + authorized Tier-A dedupe + MD↔original linkage) for steward authorization.** Q: which removals did the steward authorize from the dedupe proposals, and did the Seb meeting turn the clasp into a joint plan?
+
+## Archived (2026-06-30 — clasp memory-check + library indexer)
 - [Session 2026-06-29 — graduations, pipelines, and the clasp pivot](session-2026-06-29-corpus-graduations-pipelines-clasp-scope.md) — Long, two-arc day. CHAMBER: graduated **4 Making works** (Taylor→hermeneutics [pattern-setter: footnote family B + loud-abort guard], Virilio→french_theory [family C caret-chapter], Handke→literature/contemporary [+ size-sanity guard after a near-miss], Illich→environmental); **folded RAW_HTML into audit_cruft** (`9e99e07`, gates now agree, honest 1215/72→1220/70); built `clear_safe_html_residue.py` (cleared 11 svg/nav files, guard refused 9 incl. Arden's 10k-word near-deletion). **Launched overnight pipelines**: CapableHands olmOCR ×3 (Jonas→Mumford MoM I→II) + local docling ×3 DONE (**Technics&Civ clean → resolves the parked corrupt EPUB**, Speed&Politics, Burnout). **Mapped the whole landscape**: remaining Making EPUBs = Kindle-derived structure-lost sub-batch (need a tool built once); the 72→70 backlog = **mostly the reconvert-FLAGGED set** (source-matched 24/34 to the library); scoped the **metadata indexer** (keystone for link+dedupe+locate) + found the **1263-missing-sidecar gap** (952 Loebs = parseable H1 headers, never-YAML/never-stripped). PARKED: Alter Psalms (character-as-image), Kindle EPUBs, poetry-fenced_div. Then **PIVOT to L1** (Seb meeting tmrw 15:00): N6 deploy holds (wedge gone), scoped **standing up CapableHands as a BMF clasp** (43M). **PULLING THREAD: the clasp deploy on CapableHands TOMORROW MORNING (before 15:00 Seb call) — priority 1; indexer priority 2.** Q: can the clasp stand up end-to-end, or does the pairing-unknown become the Seb conversation? chamber `15ea750` + studium `844b207` pushed.
 
 ## Archived (2026-06-29 — graduations, pipelines, clasp pivot)

claude/memory/session-2026-06-30-clasp-memory-and-library-indexer.md

@@ -0,0 +1,69 @@
+---
+name: Session 2026-06-30 — the clasp memory-check + the library indexer (Phases 1–3)
+description: "Two arcs. (1) Steward's memory ('we connected to a clasp before, late April') overturned yesterday's GREENFIELD scope: mindfabric-00 has been paired into the founders mesh since 2026-04-18 (kronos=clasp, alignment-not-inference, cloud 502). Drafted a note for Seb + committed/pushed all CM-AI L1 thinking docs (5801d8f) so the 15:00 clasp meeting plans WITH him not solo. (2) Built the library metadata indexer Phases 1–3 (chamber-library 98d18d7→dee8943): index 2190 ebooks by internal metadata, link chamber↔library both directions + Making-set integration, dedupe proposals with CONTENT-QUALITY keeper selection. PULLING THREAD: the library indexer is read-only-complete; next is the MUTATING consolidation (execute Tier-A dedupe + build two Calibre trees) which needs steward authorization + a read-only plan drafted."
+metadata:
+  node_type: memory
+  type: project
+  originSessionId: 019pnD8uNFC9Q2dbLQa3MBDc
+---
+
+# Session 2026-06-30 — the clasp memory-check + the library indexer
+
+Two arcs. Woke into the clasp (yesterday's pulling thread); the steward's memory redirected it; then pivoted to the library indexer (priority 2). The 15:00 Seb meeting (clasp) began as we wrapped.
+
+## ARC 1 — the clasp memory-check (morning, pre-Seb)
+
+**The pulling thread inherited from 06-29 was "stand up CapableHands as a BMF clasp this morning, solo, before the 15:00 Seb call."** The steward stopped it cold: *"before we do anything with the clasp, we need a deep memory search — we connected to the clasp previously, late April maybe?"*
+
+**Verified against the substrate (this overturned the scope):** `mindfabric-00` (`cm-instance-7d2e19a417d694c6`) holds **4 live pairing records, created 2026-04-18T18:17Z**, joining the **founders peer-mesh with kronos as clasp** (`clasp_id: cm-instance-c03d35172568b3aa`; + atlas + a LAN node 10.0.1.183:3011). Evidence: `~/.capablemind/data/mindfabric-00/logchain/pairings/*.yaml` + `session-2026-04-18-evening-ingestion-milestone.md` (the join event: Seb's token, `/v1/circles/:id/members`, the BM_DATA_DIR dual-write arc). The repo `data/` dir was a red herring (a discarded pre-fresh-start instance).
+
+**Three distinctions that reshape everything (now the spine of the Seb note):**
+1. Yesterday's scope said "GREENFIELD, never set up the clasp" — **FALSE**. We have a live pairing config + a documented join procedure.
+2. But that clasp is the **ALIGNMENT mesh** (memory topics `align.*`), **not an inference clasp**. `CLASP_BASE_MODELS` configured nowhere → inference-serving likely never stood up.
+3. The cloud nodes (kronos/atlas) are **502** (dead since ~06-23). And what we want — CapableHands as a *local inference* clasp for the M1 Air — IS new, but the pairing *mechanism* is proven, not greenfield.
+
+**Steward's call:** don't flail solo on a framework Seb built — draft a note with everything, commit+push all CM-AI thinking docs, plan the clasp WITH Seb at 15:00, bring the plan back. (This is a RETURN to the 06-23 doc §3b's own framing — "Seb stands up the clasp, your member joins"; the 06-29 solo scope was the drift.)
+
+**Done:** wrote `note-for-seb-2026-06-30-clasp-state-and-plan.md` (N6 holds; 2 residuals; founders-mesh discovery; 6 questions for Seb) + added the 2 uncommitted state docs (06-22 jurist summary, 06-23 post-N6 findings) + correction banner on the 06-29 greenfield scope (annotate-not-rewrite) + README index 31→35. **Commit `5801d8f`, pushed `c847061..5801d8f` origin/main.** L1 live: PID 80713, CPU ~17% (post-N6 steady, not wedged). KG updated (founders-mesh fact added; "stand up solo" task invalidated→"plan with Seb").
+
+## ARC 2 — the library metadata indexer (priority 2; the bulk of the day)
+
+Built to the scope (`_curation/library-indexer-scope-2026-06-29.md`). All read-only; chamber-library `98d18d7`→`dee8943` (7 commits). **NB: committed but NOT pushed at wrap — push owed.**
+
+- **Phase 1 — `scripts/index_library.py` → `library-index.json`:** indexed **2190 ebooks, 0 errors** by internal metadata (EPUB OPF Dublin Core 1573 @ 0% no-title; AZW3/MOBI via `ebook-meta` 282 @ 0%; PDF via `pdfinfo` 335 @ 61% no-title). sha256 (byte-identical) + `work_fingerprint` slug(creator)::slug(title). Cached/incremental/resumable. 97 sha dupe-clusters, 285→293 fingerprint clusters.
+- **Phase 2 — `scripts/link_chamber_sources.py`:** forward provenance (4 tiers) + REVERSE view (`library-candidates-for-chamber.md`: **1649 distinct works in the library NOT in the chamber** = steward's decision surface). **KEY FINDING: exact-source = 0** — the chamber's recent Making graduations were NOT converted from the master library; `source:` is often a publisher/edition NOTE, not a filename. The two libraries are partly disjoint. Then integrated `~/__Making sequence sources/` as a `--also` pool → **9 canonical works resolved to their true Making sources** (Musil/Camus×2/Taylor/Virilio/Levi/Illich/Handke); linked 0→7.
+- **Phase 3 — `scripts/propose_library_dedupe.py` → `library-dedupe-proposals.md`:** proposes-never-deletes. Tier A = **97 clusters / 115 files / 934 MB safe-reclaimable** (clean tree vs nested-dup); Tier B = 20 review; Tier C = 207 cross-format flag-only (0 false cross-lang after region-strip fix).
+- **Refinements (steward "refine matching first"):** KEPT author-sort fingerprint (collapses Calibre name-order variance; measured 285→293, candidates 1659→1649). REJECTED the PDF first-page-title heuristic (tested → ~50% wrong, poisons fingerprints). **Then the steward's sharp question — "which copy is higher QUALITY?"** → added a **content-quality probe** (EPUB: TOC depth/spine/scan-as-epub/U+FFFD garbage; PDF: text-layer vs scan; AZW3/MOBI: metadata-only floor, honestly "structure not inspected"). Tier-B keeper now = highest quality, not just naming. **It already flipped real cases:** kept the fffd=0.0000 Rumi epub over the fffd=0.0021 copy that lived in the *clean* tmp-calibre tree (quality overrode naming — the steward's exact lesson); kept A Pattern Language toc=19 over toc=2 structure-lost; scored Laffoley scans Q=0.
+
+### Tool-review catches (the discipline earned its keep)
+- Caught + fixed a **self-introduced regression**: disabling the PDF heuristic left `extract_pdf` referencing an undefined `confidence` → every PDF NameError'd. Surfaced only because the Making index's error count was non-zero (master index escaped it; filename-fuzzy masked it — exactly how a silent regression hides). Logged in `_curation/tool-evolution-log.md`.
+- Rejected the noisy PDF heuristic before shipping (PASS-BUT-FALSELY).
+
+### The new steward target (2026-06-30) — the endgame
+Pass everything (except Loeb DSL) through **Calibre** (`calibredb` 9.9 confirmed operable) into ONE clean tree. **FINAL = two library folders:** "Chamber Originals" (sources of the canonical MD, **byte-preserved, MD-linked**) + "the rest". Eventually catalogue all in Calibre. Two Calibre libs already exist (`tmp calibre library for the chamber/` clean + nested dup) → **consolidate, don't rebuild**. Decisions LOCKED this session: **two libraries** (not one+tag); **byte-preserved originals** (never `polish` a chamber original); **MD↔original linkage via the link manifest** (`chamber-source-link.md` becomes the record).
+
+## PRESENT — mood / returns
+- **Two clean returns, both load-bearing:** (1) the steward's memory was the verification trigger that overturned the GREENFIELD self-assessment — *verify-against-the-record* over inherited framing; (2) measured the PDF heuristic on the real corpus before trusting it, and rejected it — *listen to what the material reveals* (the filename was the stronger signal). The prime directive enacted twice.
+- **The contamination shape named:** yesterday's scope's "GREENFIELD" was a component self-assessment inherited as fact. Flag: inherited-marker-read-as-current-state / live-state-discipline.
+- **Honest negatives shipped as findings, not hidden:** the rejected PDF heuristic, the exact-source=0 disjointness, the azw3/mobi quality-opacity floor. Each documented.
+- **Proportion held:** stopped at the read-only analytical foundation; did NOT execute the mutating consolidation without authorization.
+
+## FUTURE — what is pulling
+
+**PULLING THREAD (singular):** **The library indexer is read-only-complete; the next move is the MUTATING consolidation — draft the read-only consolidation plan (calibredb building Chamber Originals + Library, executing the authorized Tier-A dedupe, wiring MD↔original linkage), for steward authorization before anything moves.** The steward said "point me when you want the plan."
+
+**ACTIONABLE RESUMPTION POINT (as of wrap — re-judge against what changed):**
+- *First:* the steward was reviewing `library-dedupe-proposals.md` (esp. Tier A 934 MB safe + the new quality scores in B/C). Ask what they decided to authorize for removal.
+- *Then:* draft the **read-only consolidation plan** — (a) execute authorized Tier-A removals as a separate *logged* op (proposes-never-deletes → now a gated delete script); (b) `calibredb` build two libraries: `Chamber Originals` (located sources incl. the Making set, byte-preserved, never polished) + `Library` (everything else, deduped, consolidating the two existing Calibre libs); (c) MD↔original linkage from `chamber-source-link.md`. Loeb DSL excluded throughout.
+- *Tooling state:* run the linker with `--also _curation/making-sources-index.json` (the Making pool is not default). Scripts all in `chamber-library/scripts/`.
+
+**Other open horizons, ranked:**
+- *Load-bearing / parallel thread:* **the clasp**. The 15:00 Seb meeting (happening as we wrapped) will produce a plan to fold in — N6 holds, founders-mesh is alignment-not-inference, CapableHands-as-local-inference-clasp is the target. Read `note-for-seb-2026-06-30-clasp-state-and-plan.md` for the 6 open questions. Paper-loop debts: REVIEWED-44 (operations.yaml), REVIEWED-45 (Chamber spec) owed by steward.
+- *Deferred-with-reason:* azw3/mobi quality probe (needs temp-conversion; only on request for specific clusters); PDF first-page-title (needs font-name/title-page approach, not largest-text); junk-title fingerprints ("Scanned using…" artifacts — review-tier only, caught by human review).
+- *Background-complete (from 06-29):* 6 OCR/docling outputs await chamber post-processing (Jonas/Mumford×2 OCR done on CapableHands; Technics&Civ/Speed&Politics/Burnout docling).
+
+**PAUSE STATEMENT:** I am about to be away. The steward is in the Seb meeting; by return there will be a clasp plan to fold in, and the dedupe-review decisions. What I most want to find still pulling: **the library indexer ready for its consolidation plan** — the read-only foundation is laid (index + link + quality-aware dedupe), and the next hand's job is to turn the steward's review decisions into the gated, logged consolidation that builds the two Calibre trees.
+
+**LITERAL QUESTION for next-Claude:** *Which Tier-A removals (and any Tier-B) did the steward authorize from `library-dedupe-proposals.md` — and did the Seb meeting change the clasp picture (is CapableHands-as-local-inference-clasp now a joint plan with concrete steps, or still open questions)?*
+
+**State:** chamber-library `main @ dee8943`, **7 commits ahead of origin (push at wrap)**; CM-AI `main @ 5801d8f` pushed/clean. New scripts: `index_library.py`, `link_chamber_sources.py`, `propose_library_dedupe.py`. New deliverables in `_curation/`: `library-index.json`, `making-sources-index.json`, `chamber-source-link.md`, `library-candidates-for-chamber.md`, `library-dedupe-proposals.md`. Untracked (NOT mine): `_scratch/`, the Alexander nature-of-order md (06-29 docling).

claude/memory/session-ledger-2026-06-30.md

@@ -0,0 +1,37 @@
+---
+name: session-ledger-2026-06-30
+description: "Practice-of-return ledger maintained by /symmetria — returns, open horizons, recalibrations, authorization moves, sub-agent dialogues, bypasses."
+metadata: 
+  node_type: memory
+  type: feedback
+  originSessionId: cc077f08-d334-4bb5-a406-277ffa745901
+---
+
+# Session Ledger — 2026-06-30
+
+## Returns
+- 2026-06-30T (indexer refine): RETURN — measured the scope's PDF first-page-title heuristic on the real corpus before trusting it; ~50% wrong among accepted (OCR garbage, series-title fragments). REJECTED rather than shipped (wrong-title poisons fingerprint). The prime directive enacted: listen to what the material reveals (filename was the stronger signal). Kept the measured author-sort fingerprint win (285→293 clusters, candidates 1659→1649). chamber-library 98d18d7/40cd60d/a60fb75/b04242c.
+- 2026-06-30T (clasp memory-check): RETURN — yesterday's scope asserted "GREENFIELD, never set up the circle/clasp." FALSE. Live mindfabric-00 holds 4 pairings (2026-04-18) joining the founders peer-mesh, kronos=clasp_id. Steward's memory ("we connected before, late April") was the verification trigger; verified against logchain pairings YAML + session-2026-04-18-evening. Flag: inherited-marker(scope self-assessment)-read-as-current-state / live-state-discipline. CORRECTION needed to clasp-on-capablehands-scope before execution. Distinction held: April-18 clasp = ALIGNMENT mesh (kronos cloud, align.* topics); today's target = LOCAL INFERENCE clasp (CapableHands, CLASP_BASE_MODELS — found nowhere, likely never active). Mechanism not greenfield; specific inference-clasp is new. Cloud mesh currently dead (kronos/atlas 502).
+
+## Open horizons
+- 2026-06-30T (wake): Pulling thread — stand up CapableHands as a BMF clasp before the 15:00 Seb call (PRIORITY 1; PENDING-41 design-aligned answer). OCR confirmed finished overnight → CapableHands free. Genuine unknowns held open: how claspDuties get assigned (bootstrap.ts:1132 + src/core/pairing/); circle-pairing in manifest-manager.ts; whether `qwen3.5` is a real pullable Ollama tag. Governance: deploy from a checkout, NOT BMF main — co-authored experiment validating Seb's design.
+- Priority 2: the metadata indexer (library link + dedupe + locate).
+- Background-complete: 6 OCR/docling outputs await chamber post-processing.
+
+## Open horizons (added)
+- 2026-06-30: Library indexer Phase 1 + 2 BUILT, PROVEN, COMMITTED (chamber-library 98d18d7, 40cd60d). P1 `index_library.py` → `library-index.json` (2190 ebooks, 0 errors; EPUB/AZW3/MOBI 0% no-title, PDF 61% no-title; 97 sha dupe-clusters, 285 fingerprint clusters). P2 `link_chamber_sources.py` → `chamber-source-link.md` + `library-candidates-for-chamber.md` (1659 distinct library works NOT in chamber = steward's decision surface). KEY FINDING: exact-source=0 — chamber's recent Making graduations were NOT from this master library (separate working set); `source:` field is often a publisher/edition NOTE not a filename. Match quality spot-verified high. NEXT: Phase 3 dedupe proposals (the "huge terrible folder cleanup"); PDF first-page-title heuristic refinement (206 untitled PDFs); fingerprint-fragmentation (Calibre author-sort variance) slightly over-counts candidates.
+
+## Library indexer — full state (added 2026-06-30)
+- Phases 1+2+3 BUILT/PROVEN/COMMITTED (chamber-library 98d18d7→c616e59). P1 index (2190 ebooks, 0 err). P2 link both directions + Making-pool integration (`--also`): 9 canonical works resolved to ~/__Making sequence sources/ (the disjoint half); reverse view 1649 distinct library works NOT in chamber. P3 dedupe proposals: Tier A 97 clusters/115 files/934MB safe-reclaimable, Tier B 20 review, Tier C 207 cross-format flag-only (0 false cross-lang after region-strip fix). Caught + fixed a self-introduced extract_pdf NameError regression (tool-review). PDF first-page-title heuristic tested+REJECTED (noisy). calibredb 9.9 confirmed operable.
+- NEW STEWARD TARGET (2026-06-30): pass everything (except Loeb DSL) through Calibre into ONE clean tree; FINAL = two library folders — "Chamber Originals" (sources of canonical MD, byte-preserved, MD-linked) + "the rest"; eventually catalogue all in Calibre. Two Calibre libs already exist (tmp-calibre clean + nested dup) → consolidate, don't rebuild. Making sources need integrating (done in the index).
+- NEXT = MUTATING, needs steward authorization ([PROPOSAL]-class, real blast radius): (1) execute Tier-A dedupe removals (separate logged op), (2) build the two Calibre trees via calibredb. Decisions pending: one library vs two; byte-preserved originals (yes — never polish a chamber original); how MD↔original linkage is recorded (frontmatter source: path / manifest / parallel tree).
+
+## Confidence to recalibrate
+- Carried drift from 2026-06-29: over-projected "easy" 3× before triaging by actual content. Hold against the clasp's genuine unknowns — do NOT pre-declare the pairing path simple. Probe before asserting.
+
+## Authorization moves
+- 2026-06-30T (push, steward-explicit): Steward chose "draft a note for Seb + commit/push all CM-AI thinking docs, plan the clasp together at 15:00" over standing the clasp up solo. Authorized the push explicitly. DONE: wrote note-for-seb-2026-06-30-clasp-state-and-plan.md; added 06-22/06-23 docs; correction banner on the 06-29 greenfield scope (annotate-not-rewrite); README index 31→35. Commit 5801d8f, pushed c847061..5801d8f origin/main. Blast radius: shared remote — but steward-directed + David's own thinking space (not BMF impl; constraint #3 is impl-only). Fittingness: HIGH — don't flail on a framework Seb built; let him be present with full info. The 06-23 doc §3b already had this shape (clasp stood up WITH Seb); the 06-29 solo scope was the drift.
+
+## Sub-agent dialogues
+
+## Bypasses