session 2026-06-26: chamber OCR pipeline + Levi first spec-conformant graduation

Session memory + MEMORY.md index (Active → 2026-06-26) + ledger + skill-harvest
register (/graduate-chamber-source proposal). Pulling thread: apply the proven
OCR→canonical pipeline to the rest of the OCR sources — Alexander Books 1–4 next.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019pnD8uNFC9Q2dbLQa3MBDc
This commit is contained in:
David F Glidden
2026-06-26 23:51:29 +02:00
co-authored by Claude Opus 4.8
parent adb3d88596
commit 64356724f2
4 changed files with 84 additions and 0 deletions
+3
View File
@@ -43,6 +43,9 @@ permalink: claude-memory/memory
- [Be (laundromat)](project-be-laundromat.md) — canonical workstream tracker established 2026-06-08 (Seb-relay of locked decisions). Be = Skemantix startup (Seb+David) funding CapableMind's funding-ladder; **bridge, not venture**. Decisions LOCKED: entity/exit (CapableMind decoupled, grant-funded), pricing (Living $12.99/mo · Archive $69.99/yr · Memorial $49.99/yr · Renovate ~$199 · $8.99 floor), CF Self-Serve Agency + versioned-template-package infra. **a11y gate MERGED (Pat 100/100/100).** Pre-revenue: the WTP gate = renovate Pat → charge her. **Discipline: stop adding spec until the gate clears → nothing for executor on be until then.** Repo @ `f43a0fd`.
## Active Session
- [Session 2026-06-26 — Chamber spec ratified + OCR pipeline + Levi first graduation](session-2026-06-26-chamber-ocr-pipeline-levi-first-graduation.md) — **Chamber Library spec §§I–VI RATIFIED** (steward+jurist loop, run live): source-agnostic canonical form + work+chapter+quote citation (+sectionless reduction); **§V verbatim = faithful-under-*declared*-normalization, NOT byte-identity** (three-tier; resolved the spec's internal contradiction); **§VI two-sidecar Voice** (reading-index derived+hash-bound / voice-manifest authored engine-side; gate verifies ONLY vs canonical text; `voice:` tag stays in corpus). PENDING-42; **REVIEWED-45 owed from steward.** Sidecar-typology thinking → `studium-engine/docs/the-sidecar-typology-and-orchestration-2026-06-26.md`. **Built the reusable OCR→canonical pipeline:** `scripts/normalize_ocr.py` (drop pages · conservative seam-rejoin · dict-validated de-hyphenation [merge / auto-resolve-doubling / defer-compound] · **verbatim WORD-GUARD** §V · conversion record; raw off-canon §III; supersedes clean_ocrmac_pagination) + `scripts/insert_chapter_headings.py` (per-book TITLE⇥anchor structure-map, fails-loud). **Caught a PASS-BUT-FALSELY in my OWN guard** (passed 3 word-altering merges → dict-validate fix). **FIRST SPEC-CONFORMANT GRADUATION: Levi *The Drowned and the Saved*** (Rosenthal 1988) — §IV/§VI frontmatter, Coleridge epigraph, **10 verified chapter headings** (read body vs ToC), apparatus trimmed, verify_conversion PASS; raw→`converted_texts/` §III + conversion.yaml + structure.tsv; catalogue 1286. Steward: "crossed a milestone, set an excellent precedent." **Structure finding (load-bearing for Alexander):** olmOCR output has NO heading markup / NO body page numbers / PDFs NO outline → chapter structure recovered **curatorially from the ToC, per-book**; Alexander's 4 books share it (worse: 4-vol reprinted ToC, Roman numerals, per-book page restarts). Steward's page-number idea **tested→doesn't-stick** for current files (furniture already stripped at OCR) → banked as a **driver enhancement** (runbook known_gaps.next). **Committed+pushed all 3 repos:** chamber `7b46937` (→skemantix), dotfiles `adb3d88`, studium `6abb593`+`38de1a9`. **Engine re-pointed** `levi-gray-zone` omnibus→standalone (manifest+sidecar; Gray Zone now clean ## ch L116–257). **PULLING THREAD: apply the proven pipeline to the rest of the OCR sources — Alexander Books 1–4 next** (book4 page-marked in chamber; books 1-3 raw clean on CapableHands `~/capablehands/scratch/`). **Owed:** engine re-ingest (coverage-ledger/chunk-quality stale to re-pointed Levi); CapableHands driver note BLOCKED on steward granting `Bash(ssh capablehands:*)`. `ssh capablehands` alias active. **Q: does Alexander's gnarlier ToC fit the current per-book structure-map, or need a richer instrument (one map per vol vs shared)?**
## Archived (2026-06-26 — Chamber OCR pipeline + Levi first graduation)
- [Session 2026-06-24→25 — OCR workhorse proven → the Chamber Library needs a spec](session-2026-06-25-chamber-library-spec-born-from-ocr-workhorse.md) — **Stood up CapableHands (M4 64GB, `david@10.0.1.136`) as an isolated MLX/olmOCR workhorse** (uv+py3.12+mlx-vlm; model `alexgusevski/olmOCR-7B-0225-preview-q8-mlx`; isolated from Peter's `capablemind` Ollama). **Levi** (*Drowned & Saved*, Rosenthal 1988 — drop-cap gate CLEARED) + **Alexander Book 4** OCR'd; **caught a PASS-BUT-FALSELY** (driver dumped JSON on no-text pages + ToC dot-loops) → patched driver (null→marker, `repetition_penalty`, `--pages`) + `splice_pages.py` → both clean. **2 ARC posts published** (The Allée / Two Notes, Aix; source-commit was a loose end → committed at wrap). **THE REAL ARC:** a citation-convention question → **steward challenged my two-tier (PDF=page / EPUB=chapter) framing** → resolved to **ONE source-agnostic canonical standard** (clean prose + intrinsic `##`/`---` structure + citation by *work+chapter+verbatim quote*; no page markers; page-provenance off-canon) → **realization that the chamber library is a substrate needing its own SPEC.** **Seed drafted:** `chamber-library/docs/chamber-library-specification.md` (`[PROPOSAL]`, charter-coupled; §§II-III settled, **§VI Voice RESERVED/undesigned** per steward, §V/§VII/§IX open). **Careless-edit mistake recovered:** stripped *La Chute*'s 5 structural `\`-break spacers as "stray" (steward caught: 6 evenings) → restored from pristine backup. **PULLING THREAD: ratify spec §§II-III → build OCR+EPUB normalizers (→ one form) → conformant graduation** (held until then; Books 1-3 OCR-ing background PID 2653). **Q: do steward+jurist ratify §§II-III?** [[project-arc-open-work-register]] §G (Gwern: link-rot G1 / progress-bar G2 / Gwern-audit G3). CapableHands password steward-supplied → **rotate.**
## Archived (2026-06-25 — Chamber Library spec born from the OCR workhorse)