session 2026-06-28: Musil graduated + Position I complete + gold-standard gate fixed (verify RAW_HTML) + 2 policies (engine-sources-graduate, notes-are-the-work) + maturation dialogue

This commit is contained in:
David F Glidden
2026-06-28 22:11:10 +02:00
parent e0815f667d
commit 8adc8ad590
6 changed files with 145 additions and 1 deletions
+7 -1
View File
@@ -29,6 +29,9 @@ permalink: claude-memory/memory
- [Plane coordination workflow](reference-plane-coordination-workflow.md) — **NOW CENTRAL to the steward↔Seb workflow** (est. 2026-06-02): `app.plane.so/capablemind`, BMF project, thin effort-tasks `[BM #N]` over canonical GH issues (effort-only, no technical detail; labels/priority mirror GH; issue attached as link). Executor keeps task state current as the 6-hour relay. ⚠ BBF = BetterBridge *product*, NOT the board. Plane MCP user-scoped/OAuth; load tools via ToolSearch `select:mcp__plane__*`. `create_work_item` needs `description_html`.
- [Resurface banked notes before re-deriving](feedback-resurface-banked-notes-before-rederiving.md) — when an idea was already captured (runbook known_gaps, skill-harvest, prior note), READ the note before re-deriving; re-derivation drifts (page-numbers mis-recalled as provenance vs structure-scaffolding, steward re-corrected 2026-06-27). The engine's own purpose, turned on my practice.
- [Tool review after each use](feedback-tool-review-after-each-use.md) — steward directive (2026-06-16): review every tool we built after each run (success OR failure), capture what it taught, iterate until reliable; PASS-BUT-FALSELY is the priority signal. Log at `chamber-library/_curation/tool-evolution-log.md`. Proven same day (audit_cruft hardening → 160 hidden-dirty files surfaced).
- [Engine sources graduate to the permanent chamber](feedback-engine-sources-become-permanent-chamber-collection.md) — steward policy (2026-06-28): any work added for the engine ALSO becomes permanent chamber collection unless expressly stated; take it ALL the way (clean→verify→graduate→catalogue→sidecar); never leave staged. The chamber accumulates. ⇒ all ~30 Making sources graduate in.
- [Notes are part of the work](feedback-notes-are-part-of-the-work-keep-footnotes-endnotes.md) — steward directive (2026-06-28): footnotes/endnotes are integral — KEEP+CONVERT them (`<sup><a>`→`[^N]`), never drop on graduation. (Caught dropping Taylor's endnotes — wrong.)
- [The maturation of the chamber — a dialogue](../../../../../_Dev/studium-engine/docs/the-maturation-of-the-chamber-a-dialogue-2026-06-28.md) — the pivotal 2026-06-28 exchange clarifying the chamber's telos: fidelity-without-trust, reading-is-unsolvable-and-that's-the-feature, language-as-notation, L2/engine=answerable-not-pure. Read when the thread touches the engine's purpose; companion to [[project-studium-engine-telos-chamber-of-voices]].
## Canonical Workstream Trackers
*Read the tracker for any active workstream at /wake-up before composing the briefing. Append substantive moves at /wrap-up. Per `feedback-canonical-workstream-tracker-discipline.md`.*
@@ -44,7 +47,10 @@ permalink: claude-memory/memory
- [Be (laundromat)](project-be-laundromat.md) — canonical workstream tracker established 2026-06-08 (Seb-relay of locked decisions). Be = Skemantix startup (Seb+David) funding CapableMind's funding-ladder; **bridge, not venture**. Decisions LOCKED: entity/exit (CapableMind decoupled, grant-funded), pricing (Living $12.99/mo · Archive $69.99/yr · Memorial $49.99/yr · Renovate ~$199 · $8.99 floor), CF Self-Serve Agency + versioned-template-package infra. **a11y gate MERGED (Pat 100/100/100).** Pre-revenue: the WTP gate = renovate Pat → charge her. **Discipline: stop adding spec until the gate clears → nothing for executor on be until then.** Repo @ `f43a0fd`.
## Active Session
- [Session 2026-06-27 — ocrmac conversion toolset CALIBRATED + Making-corpus advance + engine research](session-2026-06-27-ocr-toolset-calibrated-making-corpus-research.md) — Marathon. Alexander book1 graduation → **discovered olmOCR SCRAMBLES 2-column figure-dense books** (reads across the gutter; the verbatim word-guard can't catch it — PASS-BUT-FALSELY at the corpus level) → **built+calibrated the ocrmac (Apple Vision) column-aware conversion toolset**: (1) **column detection** = line-crossing-of-narrow-lines + line-width (DPI was the key, 120→150); validated all 491 pages; (2) **de-hyphenation** = **wordfreq, MULTILINGUAL** `--lang en|fr|de|es` (merged-Zipf≥3.4→merge / both-parts≥4→compound / unknown-lowercase→**merge_flag** catches OCR+reflow errors); Camus/Handke forward-req met by design; (3) **structure recovery** = steward's page-number method (scaffolding NOT provenance; retain→map ToC printed-page→scan→place→strip) **PROVEN 9/9**. Tools evolved: `scripts/normalize_ocr.py` (+within-page rejoin, page-top runhead detection, `--no-heading-recovery`, wordfreq), `scripts/insert_chapter_headings.py` (2-level+block-replace; Levi byte-identical). Method `docs/ocr-conversion-method-2026-06-27.md`. **Then compute-deployed (steward: spend the compute, except L1):** engine-design **research sweep DONE** (`studium-engine/docs/research-grounded-reasoning-bounded-corpus-2026-06-27.md`; 107 agents/23 verified — citation **correctness≠faithfulness** [57% post-rationalized] vindicates "boundedness=trust"→couple attribution to generation; adopt **SelfCite+eTracer+MiniCheck**; engine's genealogy/temporal + multi-voice signature capabilities are GREENFIELD = 2 sweeps owed); **Making-corpus readiness map** (`chamber-library/docs/making-corpus-conversion-readiness-2026-06-27.md`; 30 raw, mostly EPUB=fast); **Musil English EPUB converted** (steward upload; 464k words; structure scoped via NCX anchors). **Steward corrections:** page-numbers=scaffolding-not-provenance (→`feedback-resurface-banked-notes-before-rederiving`); Levi drop-caps RECOVERED (re-raised wrongly 3×) but a **within-page-rejoin hyphenation final pass owed** ("essentially ready"); p42-is-2col (misread the image). **PULLING THREAD: finish the conversion toolset (package driver + furniture layer) + build the Making corpus — Position I (Musil structure recovery + Levi hyphenation pass) unblocks the engine's first pattern-finder pass.** UNCOMMITTED for steward review: chamber scripts+docs, studium research doc (_scratch/ + staged olmOCR Alexander raw are SUPERSEDED — don't commit). CapableHands: ocrmac installed, /tmp cache. ssh/scp capablehands persisted. **Q: unify ToC-page-number (OCR) + NCX-anchor (EPUB) structure recovery into one format-agnostic "structure-from-authoritative-ToC" step?**
- [Session 2026-06-28 — corpus settling: Musil graduated, Position I complete, gold-standard gate fixed](session-2026-06-28-corpus-settling-position-I-complete-gate-fixed.md) — Long, foundational day, spine set by the morning **maturation-of-the-chamber dialogue** (fidelity-without-trust; reading-is-unsolvable-and-that's-the-feature; language-as-notation; L2/engine=answerable-not-pure → `studium-engine/docs/the-maturation-of-the-chamber-a-dialogue-2026-06-28.md`; *settle the corpus we CAN perfect before the engine*). **Graduated English Musil** (Wilkins/Pike, `471bc53`) via TWO new reusable EPUB tools — `structure_from_ncx.py` + `clean_pandoc_html_residue.py` — proving the unify answer: ONE placement engine (`insert_chapter_headings`), TWO map-producers (EPUB NCX-anchors / OCR page-numbers); raw↔final prose WORD-IDENTICAL; source archived `~/__Making sequence sources/`. **Position I COMPLETE** (Weil×2, Musil-English [replaced French, steward-ruled], Arendt, Levi): Levi *Shame*-chapter hard-wrap reflowed (Shakespeare verse preserved) + re-scoped to the COMPLETE book (id→`levi-drowned-and-saved`); all 5 sha-current + sidecars matched. **Two policies set:** [[feedback-engine-sources-become-permanent-chamber-collection]] + [[feedback-notes-are-part-of-the-work-keep-footnotes-endnotes]]. **Runbook brought current** (`epub_ncx_markdown` path; olmOCR/ocrmac CORRECTED — two-tool by column: single→olmOCR, multi→ocrmac, complementary not retired). **GOLD-STANDARD GATE FIXED** (`af17dde`): `verify_conversion` had a PASS-BUT-FALSELY (passed cruft=0 on Taylor's 59 raw `<sup>`) → added `RAW_HTML` gate → trustworthy audit **1187/91→1152/126** (35 false-passes caught). All committed+PUSHED (chamber `af17dde` skemantix, studium `cdd8d4a` github). **PULLING THREAD: the graduation batch — work the ~18 Making EPUBs + ~9 PDF/OCR + the audit's 126 fails into the chamber, properly (KEEPING NOTES), against the now-trustworthy gate; Taylor-redone-WITH-notes is first + pattern-setter.** Q: new-Making-graduations first or the 126 audit-fails first — which serves the engine sooner? Two greenfield research sweeps (genealogy/temporal; multi-voice) + multilingual-NLI validation = the engine phase, gated on corpus.
## Archived (2026-06-28 — corpus settling: Musil graduated, Position I complete, gate fixed)
- [Session 2026-06-27 — ocrmac conversion toolset CALIBRATED + Making-corpus + engine research](session-2026-06-27-ocr-toolset-calibrated-making-corpus-research.md) — Marathon. Discovered olmOCR scrambles 2-col figure-dense (PASS-BUT-FALSELY) → built+calibrated the ocrmac column-aware toolset (column detection via line-crossing+line-width@150dpi; wordfreq MULTILINGUAL de-hyph; page-number structure recovery 9/9). Engine research sweep DONE (citation correctness≠faithfulness; SelfCite+eTracer+MiniCheck; genealogy/multi-voice GREENFIELD=2 sweeps owed). Making readiness map (30 raw). Musil English converted. [Superseded re olmOCR-retirement: 2026-06-28 corrected to two-tool-by-column.]
## Archived (2026-06-27 — ocrmac toolset calibrated + Making-corpus + engine research)
- [Session 2026-06-26 — Chamber spec ratified + OCR pipeline + Levi first graduation](session-2026-06-26-chamber-ocr-pipeline-levi-first-graduation.md) — Chamber Library spec §§I–VI RATIFIED (source-agnostic canonical form; verbatim=faithful-under-declared-normalization; two-sidecar Voice); built the OCR→canonical pipeline + FIRST spec-conformant graduation (Levi). PENDING-42 / REVIEWED-45-owed. [Superseded re: OCR — olmOCR pipeline replaced by ocrmac column-aware toolset 2026-06-27.]