David F GliddenandClaude Opus 4.8
3f9a89b00c
Basic Memory v0.21.6 first sync over the live memory dir (steward-authorized live-dir trial, Option A 2026-06-06): adds permalink: to frontmatter, refolds long YAML description lines, strips final newlines. Bodies untouched — verified via full diff classification. From this commit forward, any diff in claude/memory shows only what Basic Memory or the session writes. Trial design: MemPalace untouched as incumbent; git status check on this dir at every wrap; end-of-day evaluation (recall quality, sync robustness, rebuild-from-files, malformed-file behavior). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
86 lines
6.0 KiB
Markdown
86 lines
6.0 KiB
Markdown
---
|
||
permalink: claude-memory/project-chamber-cruft-restoration
|
||
---
|
||
|
||
---
|
||
name: Chamber-library cruft restoration project — 186 files need work, 62 are load-bearing voices
|
||
description: 47% of the chamber (186/399 .md files) carries cruft from EPUB/HTML conversion residue. 124 are CLEANUP (strip_cruft handles), 62 are severe RECONVERT (need source EPUB + repair pipeline). Load-bearing voices in the severe bucket: Bachelard ×3, Arendt ×3, Adorno, Heidegger, Plato, Marcus Aurelius, Alexander, Lévi-Strauss. Precondition for "discourse with the library" — the steward's actual aim.
|
||
type: project
|
||
originSessionId: a5411fd1-4a96-43e7-aa1a-1a50d8951a8f
|
||
---
|
||
**Why this exists** — the steward's framing 2026-05-13 evening, after seeing the audit:
|
||
|
||
> *between cleaning this and the better query tools that mcp will give us, the library and I could perhaps "talk"*
|
||
|
||
This is the work that makes discourse-with-the-library reachable. Substrate quality + multi-tool retrieval = honest dialogue with the corpus. The chamber-Alexandrian-foundation memo (`project-chamber-alexandrian-foundation-standard.md`) names the standard; this is the restoration that delivers on it.
|
||
|
||
## The actual numbers (2026-05-13 audit of 399 chamber .md files)
|
||
|
||
| Bucket | Files | % | Cruft markers | Lines | Work |
|
||
|---|---:|---:|---:|---:|---|
|
||
| CLEAN (0 markers) | 162 | 41% | 0 | 1,929,017 | nothing |
|
||
| near-clean (<50 markers) | 49 | 12% | 302 | 2,028,939 | leave as-is |
|
||
| light cleanup (<0.01/line) | 33 | 8% | 4,193 | 903,689 | strip_cruft, fast |
|
||
| moderate cleanup (0.01–0.05) | 33 | 8% | 18,991 | 784,607 | strip_cruft, ok |
|
||
| heavy cleanup (0.05–0.20) | 58 | 15% | 94,456 | 878,200 | strip_cruft, heavy |
|
||
| **severe — RECONVERT** (≥0.20) | 62 | 16% | 488,663 | 1,313,685 | source EPUB + repair_epub_headings + pandoc + strip_cruft |
|
||
|
||
**Total work:** 186 files (47% of chamber).
|
||
|
||
## Load-bearing voices in the severe RECONVERT bucket
|
||
|
||
These aren't "any books" — they're chamber load-bearers for the work the steward actually does:
|
||
|
||
- **Phenomenology / Bachelard cycle:** *Poétique de la rêverie*, *Poétique de l'espace* (FR), *La terre et les rêveries de la volonté*, *L'air et les songes*, *Psychanalyse du feu*
|
||
- **Frankfurt School / Arendt:** *Human Condition*, *Eichmann in Jerusalem*, *Between Past and Future* (×2 — duplicate, see below), *Totalitarianism*
|
||
- **Adorno:** *Minima Moralia* (worst offender, 2.19 cruft/line — every line wrapped 2+ times)
|
||
- **Heidegger:** *Being and Time*
|
||
- **Plato:** *The Republic*
|
||
- **Marcus Aurelius:** *Meditations* (new translation)
|
||
- **Alexander:** *A Pattern Language* — the Alexandrian-standard text itself
|
||
- **Lévi-Strauss:** *Mythologiques 1–4* (all four volumes severe)
|
||
- **Borges:** *Fictions*
|
||
- **Visual culture / Berger:** *Here Is Where We Meet*, *A Fortunate Man*, *Understanding a Photograph*, *Success and Failure of Picasso*
|
||
- **Massive volume cases:** Taruskin *Oxford History of Western Music* (131k cruft, 305k lines), Davies *Europe: A History* (31k/84k), Shakespeare *Arden Third Series Complete* (66k/262k), Swafford *Brahms* (12k/35k)
|
||
|
||
## Critical finding: dedup missed an Arendt duplicate
|
||
|
||
The 2026-05-13 morning dedup caught byte-identical filename-matches. It missed byte-identical content under different filenames:
|
||
|
||
- `traditions/critical_modernity/frankfurt_school/between-past-and-future-hannah-arendt.md`
|
||
- `traditions/critical_modernity/frankfurt_school/between-past-and-future-penguin-classics.md`
|
||
|
||
Both: 1,166 cruft / 2,110 lines, exactly 0.5526 cruft/line. Identical content under different naming. One needs to go before reconversion to avoid double-mining.
|
||
|
||
Probable other content-dupes lurking in the bucket — worth a content-hash sweep across the chamber as a discrete pre-step before reconversion begins.
|
||
|
||
## Workflow implications
|
||
|
||
**The current mine (running until ~02:30–04:30 tomorrow) is embedding cruft.** All 399 files including the 186 non-clean ones are mining as-is. Drawers will carry pandoc-class markers and HTML scaffolding inline. After cleanup+reconversion, the cleaned files will need re-mining via mempalace's mtime-trigger (touch file → sync prunes old drawers → next mine re-embeds clean).
|
||
|
||
So **cleanup-then-remine is a recurring workflow**, not a one-shot. Each restored file means: clean → touch → sync → mine. The audit script we wrote tonight (`audit_chamber_queryability.py`) becomes the verification surface after restoration.
|
||
|
||
## Sequencing strategy
|
||
|
||
**Phase 1 — CLEANUP bucket (124 files, ~3–5 hours attended work)**
|
||
- Cheaper per-file (strip_cruft.py --apply handles it)
|
||
- No source-material requirement (operates on existing MD)
|
||
- Clears 31% of chamber faster than equivalent effort on RECONVERT
|
||
- Backup discipline: `_backups/YYYY-MM-DD/` per session
|
||
|
||
**Phase 2 — RECONVERT bucket (62 files, ~15–30 hours attended work)**
|
||
- Per-file craft (find source EPUB → repair_epub_headings.py → pandoc -t gfm-raw_html → strip_cruft → verify)
|
||
- Some files have source in `~/Documents/__Chamber Source EPUBs/` (already-repaired) or `~/Documents/___The Library [ePub_AWZ3]/` (need repair); some stranded until source surfaces
|
||
- Priority sequencing: load-bearing for current work first (Bachelard for AldineXXI/phenomenology; Alexander for Pattern Language references; Berger for visual culture)
|
||
|
||
**Phase 3 — final sweep + audit**
|
||
- Re-run `audit_cruft.py` against restored chamber — confirm 0 severe, minimal cleanup remainder
|
||
- Re-mine touched files
|
||
- Run `audit_chamber_queryability.py` against quiescent palace — verify retrieval surfaces canonical voices for designed probes
|
||
- Per Alexandrian-foundation standard: *building what you will not need to rebuild*
|
||
|
||
## Honest scope
|
||
|
||
This is a multi-day substrate restoration project. **15–35 hours of focused work** across the two phases, plus verification and re-mining. Per the chamber-Alexandrian-foundation memo: this is per-file craft, not batch processing; the quality bar applies equally to first and last voices admitted. *Building what you will not need to rebuild.*
|
||
|
||
The aim is not "throughput" — it's a substrate the steward can trust enough to talk *with*, not just search through. |