Files
dotfiles/claude/memory/project-source-library-link-and-dedupe.md
T

4.2 KiB

name, description, metadata
name description metadata
source-library-link-to-chamber-dedupe-steward-goal The steward's master source library is ~/Documents/___The Library [ePub_AWZ3]/ (2190 ebooks: 1573 epub, 267 azw3, 335 pdf, 15 mobi; 180k total files; messy nested subfolders). Eventual goal: LINK it to the chamber (canonical_texts ↔ source provenance) and DEDUPE the messy folder. The fuzzy source-matcher built 2026-06-29 is the seed of both.
node_type type originSessionId
memory project 604b3d1d-6111-48f2-9683-2dfba02d5b6b

Location: /Users/davidglidden/Documents/___The Library [ePub_AWZ3]/ — the steward's master ebook library. 2190 ebooks (1573 .epub, 267 .azw3, 335 .pdf, 15 .mobi), 180,567 total files, deeply/messily nested. Notable subfolders the steward pre-organized: _2026 chamber source cleanup/ (categorized 1. PDF, 2. EPUB/<tradition>), tmp calibre library for the chamber/ (clean Calibre Author/Title (id)/Title - Author.ext structure — the most matchable), The Library [ePub_AWZ3]/ (nested dup of the root, also Calibre-ish), __PDF/, superpower mine/, New texts may 2026/. The steward asserts the originals for ALL chamber sources are in here somewhere.

Steward goal (stated 2026-06-29): (1) LINK the two libraries — chamber canonical_texts/ ↔ their source files (a provenance index: every canonical work → the exact source it was converted from). (2) DEDUPE the messy folder (z-library dupes, Calibre dupes, format dupes epub+azw3+pdf of the same work, the root↔The Library [ePub_AWZ3]/ nesting dup).

Seed already built (2026-06-29): a fuzzy source-matcher (token-overlap of title/author keywords vs library filename stems) — used to match the 34 reconvert-flagged works → sources (24 found, 10 needed manual locate). Output: chamber-library/_curation/reconvert-queue-2026-06-29.md. This same matcher generalizes to BOTH goals: run it over ALL ~1290 canonical works → the link index; run it within the library (filename clustering) → duplicate clusters for dedupe.

How this connects to the reconversion work: the immediate driver was that ~34 of the ~69 remaining cruft files are the reconvert-flagged set (_curation/reconvert-list-2026-06-16.txt) — already judged "reconvert, don't patch." The link index makes reconversion executable (each flagged work → its source). See feedback-character-as-image-hazard (pre-check sources before converting), the conversion runbook, and the session ledger 2026-06-29 for the backlog map.

CANONICAL PROVENANCE ARCHIVE ESTABLISHED (2026-07-02): the destination for confirmed source originals is now decided — iCloud Drive / Chamber Sources/ (~/Library/Mobile Documents/com~apple~CloudDocs/Chamber Sources/). Steward-authorized. OUTSIDE the repo (text-only), iCloud = local+cloud, 2TB plan (storage no constraint). Layout = flat + MANIFEST.md (the archive's self-describing index: filename→sha256→graduated chamber text→edition notes). Filenames key to the graduated slug. ⚠ Must be pinned "Keep Downloaded" in Finder — iCloud "Optimize Storage" silently evicts to dataless stubs otherwise (found a live dataless file on Desktop; that's why NOT the Desktop surface). First intake: Jonas (2 scans: IA-color-360dpi = provenance-of-record; bitonal-600dpi = hi-res verify backup), Vico epub (Marsh/Grafton), Heidegger pdf (Hofstadter/Harper). The in-repo per-text sidecar (spec §VI source_sha256) stays DEFERRED per PENDING-42 §VI; MANIFEST.md is the interim index; reconcile with _curation/chamber-source-link.md later. The 25GB master library folds in here per the link+dedupe pass. Heidegger repair candidate: graduated .md title garbled "Poetry, 'bonbuoD Thought" (="Language") — clean source now archived to verify/repair.

Caution (matcher limits): fuzzy filename matching misses French/diacritic titles & differently-named editions (Mythologiques, Les Fleurs du Mal, Peirce, Neumann all returned no match despite likely being present). A real link index should also read EPUB/PDF internal metadata (dc:title/dc:creator), not just filenames. And verify edition/translation identity (Foucault: the library's "Madness and Civilization" is the ABRIDGED EN, ≠ the canonical FR "Histoire de la folie") — wrong-edition is worse than no-match.