David/dotfiles
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

session 2026-06-29: 4 graduations + RAW_HTML fold-in + OCR/docling pipelines launched; landscape mapped (reconvert-queue, indexer scope, sidecar gap); L1 pivot → CapableHands-clasp scope for tmrw Seb mtg

Browse Source
This commit is contained in:
David F Glidden
2026-06-29 23:29:15 +02:00
parent 8adc8ad590
commit 0f75862af6
6 changed files with 214 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
claude/memory/project-source-library-link-and-dedupe.md
+18
View File
@@ -0,0 +1,18 @@
---
name: source-library-link-to-chamber-dedupe-steward-goal
description: "The steward's master source library is ~/Documents/___The Library [ePub_AWZ3]/ (2190 ebooks: 1573 epub, 267 azw3, 335 pdf, 15 mobi; 180k total files; messy nested subfolders). Eventual goal: LINK it to the chamber (canonical_texts ↔ source provenance) and DEDUPE the messy folder. The fuzzy source-matcher built 2026-06-29 is the seed of both."
metadata:
node_type: memory
type: project
originSessionId: 604b3d1d-6111-48f2-9683-2dfba02d5b6b
---
**Location:** `/Users/davidglidden/Documents/___The Library [ePub_AWZ3]/` — the steward's master ebook library. 2190 ebooks (1573 .epub, 267 .azw3, 335 .pdf, 15 .mobi), 180,567 total files, deeply/messily nested. Notable subfolders the steward pre-organized: `_2026 chamber source cleanup/` (categorized `1. PDF`, `2. EPUB/<tradition>`), `tmp calibre library for the chamber/` (clean Calibre `Author/Title (id)/Title - Author.ext` structure — the most matchable), `The Library [ePub_AWZ3]/` (nested dup of the root, also Calibre-ish), `__PDF/`, `superpower mine/`, `New texts may 2026/`. The steward asserts the originals for ALL chamber sources are in here somewhere.
**Steward goal (stated 2026-06-29):** (1) LINK the two libraries — chamber `canonical_texts/` ↔ their source files (a provenance index: every canonical work → the exact source it was converted from). (2) DEDUPE the messy folder (z-library dupes, Calibre dupes, format dupes epub+azw3+pdf of the same work, the root↔`The Library [ePub_AWZ3]/` nesting dup).
**Seed already built (2026-06-29):** a fuzzy source-matcher (token-overlap of title/author keywords vs library filename stems) — used to match the 34 reconvert-flagged works → sources (24 found, 10 needed manual locate). Output: `chamber-library/_curation/reconvert-queue-2026-06-29.md`. This same matcher generalizes to BOTH goals: run it over ALL ~1290 canonical works → the link index; run it within the library (filename clustering) → duplicate clusters for dedupe.
**How this connects to the reconversion work:** the immediate driver was that ~34 of the ~69 remaining cruft files are the reconvert-flagged set (`_curation/reconvert-list-2026-06-16.txt`) — already judged "reconvert, don't patch." The link index makes reconversion executable (each flagged work → its source). See [[feedback-character-as-image-hazard]] (pre-check sources before converting), the conversion runbook, and the session ledger 2026-06-29 for the backlog map.
**Caution (matcher limits):** fuzzy filename matching misses French/diacritic titles & differently-named editions (Mythologiques, Les Fleurs du Mal, Peirce, Neumann all returned no match despite likely being present). A real link index should also read EPUB/PDF *internal metadata* (dc:title/dc:creator), not just filenames. And verify edition/translation identity (Foucault: the library's "Madness and Civilization" is the ABRIDGED EN, ≠ the canonical FR "Histoire de la folie") — wrong-edition is worse than no-match.