Top
Best
New

Posted by pmaze 1 day ago

Show HN: I used Claude Code to discover connections between 100 books(trails.pieterma.es)
I think LLMs are overused to summarise and underused to help us read deeper.

I built a system for Claude Code to browse 100 non-fiction books and find interesting connections between them.

I started out with a pipeline in stages, chaining together LLM calls to build up a context of the library. I was mainly getting back the insight that I was baking into the prompts, and the results weren't particularly surprising.

On a whim, I gave CC access to my debug CLI tools and found that it wiped the floor with that approach. It gave actually interesting results and required very little orchestration in comparison.

One of my favourite trail of excerpts goes from Jobs’ reality distortion field to Theranos’ fake demos, to Thiel on startup cults, to Hoffer on mass movement charlatans (https://trails.pieterma.es/trail/useful-lies/). A fun tendency is that Claude kept getting distracted by topics of secrecy, conspiracy, and hidden systems - as if the task itself summoned a Foucault’s Pendulum mindset.

Details:

* The books are picked from HN’s favourites (which I collected before: https://hnbooks.pieterma.es/).

* Chunks are indexed by topic using Gemini Flash Lite. The whole library cost about £10.

* Topics are organised into a tree structure using recursive Leiden partitioning and LLM labels. This gives a high-level sense of the themes.

* There are several ways to browse. The most useful are embedding similarity, topic tree siblings, and topics cooccurring within a chunk window.

* Everything is stored in SQLite and manipulated using a set of CLI tools.

I wrote more about the process here: https://pieterma.es/syntopic-reading-claude/

I’m curious if this way of reading resonates for anyone else - LLM-mediated or not.

472 points | 141 commentspage 7
miracoli 1 day ago|
wow I hope the bubble pops soon.. now that you discovered books with AI that was illegally trained on them, how about reading them?
nephihaha 1 day ago||
I'm not sure I understand what the connections are exactly, or whether they go much deeper than certain words and phrases.
only-one1701 1 day ago||
I'm really not trying to be mean, but one of the things we learn in the humanities is that basically any two texts can be connected via extremely broad statements (e.g. "Perfect is the enemy of the good"). This is like the joke on twitter about how every couple of years someone in tech invents the concept of public transportation.
nephihaha 20 hours ago||
Yes, exactly, "extremely broad". English isn't just built up of individual words, but phrasal verbs, idioms and sayings, so it is inevitable some of these will repeat. (Even before AI, hack writing relied on clichés, repetition etc and downright plagiarism.)
jennyholzer6 17 hours ago||
[dead]
pharrington 1 day ago||
Please don't give yourself LLM-induced psychosis.
napolux 1 day ago|
Monetize it!