Top
Best
New

Posted by ahaspel 19 hours ago

Britannica11.org – a structured edition of the 1911 Encyclopædia Britannica(britannica11.org)
314 points | 105 comments
realityfactchex 18 hours ago|
Very, very cool. Hats off. I've considered attempting a more limited form of this for years.

For those who don't know, the 1911 Britannica is heralded for several reasons (and rightly criticized for regrettable others), but the most well-known is that it was the last encyclopedia before The Great War, and hence had a good amount of steam/optimism coming from the first and second industrial revolutions and the "Progressive Era", not sullied yet by thoughts of "the war to end all wars".

Trying https://britannica11.org specifically, it quickly found and displayed the article I searched for, chosen (to search for) at random: Portuguese East Africa, at https://britannica11.org/article/22-0177-portuguese-east-afr...

A question/idea for nice-to-haves, most respectfully. I don't know if it would be feasible. It's probably perfect as it is, simply linking to the image-page in unobtrusive text for each section. But I would love an option (emphasis on option) to see the text side by side with the page images. That parallel view would load all of the page images on the same page as the full article text. That way, I could "confirm" or "fact check" the faithfulness of the OCR, and also see the beautiful printing, at once, without opening each page separately and managing the images/windows myself. Most likely, I would use the site to jump to the articles, and read them mainly as images, only switching to the text form to verify what something said, or to copy-paste cleanly, etc. (As it is, initially, I thought I read the original images were available, but had to visit the page three (3!) times before finding where the side-links to them were.) Maybe thumbnails could be a middle-ground option (again, optional) for salience.

Very, very well done. And it's fast!

aragonite 16 hours ago||
> But I would love an option (emphasis on option) to see the text side by side with the page images. ... That way, I could "confirm" or "fact check" the faithfulness of the OCR.

You can already do that on Wikisource. For example, here's p. 658 from the entry on "Molecule":

https://en.wikisource.org/wiki/Page:EB1911_-_Volume_18.djvu/...

Also OP: I noticed some fidelity issues in your version (at https://britannica11.org/article/18-0684-s2/molecule). For example parts of the math formula under the line that ends with "the molecules of other kinds" ([1]) are missing (compare [2]). Also, in your version fn. 1 of this article is attached to "as they have always done" ([3]) but it should actually be attached to "Atom" on p. 654 ([4]):

[1] https://britannica11.org/article/18-0684-s2/molecule#:~:text...

[2] https://en.wikisource.org/wiki/Page:EB1911_-_Volume_18.djvu/...

[3] https://britannica11.org/article/18-0684-s2/molecule#:~:text...

[4] https://en.wikisource.org/wiki/Page:EB1911_-_Volume_18.djvu/...

realityfactchex 15 hours ago||
That's cool about the WikiSource parallel text+image page view, TIL. Thanks!

As an example flow (since it took a minute to figure out): we can start at https://en.wikisource.org/wiki/1911_Encyclopædia_Britannica then click to navigate/browse volume > section > topic to get to a text page, then click Source tab, then click a Page Number (maybe hunt around for the correct page number), and see the parallel view, text + image. With previous and next page buttons available, retaining the parallel text + image view.

ahaspel 18 hours ago||
Thanks — really appreciate that, and glad it worked well for a random article.

That’s a great suggestion. A side-by-side text + page view would be very nice for exactly the reasons you mention (verifying the text and seeing the original layout). I haven’t built that yet, but I’ve considered it.

Also helpful to hear that the links to the scans weren’t immediately obvious — I should probably make them a bit clearer. This may also not be obvious, but you can click the vol:page links in the left margin and go directly to the scan of whatever page you're reading.

Thanks again.

ahaspel 19 hours ago||
I rebuilt the 1911 Encyclopædia Britannica into a clean, structured, navigable site:

https://britannica11.org/

What it does:

– ~37k articles reconstructed from the original volumes – section-level structure (contents are clickable within articles) – cross-references extracted and linked – contributors indexed and searchable – original volume + page references preserved and shown while reading – links to the original scans for each page – ancillary material included (prefaces, abbreviations, etc.) – topic index reproduced and cross-linked – full-text search with article metadata (length, volume, etc.)

Most of the work was in parsing and reconstruction: headings, multi-page articles, tables, math, languages, footnotes, plates, and all the small edge cases that come up in a work like this.

The goal was to make something that feels like the original, but is actually usable.

I’d especially appreciate feedback on: – search quality – navigation (sections, cross-references) – anything that looks structurally off

Happy to answer questions about the pipeline or data model

zozbot234 17 hours ago||
You might want to add The Reader's Guide to the Encyclopaedia Britannica, PD text available at https://www.gutenberg.org/ebooks/74039 and scans at https://archive.org/details/readersguidetoen00londuoft - It would fit naturally with the Ancillary material that includes the topic-based index.
ahaspel 16 hours ago||
It would indeed. I will see about working this in, it's highly pertinent.
bentley 2 hours ago|||
There’s an escaping issue in tables of contents. See, e.g., “Roosevelt's” in the “United States” article. https://britannica11.org/article/27-0635-united-states-the/u...
huijzer 6 hours ago|||
Really nice. Well done.

As a feature request, would it possible for your pipeline to also create an EPUB? Then people can easily access and search through the document even when your site would go down. EPUB by default uses compression so the file size might even not be too bad for the full encyclopedia.

nyc_pizzadev 15 hours ago|||
Very nice. I actually spent a bit of time browsing a few topics, which is something I rarely do these days!

A few things... when I click an article and try to jump to a new topic, the top search box (labeled "Search titles and full text...") doesn't work. Second, when I first came to the site, I was a bit stuck. It took a bit of time to realize I need to click on "Articles" or even "Topics" to start browsing. Not sure why, maybe I expected the image to let me enter the site somehow...?

ks2048 13 hours ago|||
Nice job. How about wikipedia-style links to other articles for topics mentioned within another article?
logicallee 18 hours ago|||
Thanks so much for sharing this. It looks fantastic. A couple of questions, if you don't mind: what license are you releasing this under, if any? Is there any way to download it? The reason someone might want to download it is for use as training data.
zozbot234 17 hours ago|||
Wikisource has the original scans available in the public domain, and their enriched text under CC-BY-SA: https://en.wikisource.org/wiki/EB1911
ahaspel 18 hours ago||||
Thanks!

The underlying text (1911 edition) is public domain, but the structured version here — the parsing, reconstruction, and linking — is something I put together for this site. Right now there isn’t a bulk download available. I’m considering exposing structured access (API or dataset) in some form, but haven’t decided exactly how that will work yet.

If you have a specific use case in mind (especially for training), I’d be interested to hear more.

hallole 17 hours ago|||
I've wanted to do something like this for The Encyclopédie, a hugely relevant text to the Enlightenment. If you ever get around to adding a rough "How I (generally) Made This" section, that'd be appreciated! Site looks great :)
logicallee 18 hours ago|||
Regarding the specific use case, I was thinking this: I had Gemma 4 (a small but highly capable offline model released by Google) make a public domain cc0 encyclopedia of some core science and technology concepts[1]. I thought it was pretty good.

Separately, I've fine-tuned the Gemma 4 model[2], it was very quick (just 90 seconds), so I think it could be interesting to train it to talk like 1911 Encyclopedia Britannica.

I would use the entries as training data and train it to talk in the same style. There isn't a specific use case for why, I just think it would be interesting. For example, I could see how it writes about modern concepts in the style of 1911 Britannica.

[1] https://stateofutopia.com/encyclopedia/

[2] To talk like a pirate! https://www.youtube.com/live/WuCxWJhrkIM

ahaspel 18 hours ago||
That’s a fun idea — I can see the appeal of that style.

The underlying text is public domain, but the structured version here is something I put together for the site. I haven’t released a bulk dataset yet.

If you end up experimenting with it, I’d love to hear how it turns out — and I’m still figuring out what structured access might look like.

realityfactchex 18 hours ago|||
> Is there any way to download it? The reason someone might want to download it is for use as training data.

Another reason would be to able to keep running/using it even if the main site were to go down for whatever reason eventually; or, to operate a mirror of it, for redundancy (linking back to the original, of course).

gnerd00 18 hours ago|||
legal terms question here also -- several major world economies are operating under very different rules regarding datasets and publication rights. I am in the USA / California.. will there be terms for me, given that I am not a giant deep-pockets FAANG, just a book person ? commercial use terms for "small business" scale ?
ahaspel 18 hours ago|||
The 1911 text itself is public domain, so anyone is free to use it.

What I’ve built here is a structured edition — the parsing, reconstruction, linking, indexing, etc. I haven’t published a formal license for that yet.

For casual or small-scale use there’s no issue at all. For bulk use (e.g. dataset / training / redistribution), I’d prefer people get in touch so I can figure out a sensible way to support that.

Kerrick 9 hours ago||
> What I’ve built here is a structured edition — the parsing, reconstruction, linking, indexing, etc. I haven’t published a formal license for that yet.

If you live in the U.S. I recommend you read No Sweat of the Brow Copyright: https://www.gutenberg.org/help/no_sweat_copyright.html

dessimus 15 hours ago||||
It's been on Project Gutenburg for over 20 years: https://www.gutenberg.org/ebooks/13600

They only release books that are in the public domain.

bentley 2 hours ago||
> They only release books that are in the public domain.

Not necessarily. Project Gutenberg does provide some works still under US copyright, such as F. P. Walter’s 1999 translation of Twenty Thousand Leagues Under the Seas: https://gutenberg.org/ebooks/2488

TremendousJudge 18 hours ago|||
I guess such an old edition is in the public domain
Soluod 15 hours ago||
[dead]
neonscribe 18 hours ago||
You can discover beliefs that are shocking today, such as this excerpt from the article "Adolescence":

"In the case of girls, let them run, leap and climb with their brothers for the first twelve years or so of life. But as puberty approaches, with all the change, stress and strain dependent thereon, their lives should be appropriately modified. Rest should be enforced during the menstrual periods of these earlier years, and milder, more graduated exercise taken at other times. In the same way all mental strain should be diminished. Instead of pressure being put on a girl’s intellectual education at about this time, as is too often the case, the time devoted to school and books should be diminished. Education should be on broader, more fundamental lines, and much time should be passed in the open air."

ahaspel 17 hours ago||
No doubt. That’s one of the reasons I find the 1911 edition interesting — the authors have more license to express their own opinions, which naturally reflect those current at the time.
genghisjahn 16 hours ago||
"Not, of course, that there is any magic about the past. People were no cleverer then than they are now; they made as many mistakes as we. But not the same mistakes. They will not flatter us in the errors we are already committing; and their own errors, being now open and palpable, will not endanger us."

On Reading Old Books C. S. Lewis

https://bradleyggreen.com/attachments/article/97/Lewis.On-Re...

yieldcrv 16 hours ago|||
It’s only shocking to write it, or declare it as sacrosanct

Many people practice it, and women’s movements that put most energy on doing the opposite have since dialed back to pointing out that they were fighting for choice, including that choice of not being in a workforce. An option of a “soft life” that is wildly popular, and timeless. People just needed a new way to say it.

If it was culturally supported for men to be subsidized by another, a large percentage of men would immediately take that graduated and intellectually diminished role too. This is not a reliable option and is rare.

If common, it would unironically solve representation imbalances in other fields, since it would no longer be about shoehorning women into them, because enough men would leave on their own. A level of enlightenment still missing from Women in <field> fireside chats at every industry conference worldwide

zozbot234 17 hours ago||
You can nowadays paste the text from pretty much anything that's in the public domain into a near-SOTA LLM such as Kimi or GLM and it will give you a pretty nice summary of what it's about in modern language (Extremely useful: the LLM tendency to go overboard on formatting nicely balances out the wall-of-text format from historical publications, which was aimed at saving paper and minimizing manual layout effort), and then gladly tell you about all the things in the historical text that would be absolutely beyond the pale today. (Sometimes you have to nudge it by prompting "How would this text be received today?" or something like it after it has put its nice summary in context, but once you do that it tends to be quite thorough.)
doubletwoyou 17 hours ago|||
I beg of thee, use that brain of yours and read a text that was made scarcely more than a century ago, a blink of an eye in the grand scale of the changes of the linguistic features of English, and interpret it for yourself.
mapontosevenths 15 hours ago||
I'm in favor of using all the tools available to better yourself, including LLM's. However, for things like this the I would argue that one should first try to understand it on their own.

Sometimes the work is the POINT. We read things like this not just to learn about the past, but for novelty and to exercise our critical thinking powers. To outsource that labor before even trying is like going to the gym and having your butler lift the weights. The weights got lifted, but what was really accomplished?

zozbot234 15 hours ago||
Historically, these texts were often consumed (especially in formal or semi-formal settings) by either having them read aloud for you or reading them aloud yourself. They were more like a written-down formal speech to be slowly pondered upon than something to be read smoothly and silently on one's own, which is how we now regard almost all texts. There was "labor" involved but that labor was not really about being more literate or exercising more critical thinking: it was simply about slowly recreating in one's mind the kind of broad structural scaffold we now expect to see in a text as a matter of course. It's in fact easier to think critically about a text when its sections and structure are clearly laid out, and having a LLM do this for you is a nice way of avoiding personal tendencies and biases that might lead one to misinterpret what the text is really about.
simonklitj 14 hours ago||
Yes, let the LLM bias and misinterpret it instead.
stereolambda 5 hours ago||||
Entertaining to think that "that's too difficult to read for us nowadays" and "look at these unacceptable things" already sound pretty much like some poor Medieval literates who got their hands on Ovid or Lucretius, while under the rule of king Theodoric or something.

I don't have to say I don't question that we are very civilized and powerful.

quamserena 17 hours ago||||
You can also read the text yourself and draw your own conclusions...
BigTTYGothGF 16 hours ago||||
How is that not "modern language"?
smallerize 17 hours ago|||
You didn't really explain what that does for you. Why do you paste it into an LLM?
zozbot234 16 hours ago||
I'm not sure if you're familiar with public domain texts from around the 19th or early 20th century, but they were not intended to be skimmed or speed-read the way we'd skim a modern text prior to getting into a more attentive close-reading. Even their short magazine articles were actually the near-equivalent to our scholarly papers, and were often read aloud at length in parlor gatherings. So having a LLM split the text into manageable sections for you and provide a hint of what each lengthy wall-of-text paragraph will be about is actually a huge gain in readability.
smallerize 16 hours ago|||
Oh well that was the whole point to me. If I wanted to read something that's not from 1911 I could just do that lol
Dylan16807 3 hours ago||||
So before you were talking about summarizing whole articles and asking the LLM to find the things that would be "beyond the pale", but now you're just suggesting using it to insert paragraph breaks and section headings?
zozbot234 41 minutes ago||
The LLM will easily do both for you. Particularly the thinking it does when constructing the summary generally involves a structured close reading of your text, and you can easily think of it as providing "paragraph breaks and section headings".
BigTTYGothGF 15 hours ago||||
The trick is to have a basic level of literacy and then you don't need the machine to chew it up for you like a mother bird.
keane 16 hours ago||||
Mostly from a bit further back but you might enjoy https://earlymoderntexts.com/texts
qmr 12 hours ago|||
> So having a LLM split the text into manageable sections for you and provide a hint of what each lengthy wall-of-text paragraph will be about is actually a huge gain in readability.

Perhaps your attention span needs improvement.

spudlyo 17 hours ago||
I'm curious how the information is structured under the hood. I just recently learned about how folks in the digital humanities use the XML-TEI format for semantic markup of works like this. I've recently been exploring the Latin-English Lewis & Short dictionary encoded in XML-TEI.

I've had a ton of fun playing learning about BaseX and XQuery to ask questions like "Which classical authors are responsible for writing words that appear only once in the entire corpus (hapax legomena)" or "what are longest hapax words" (usually the funniest ones) and that kind of thing. Shout out to Tufts University for making this available!

I would love to be able to load the 1911 Britannica into BaseX and and see what interesting things I could learn about it via XQuery!

ahaspel 17 hours ago|
Under the hood it’s not XML-TEI — it’s a relational/data-pipeline approach, with article boundaries, sections, contributors, cross-references, and source-page provenance all reconstructed into structured records. The text itself is public domain, but I haven’t released a bulk structured export yet.

People asking for dataset access has definitely been one of the themes of this thread. I’m taking that seriously. If I do expose it, I’d want to do it in a form that preserves the structure and doesn't just dump plain text.

shantara 18 hours ago||
Interesting how different both the tone and the structure of the articles are compared to the modern texts.

Take the article about Copenhagen as an example: https://britannica11.org/article/07-0111-copenhagen/copenhag... The geography and key points of interest are described very accurately, but the authors aren’t shy about inserting emotionally charged adjectives and personal options on what they consider interesting or curious. Also, the huge portion about the Battle of Copenhagen in the bottom is a complete departure and shifts the genre from a geographical description to the shot-per-shot narration of a naval battle.

ahaspel 18 hours ago||
Yes, that’s one of the things I like most about it. The articles have a personal tone and are less homogenized.

You get that mix of geography, history, and sometimes quite opinionated description all in one place, which makes them much more readable, in my view. My introduction to this version discusses this and other related matters: https://britannica11.org/about.html

krige 5 hours ago||
Looking at Victor Hugo's entry I immediately spotted this

> After yet another three years’ space the author of La Légende des siècles reappeared as the author of Les Misérables, the greatest epic and dramatic work of fiction ever created or conceived: the epic of a soul transfigured and redeemed, purified by heroism and glorified through suffering; the tragedy and the comedy of life at its darkest and its brightest, of humanity at its best and at its worst.

Sure sounds like someone was a (fellow) fan.

bentley 2 hours ago||
The first article I looked up was New Mexico, because I knew, as does anyone familiar with New Mexico history, that it became a state in January 1912 (before which it was a territory). Arizona also became a state, in February. I was surprised to find both described as states of the United States in this 1911 encyclopedia. I suppose the editors just made a confident guess? The last sentence of both articles is, “In June 1910 the President approved an enabling act providing for the admission of Arizona and New Mexico as separate states.”
robin_reala 18 hours ago||
A seriously trivial bug report, but the font you’ve chosen doesn’t support ℔, making articles like https://britannica11.org/article/22-0688-s2/putting_the_shot look odd. Potentially might be worth rewriting ℔ to a more normal (these days) lb?
ahaspel 18 hours ago|
Good catch — thanks. That’s a font coverage issue. I’ll either swap in a fallback font for missing glyphs or normalize those cases. This only sounds trivial, this project is full of items like that.
rustyhancock 18 hours ago||
I spent ages trying to work out if it would be possible to find a copy of the 2021 Encarta or Britannica.

Pre LLM And post COVID and perhaps the best we can hope for before AI taints all the info.

One of my prized possessions as a child was a CDROM based encyclopedia (well before the internet was common). I don't know why I liked it so much but on a rainy afternoon I'd kick up some of my favourite articles and read and learn more of them.

tezza 18 hours ago||
2004: https://archive.org/details/britannica-2004

2009: https://archive.org/details/britannica-multimedia-dvd-2009-d...

2012: https://archive.org/details/britannica-dvd_20230709

2013: https://archive.org/details/encyclopedia-britannica-dvd-2013

ahaspel 18 hours ago|||
I know exactly what you mean — I had the same experience with CD-ROM encyclopedias. There’s something about just browsing and falling into articles that’s hard to replicate.

Part of the motivation here was to bring that kind of exploration back, but with the original 1911 text and structure.

pawsocks 18 hours ago||
Do you happen to use a language model to translate or format your comments?
ahaspel 17 hours ago||
Just me. I spent a lot of time thinking about this, so I like talking about it.
hoppyhoppy2 16 hours ago||
The final release of Encarta was in 2009.
doctor_blood 17 hours ago||
Small world - I'm currently cleaning up scans of the EB 9th edition to put it online as a mediawiki site; I'm including all the illustrations and plates so I'm only a third of the way through.

I've been testing different OCR tools and so far I've been the most impressed with paddleOCR - it correctly split the text columns, labled the illustrations, and noted the maragin text.

Still, it's not perfect, so I'm having to hand-edit some tables. I plan to put the source pages online as well so you can switch between the scanned page and the electronic text.

doctor_blood 16 hours ago||
For those unfamiliar, the 1875 9th ed. was known as the scholar's edition due to how many eminent persons had contributed; it's a fascinating snapshot of the late 1800s.

Other material that would be fun to put online in a hyperlinked and indexed format include geographic and medical atlases and the Baedeker travel guides.

ahaspel 16 hours ago||
I'm looking forward to it. The 9th is great in its own right and a lot of it is in the 11th. Alfred Newton's nearly 200 articles on bird species and a few classic essays by Macaulay come to mind offhand.
entrepy123 18 hours ago|
Bravo. People who like the 1911 Encyclopedia Britannica might like https://OldEncyc.com to dig into the volumes (by letter range) of 22 editions of old encyclopedias dated 1728-1926 (though not searchable like the OP).
ahaspel 18 hours ago|
I hadn’t seen that before, it’s a great collection. I like the breadth across editions.
More comments...