Top
Best
New

Posted by verditelabs 3 hours ago

A Herculaneum scroll has been read for the first time(scrollprize.org)
319 points | 86 comments
proee 22 minutes ago|
Only about 20% of the Herculaneum site has been excavated, so there is high probability that more scrolls exist. The current scrolls were not part of the main library, but more of a private collection at the time.

So imagine how cool it would be to find a full library with thousand of scrolls across many different topics, that can now be read with this technology.

bambax 1 minute ago|
This could eventually completely transform our understanding of Antiquity. It is estimated that only around 1% of the ancient works in Greek and Latin have survived to the present day, much less in other languages such as Punic [0]. Some works and some authors we only know by name because they were alluded to in later texts.

It's also well known that surviving texts survived because they were copied again and again on costly animal skin during the Middle Ages, by monks who had to make a choice and naturally favored topics that were of most interest to them.

This could quite literally change everything.

[0] https://talesoftimesforgotten.com/2021/09/25/are-there-more-...

verditelabs 3 hours ago||
I am on the vesuvius challenge team that did the segmentation, unwrapping, and ink detection, so feel free to ask any questions.
2ap 1 minute ago||
I'm interested to know about the approaches that you tried with the ML, and then decided to not use. In practice, the options are so many. How did you come up with the final approach - and was there a systematic way to decide which options to go for?
Dzugaru 1 hour ago|||
Outstanding work! I've participated in the challenge, but didn't get far. One of the questions I had at the time was - if I'm going to use ML to detect ink, could it invent hallucinated letters, or even parts of text, and how to prevent that?
verditelabs 59 minutes ago|||
Yes, it's quite possible for ML to hallucinate ink, though it is on a much more local scale, like predicting a slightly longer stroke, filling in more of a character than is actually in the data, etc. Perhaps enough to change a reading of a character or show where ink isnt. It is difficult for ink detection to hallucinate grammatical and idiomatic greek and latin.
im3w1l 51 minutes ago||
What is the input to the ML algorithm? Does it know the surrounding context so that it has a chance to deduce "if this stroke is slightly longer then the end result will be idiomatic greek and latin"?
verditelabs 46 minutes ago||
The input is 3d chunks of reconstructed CT data from our scans. I can't remember the specifics but maybe enough voxels for .5mm^3 at a time or so? They're all available for free from https://registry.opendata.aws/vesuvius-challenge-herculaneum... . Our trained models are all available at https://huggingface.co/scrollprize
cwnyth 40 minutes ago|||
Not all machine learning is generative AI.
mc32 38 minutes ago||
True but like regular document scanning software there can be errors in detection.
dleeftink 20 minutes ago||
Just as with redacted documents (consistently blocked terms) or bad OCR jobs (wrong or missing characters), even if only a certain percentage comes out unmangled it is more readable than having no data at all.

A stable base corpus and some dynamic programming will allow you to clean up the remainder[0].

[0]: http://stackoverflow.com/a/11642687/2449774

tomcam 23 minutes ago|||
Absolutely incredible work. This is one of the most amazing news articles I’ve encountered in decades. Congratulations team!
adriand 1 hour ago|||
What are the wildest, most exciting but plausible things that might be discovered in these documents?
verditelabs 1 hour ago|||
I am not a papyrologist or a classicist, rather I'm a computer scientist, so my expertise is unfortunately not in _what_ the scrolls say, rather how we get there. That being said I think and hope that there will be a trove of things that has no known provenance at all, completely lost works that elude the public memory.
arikrahman 23 minutes ago|||
Well what were your first thoughts when you decoded the script, besides the obvious Eureka, after making some sense of the texts?
readthenotes1 4 minutes ago|||
Your response reminds me of Nigel Richards :)

https://en.wikipedia.org/wiki/Nigel_Richards

Congratulations, and thank-you!

suddenlybananas 1 hour ago||||
Probably a lot more texts of Epicurean philosophy and not a whole lot else unfortunately according to my papyrologist friend.
Matticus_Rex 5 minutes ago|||
That's what was thought, but maybe not -- only one of the three so far looks Epicurean, which is not what was expected. Maybe it's a fluke, but historians are buzzing a bit about whether it might be broader than expected.
cwmoore 53 minutes ago|||
Why would Epicurean philosophy be unfortunate?

I was under the impression that there was almost nothing left of that school of thought, and that it’s writings had been destroyed.

What would you like to have instead?

cwnyth 39 minutes ago||
The unfortunate part is the lack of anything else therein, not that it's Epicurean philosophy.
ogogmad 3 minutes ago||
The Jewish Talmud uses Epicurus's name as a term for "heretic".
colechristensen 57 minutes ago|||
Here's a list. The scrolls are from a library that burned in 79 AD.

https://en.wikipedia.org/wiki/List_of_lost_literary_works

kouru225 25 minutes ago||
Woah there was a lost Homer epic comedy about a bumbling fool named Margites?
BiraIgnacio 35 minutes ago|||
Amazing work, fantastic!
tsol 1 hour ago|||
How do get to do that? As in what did you study to get the prerequisite knowledge, and how did you find this particular job? When I see interesting jobs I'm anyways curious what path lead there
verditelabs 1 hour ago||
I am a computer scientist. I studied CS in university, worked in the semiconductor industry for a while, got started as a participant in the challenge aspect of the Vesuivus Challenge. They were hiring, I sent in an application, interviewed, and was offered the job.
matneyx 13 minutes ago||
That last sentence is so perfect, like my dad answering the question of how he lost weight. "I ate less and exercised more."
TheOtherHobbes 1 hour ago|||
No questions, but I just want to say this is really exciting work!
helterskelter 1 hour ago|||
Given the current rate of progress, how long do you think it will take to decipher the entire collection?
verditelabs 1 hour ago||
That's a tough one to give a strong estimate of. Some scrolls are easier or harder to unwrap and read for a multitude of different reasons, mostly due to how damaged the scroll was in the eruption, and how easy or not the ink is to read. IIRC from what we've scanned of the herculaneum collection, none of the ink is easily visible via spectrum alone, so we have to use a lot of ML and physically based rendering techniques to be able to find ink. That also requires unwrapping and segmentation _before_ any ink detection.

For iron gall ink with high enough iron concentration, the ink stands out in the xray volume through simply masking off low values, such as was shown in our campfire scroll experiment a few years ago. No herculaneum scrolls show similar ink.

pimlottc 1 hour ago|||
Do you think this particular scroll is easier or harder to read that the others will be? Or about average?
verditelabs 58 minutes ago||
Pherc1667 was quite small and just so happened to have readable ink, so it was easier than I expect most others to be.
superjan 52 minutes ago||||
Do we known what ink is used?
verditelabs 38 minutes ago||
Most of the evidence so far points towards carbon based ink. I am not sure if any of the scrolls we have scanned show strong evidence of iron gall based ink. I know that there are different types and preparation methods for different carbon based inks, but I do not know if it is possible to determine which kind(s) were used solely from inspecting the xrays.

I am, though, not a papyrologist, so historical ink making, preparation, and usage are not my field.

helterskelter 1 hour ago|||
Thanks!
temp987 20 minutes ago|||
this is überragend. by many means!
echelon 1 hour ago|||
Did anyone on the team come from a non-science, non-math, non-academia background? Did anyone working on this just teach themselves and start contributing?
verditelabs 1 hour ago||
Yes. Sean, who was a co-winner of the 2024 prize, IIRC has no formal background in ML, computer science, AI, etc. He is one of our core researchers and the most productive team member.
fintechjock 1 hour ago||
I've been on the Discord for a couple of years now, and poking around with submissions as well. Sean and the entire team deserve so much praise for all of this work.

It's easy to just read about the breakthrough and see it as one neat, linear line to get there, and hard to comprehend the hours, months and years that so many spent to get there. Big congrats to you, Sean, Nat and the entire team!

jimbob45 1 hour ago|||
Are the fragments destroyed in ‘69 and ‘80 available to be read similarly? Or were they disposed of?
verditelabs 1 hour ago||
I am unaware of those fragments in particular. Though we have scanned a dozen or so fragments, mostly to help guide ink detection, since the ink in them is often more visible in visible and/or near IR light, but can be hard to impossible to detect in the xray spectrum.
inglor_cz 1 hour ago||
I don't have any questions, just a comment.

You have a potential to rewrite the history of European Antiquity quite substantially. The Herculaneum set of scrolls is enormous and must contain a lot of hitherto unknown.

That comes with a set of peculiar risks. Once your work starts producing something that contradicts previous work of Very Important People, they will lobby to stop you. Be prepared for that.

Science should be neutral and always value new evidence. Scientists as humans are unfortunately subject to all sorts of passions.

mattbettinson 44 minutes ago||
I wonder what the parellel would be 2,000 years for now:

A Post-Great Solar Flare of 2484 Step Brothers DVD Has Been Decoded

Waterluvian 12 minutes ago||
We have successfully uncorrupted audiovisual media of what we believe to be an oral retelling of the long lost ending to Chekhov‘s “The Three Sisters.” It turns out the light was on.
clickety_clack 1 hour ago||
When I read translations like these, I always wonder if the tone is translated. Did the writer mean to convey a very formal “to the utmost”, or was it a more casual “to the max”.

How much of the translators bias makes these seem like academic papers instead of social media posts.

adrian_b 56 minutes ago||
Any useful translation of an ancient text is accompanied by the text in the original language, so that the reader may assess how faithful is the translation.

For anyone who wants to read ancient texts, there are bilingual editions, for example those of the "Loeb library".

The translations that omit the original text are just for the people who want to have some idea about the content, but do not care about the correctness of the translation.

With a bilingual edition, it is easy to understand the original text even with relatively little knowledge about the original language.

The original text is important because frequently the translator is forced to introduce inaccuracies in the translation, because of the absence of exact equivalents in the target language, which would require a long explanation of the original meaning, instead of just a translated sentence.

Especially misleading are translations where several distinct ancient words are translated using the same English word, so some nuances are lost.

Equally confusing are the cases when the translator chooses to translate the same ancient word by different English words, because even if the meaning of a word may depend on the context, many translators fail to judge correctly the context, because they may lack specialized knowledge so their guesses are not necessarily better than of the readers who may be less competent in linguistics, but more competent in the science or technology needed to understand the context. Better translators prefer to use a one-to-one mapping between words, which makes it easier for the readers to discover the meaning intended by the ancient writer, after seeing multiple examples of usage.

forshaper 1 hour ago|||
This is why I like literal translations & etymological dives, paired with asking what activities would constitute a life in that time. Ie, you may not need to be a competent archer, but it is a little easier to understand someone who used a particular style of bow if you can play around with that type of bow for a bit.
bibimsz 3 minutes ago|||
let's translate the ancient classic poem Mugger's Paradise by the poet Somewhat Frosty:

While I step through the valley of the shadow of death,

I contemplate my life and perceive that nothing remains.

For I have hurled weapons and laughed for so long that

Even to my mother, my mind appears to have departed.

Yet I have deceived no one except him who was worthy of it;

For me to be held as a coward—that indeed is unheard of.

Beware what you speak and where you set out,

Lest you and your companions be outlined in chalk.

colechristensen 1 hour ago|||
Sometimes there is very little to go on, but we really do have a lot to work with from the late republic and early roman empire.

Latin is also a very rich language and this is no snippet.

Translation is always hard, especially from a couple thousand years ago BUT this kind of translation comes with a lot of confidence.

hyhatqtv 19 minutes ago||
It’s in Greek, though. Of course same points apply
charcircuit 31 minutes ago|||
After sticking it into CharGPT I can tell you it's neither. The word upmost is coming from is a form of the compound verb ἐκπονέω.

* ἐκ- = “out,” “thoroughly,” “to the end”

* πονέω = “to labor,” “to toil,” “to work hard”

kridsdale3 22 minutes ago||
I trust a lifelong dedicated Ancient Greek Papyrologist to do a better job here than ChatGPT.
devindotcom 58 minutes ago|||
[dead]
dylan604 1 hour ago||
Sending a tweet is free and takes zero thought to make it (as the vast majority of tweets prove). Writing something on a scroll would take a lot of effort and would not be free. If these were tweet level content in the scrolls, I'd have to totally reevaluate a lot of things to the point I might as well just become MAGA
kilroy123 1 hour ago||
For me, this is one of the most exciting things being done with AI right now. (This and medical research)

I'm kind of obsessed with the ancient world. I dream of being able to read entire pages of new text from ~2,000 years ago.

lanthissa 52 minutes ago||
The person who wrote this was was closer in time to the technology that was able to unwind and read burned fragments of their text, than the technology that build the pyramids. pretty wild to think about.
sevenzero 51 minutes ago|
>technology that build the pyramids

You mean ropes and carts?

inglor_cz 36 minutes ago||
The stones were cut with enormous precision, at least relative to what we know about the available cutting tools. You cannot still stick a knife between a lot of these stones. Maybe we will learn more about that.
vitally3643 5 minutes ago||
I'm pretty sure we've conclusively answered these questions. Hand tools, skill, and absolutely unreasonable amounts of time and patience.

Any master stoneworker from any era should be able to carve stone to that level of precision given enough time and reason. The problem, as always, is that there is usually very little reason to put in that amount of time and effort when you can get 90% as good for 50% the effort.

hasteg 8 minutes ago||
So far this is some of the best uses of ML I've seen to date! This is one of the few things you can point at and say "AI made the world a better place" IMO (this and medical research).
9dev 1 hour ago||
Every time you feel depressed by the state of tech, and how so many intelligent people seem to work on forcing ever more ads down people's throats (a common trope around these parts), remember that projects like this do exist too!

There are lots of very smart folks working on incredible things, they just aren't as loud.

giancarlostoro 1 hour ago|
This isnt the only incredible thing though, AI is being used to make discoveries in the medial field, and even to prevent sepsis related deaths, cutting down on them by detecting sepsis sooner. There was another that discovered the gene for Alzheimers is what activates it not just a sign of it.
verditelabs 33 minutes ago||
There is a large overlap in what we are doing with the medical field as well. A lot of the segmentation methodology and technology we use and adapt originally came out of the medical field for doing things like brain imaging.
_verandaguy 1 hour ago||
I imagine it's not the first time, It must've at least been proofread at the time of writing :)

But really impressive stuff! Between this and (a particularly optimistic outlook on) the Linear-A news from the other week this is an exciting time for linguistics.

cortesoft 8 minutes ago|
This is so cool. I feel like it is almost a victory against entropy!
More comments...