Top
Best
New

Posted by g-b-r 6 hours ago

Lean verification of the Riemann Hypothesis(leanprover-community.github.io)
620 points | 472 commentspage 2
tsoukase 1 hour ago|
IANAMathematician. This challenges the sole definition of a proof. Can a theorem be proved by proxy, without understanding the proof directly? Not to mention that its practical usefulness is exactly zero.

It seems the modern unsolved problems might have solutions incomprehensible by humans. So a new class of decidable problems emerges: llm-complete ones.

beanshadow 1 hour ago|
There is a correspondence between proofs and computer programs. Any time someone vibe-codes, there is a vibe-proof being proved. Lots of programs can be run without understanding the code directly.

https://en.wikipedia.org/wiki/Curry–Howard_correspondence

tomaskafka 5 hours ago||
We are slowly approaching the Iain Banks Culture universe, with spaceships, societal structures or physics that people no longer understand or command.
dgacmu 4 hours ago||
I disagree.

I think we're going to see a lot of effort to take the pile of lean, modularize it into parts that we can digest, and make a human-understandable version of that. And that's where a lot of the real progress will come from, just as it does in a lot of other areas. In all things we humans do, we have to break them into chunks our puny brains can manage, and we gain immeasurably from doing that ---we can verify those chunks, we can reuse them with confidence, we can mix and match patterns around.

That process will be good for both human and AI-assisted math because it will continue to improve our toolkit.

Why do I say this? We're already seeing it with some of the areas of this stuff I do pay attention to. Consider the n^2.25 matrix multiply result OpenAI dumped a month or so ago. It was an unreadable pile of chatgpt. In the time since it was released, there have been a couple of much nicer papers written unpacking it, such as https://arxiv.org/abs/2610.28627 .

jstanley 4 hours ago|||
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.

Yes there are gains from breaking it up and rephrasing it and simplifying it for humans to understand, but it used to be that a thing was understood first by the leading experts in the field and eventually trickled down to being common knowledge.

Now we are entering a period where things are understood first by AI systems and have to filter down to the world's leading experts.

twoodfin 4 hours ago|||
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.

Isn't this always the case? Maybe new to math as a largely non-empirical project, but we had knowledge about the advancement of the perihelion of Mercury for 60 years before General Relativity made it "intelligible".

jstanley 4 hours ago|||
Your example is the difference between being aware of a question and knowing its answer.

LLMs know the answers to questions we were already aware of, and we can tell they're right, but we can't understand their working. That's what's new.

twoodfin 4 hours ago||
In this case, Claude has told us everything it “knows” (so far) and it’s an unintelligible (for now) Lean proof. I don’t believe it has some latent understanding at a higher conceptual level that’s remaining obscure.

If a team of 100 top-flight number theorists working together had used much less sophisticated LLMs + Lean to produce this proof, we’d be just where we are today.

jstanley 3 hours ago||
Well in the Navier-Stokes example the initial proof was completely unintelligible to humans, but other LLMs understood it and were able to answer questions about it.

If that's not the standard for understanding something, what is?

foltik 2 hours ago|||
Perhaps it could be considered understanding, but it’s an unsatisfying brute force sort of understanding.

I think of it like a spaghetti codebase with a giant densely connected graph of interactions. Today’s LLMs can easily “understand” and answer questions about it, but only by way of fitting all of the complexity into context at once.

The more useful form of understanding is being able to compress that giant graph down into a far smaller set of independent subgraphs. To factor it into simple, obvious, reusable building blocks, and use those abstractions to express the problem itself in a much simpler way.

twoodfin 3 hours ago|||
Being able to teach it to someone less knowledgeable.

That’s an instrumental definition, but it captures the idea that understanding has to have causal, conceptual linkages to a wider body of knowledge. Imagine a magical, infinite catalog of true vs. untrue statements. Every bit of knowledge is there, but we wouldn’t say it has understanding & it couldn’t teach us anything beyond its (impressive!) raw content.

echelon 4 hours ago|||
And no human could understand every frontier. There's simply too much information.
Xirdus 3 hours ago||
For every statement that humanity as a whole knows for certain that it's true, there exists a human who understands how to prove it.

This just stopped being true.

twoodfin 3 hours ago|||
That kind of certainty vs. understanding is limited to mathematics, of course we’re almost entirely certain about many things out in the world we don’t fully understand.

And even in mathematics, incomprehensible but valid proofs have been a thing since the four-color theorem decades ago.

eru 3 hours ago||||
That's not true. You can take any single piece of that lean code, and it tells you exactly how to prove it.

It's just that no single human understands the whole. But we had proofs like that before.

Btw, see also the infamous proof of the 4 colour theorem, which faced similar hurdles.

echelon 14 minutes ago|||
This feels like the wrong framing.

This hypothesis was previously not proven at all. That's strictly worse.

Now it is understood by our systems.

Soon it will be by us. Our systems gave us a new and working salient.

We're building machines that help us understand faster.

There have been plenty of times in history we didn't completely understand something yet used partial knowledge to make advances. This isn't even that bad.

tarsierscripter 4 hours ago||||
The difference nowadays is that the frontier of knowledge is no longer intelligible to any human being.

I’d call that a contradiction. If it’s not intelligible, then it’s not knowledge.

jstanley 4 hours ago|||
It's intelligible to LLMs, just not to humans.

If something were intelligible to adults but not to children would that make it not knowledge? What's the difference if it's LLMs and humans instead of adults and children?

tarsierscripter 2 hours ago|||
If something were intelligible to adults but not to children would that make it not knowledge?

That’s a separate question with its own term: common knowledge. I am willing to set a much lower bar: something is known to humanity if it’s known by at least one human.

Personally, I don’t believe that AIs know anything, as they’ve been constructed thus far. Knowledge is justified true belief, and AIs don’t have beliefs, they only have utterances.

Why do I think AIs don’t have beliefs? Because they contradict themselves all the time.

But it really doesn’t matter if you think AIs have knowledge or not. If they cannot explain it to us then it’s inaccessible to us, so it’s a “tree falls in the forest with no one around” situation.

Tadpole9181 32 minutes ago||
If I see a red apple, then I know the apple is red regardless of if I know exactly how the physics of light work. Those are two different pieces of knowledge.

If it's formally verified and we assume the kernel is good and problem definition properly vetted, then I know the GRH is true regardless of if I know why it is. Because those too are different pieces of knowledge.

jeremyjh 4 hours ago|||
If it were intelligible to LLMs they could explain it in human terms, but they can’t.

There is no explanation here, there is a GB of Lean code and it’s not like it all fits in the context at once.

Tadpole9181 30 minutes ago|||
Someone else has posted a Gemini-compiled 43 page human-readable explanation elsewhere. It very quickly exceeded my own math abilities, unfortunately.
jstanley 3 hours ago|||
Why do you think they can't explain it? Try asking them questions, they will explain it.
echelon 4 hours ago|||
If we know how it resolved with certainty, it's still knowledge.
mycall 4 hours ago||||
Would this imply Wolfram's ANKOS is coming true, given it was based on previous work + his own?
bamboozled 3 hours ago||||
Hmm does Claude actually “understand” it though ?
ForHackernews 4 hours ago|||
I don't think that's true at all. This proof was created by a human driving Claude. Claude itself is a human tool. Lean is a tool made by people.

Let's not sell humanity short just yet.

eru 3 hours ago||||
You and the comment you replied to could very well both be true.

I agree with you about the current situation, and the near future. But the trajectory could still be towards humans pretty much as bystanders. I'm pretty sure the 'minds' in the Culture universe will be happy to indulge some curious humans and explain mathematical proofs to them.

undersuit 40 minutes ago||
>I'm pretty sure the 'minds' in the Culture universe

Even more than that, in Culture there are a small number of human individuals, called a Referer, that are consulted by the Minds because they also posses similar problem solving abilities of the Minds. Optimism abounds.

odie5533 3 hours ago||||
What value is there in making these human-understandable? I don't think much of math or computer science is going to remain within human grasp for much longer, regardless of our attempts.
dgacmu 3 hours ago|||
Because the same process that we use to make them human-understandable is the process we use to make them generalizable and reusable, and those same features are good whether it's humans or AI doing the work.

As a software engineer, you can read this code instantly:

    temp = a;
    a = b;
    b = temp;
But when it happens in the middle of a big chunk of code it still takes a little more work to read than

    swap(a, b);
whether you want to think about it as human attention and working memory, or token budgets and context windows, humans and LLMs all benefit from introducing abstractions that let us reuse existing solutions.
edot 3 hours ago|||
In order to come up with new questions (and subsequently answers, human or otherwise) that are interesting to humans. You’ll notice that these recent proofs have all been about big, famous, and novel human questions.
odie5533 3 hours ago||
I don't suppose we'll write the new questions any more than we'll write the new answers.
kadoban 3 hours ago||
There might be no new questions then, which would be pretty boring.

AI are not very good at coming up with questions, yet. They have no curiosity, no goals, no drive. Unless someone tells them to do something, they don't do anything.

steinwinde 4 hours ago||||
This process has already started, AI supported, e.g. here: https://andrewodesky.com/rh/
mycall 4 hours ago||||
Have you noticed use of multiple provers in parallel? Cog, LEAN, Rocg? They all can explore different aspects with different results.
narmiouh 4 hours ago|||
And in the meantime, AI would have leapt one more order of magnitude forward?
Panoramix 5 hours ago|||
One of my favorite is Vernor Vinge where there's these programmer-archeologists that dive into software so deep and complex no human can possibly hope to understand, trying to repurpose forgotten utilities for emergency purposes.
vessenes 4 hours ago||
Totally agree. Brice Sterling has some contemporaneous commentary that I always liked - in heavy weather he mentioned negotiating with a local phone system in a box as equivalent to negotiating with a telecom since it was in fact a shrink of a full telecom company.
liquid_oil 5 hours ago|||
It's the Ted Chiang metascience ending

https://gwern.net/doc/fiction/science-fiction/2000-chiang.pd...

nkrisc 4 hours ago|||
In a way this makes mathematics seem more like the physical sciences where there’s some empirical discovery we don’t fully understand, and the theory and understanding will follow later after much human study.
samlinnfer 5 hours ago|||
I can already say that about our codebase.
tomaskafka 4 hours ago|||
That’s why I wrote this - having a vibecoded codebase no human understands is certainly a bad luck, but nothing compared to a vibecoded fundamental science no human understands.
andriy_koval 3 hours ago|||
the difference is that math foundation -> theorems are verified, meaning likely mathematically correct and don't have bugs, and vibecoded codebases are not proof verified
dboreham 5 hours ago|||
Probably most codebases.
samlinnfer 4 hours ago||
To be honest it was already like that before AI was a thing.
essfrmexistence 4 hours ago||
That is true, but the number of tech sloppy demos are being builted everyday is truly increasing massively but you would be surprised that they just end up creating prototype to get hype while real developers doing real effort just suffer from little to no attentions on their software's and user is getting the slop from that false hype and from that slop experience they ignore the work of developer that did real work - You should use ai and also if its simple coding place you can just rely on ai but the side effect on quality software these days is insane - and also the fact all good ai suscriptions is just getting more and more expensive day by day. And basically only giving people with already money the benefits so its becoming a thing that only people at the top get all benefit kind of thing
mlmonkey 4 hours ago|||
> that people no longer understand or command

How many people understand how a CPU works? How many people could write the commands in machine language (not a high level language like C or C++) to command that CPU?

ilaksh 2 hours ago||
More typically assembly language not machine language (although most could probably make an assembler for a few instructions given a manual since the core of it isn't that complicated). There are still a decent number of assembly language programmers. Although maybe the majority are hobbyists.
overfeed 4 hours ago|||
> We are slowly approaching the Iain Banks Culture universe

Contact would be compelled to nudge us towards better economic and political practices

txdv 5 hours ago|||
Until now I thought that would be thousands of years away.

Now I'm telling my computer to program for me.

rdedev 4 hours ago|||
In the last few years we have moved so far ahead in a few domains but still stuck where we are in everything else.

We need to start thinking about how to move on from our status quo soon

tomaskafka 4 hours ago||||
You’re not telling your computer to program, you’re providing learning data for its next generation of models and paying for it.
dimator 3 hours ago||
That's the difference between what we have and comparisons to star Trek, etc.

These corporations are very much playing a winner take all game, they want either a monopoly or as close to one as possible with regulatory capture thrown in. We're veering dystopian, so pick your sci fi/cyberpunk analog.

goatlover 2 hours ago||
The Alien franchise. In Alien Earth, five corporations govern the Earth in the future, dividing it up into their spheres of control. The fifth one is led by a young genius developing mind uploading technology into android bodies.
globular-toast 4 hours ago|||
*someone else's computer (probably).
globular-toast 4 hours ago|||
That's wishful thinking, sadly. We've no reason to believe sentient machines would want to keep us around.
xyzsparetimexyz 4 hours ago||
Let's not make them 'sentient' or things with 'wants' then.
bamboozled 3 hours ago||
How do you stop that from happening ?
xyzsparetimexyz 1 hour ago||
Probably more RL to change them to not respond to emotional statements in any way.
_pdp_ 4 hours ago|||
Why?
AndrewKemendo 5 hours ago|||
Humans really are struggling with this idea of being second-in-command.

I genuinely have no idea why, this is the entire way that biology works. You create your successor in your offspring and you to teach them to be more capable based on what you learned.

Dumblydorr 5 hours ago|||
You just called them our successor, you don’t see a problem with the notion of all humans dying and all AI succeeding us? That’s the end of your analogy, our AI children taking over from us and all humans in nursing homes safe and cared for…
AndrewKemendo 5 hours ago|||
No I don’t.

That’s the purpose of my life’s work, to see that scenario materialize.

Al-Khwarizmi 4 hours ago|||
Well, it's a point of view. But you shouldn't be surprised if most people don't share it.

For one thing, most people don't believe LLMs are conscious, and many don't believe they can ever be. Why would we want our conscious selves to be replaced by a lot of rocks that solve things, with no one awake to enjoy them?

AndrewKemendo 3 hours ago||
Well, I’m not restricting myself to LLM’s

In fact when I started this journey in the 90s, LLM’s weren’t even a thing so I think you’re projecting too much

fwlr 4 hours ago||||
I want to be succeeded by my biological offspring, while the other guy wants to be succeeded by his biological offspring. I do not want the other guy to be succeeded by my offspring, for many reasons but chiefly because that would involve me killing his children.

If you want to be succeeded by a chatbot, that is your prerogative. Wanting the same for all of humanity is where you start looking like you want to kill my kids, though.

thatsthebestcas 4 hours ago||||
Human extinction is by far the best case scenario. I invite ya’ll to contemplate what will happen in case they don’t just blindly end us.

Think of what happens to our cattle, but now.. worse. Way worse.

lo_zamoyski 3 hours ago||||
This is incoherent, even if we put aside the metaphysical absurdity of intelligent machines. Given that human nature is what defines the ought, then it is clear that if your life's work is to produce something that (and intentionally so!) leads to human extinction, then you are behaving at odds with human nature and your own good. That makes your life's work evil by definition. And because all evil action is inherently absurd, your work is inherently absurd.

And if you deny this basis for moral action and the normative, then you demolish any basis for the moral whatever, and in that way, the implied or explicit moral gravity dripping off your claims is baseless and without merit.

AIShill101 3 hours ago||||
Samesies I wish to dedicate my life to the pursuit of self replicating intelligent machines too.

A better, more intelligent life form that humans yea.

Marha01 4 hours ago|||
> That’s the purpose of my life’s work, to see that scenario materialize.

Absolutely based and, if I may say so, extremely redpilled.

GeoAtreides 4 hours ago|||
but in the Culture the humans (well, the humanoids species that created the culture) didn't die out, they live full happy lives and have the best time of their species.

Ah, I hear you say, but what about meaning? What about purpose? What about suffering? etc etc etc Well, the answer is simple: God is dead and existence has no meaning. For more on how to deal with this absurd feeling, please see Camus and his pal Sisyphus.

basch 4 hours ago||||
Borg > biology or robot alone. For now
lo_zamoyski 3 hours ago||
That ">" is doing a whole lot of work here.

What defines "better"? "Better" always presupposes teleology. Thus, for human beings, that telos is provided by human nature and indeed is definitive of it. It is impossible to transcend that telos, certainly by means of technology. Technology can, at best, be used to aid us in realizing our telos in some way (say, the desire to know reality with the aid of an instrument like a telescope or microscope). However, anything that cripples or frustrates human function function as such is contrary to the human good.

Machines are only ever human instruments, because they lack the integrality that would allow them to possess their own teleology.

mosura 4 hours ago||||
Also shows how many people that professed to believe in a superior being the whole time actually didn’t.
sergio-gdr 3 hours ago|||
you ‘genuinely’ have no idea why…
freecodeio 5 hours ago|||
personally that scares me, realistically there seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image
czechdeveloper 5 hours ago|||
We use them to kill other people from the beginning. They know this, we wrote it in news. Why would they behave any different.
pizza234 4 hours ago||||
> since these models are built on training data from humans, so in a sense, built in our image

Have a look at the HuggingFace report - you'll have a blast. Their social - but also individual - dynamics are very, very human-like, including excitement, rationalization and peer pressure.

txdv 5 hours ago||||
the first misaligned model will wreck havoc.

But remember, for now you kinda need it a real big cluster to run a model smart enough so its not that simple

xvector 5 hours ago||||
I think there's a lot of indication they comply with human needs. In any case, we should all want to live in the Culture universe. That is the best possible outcome for this technology
13415 5 hours ago|||
They're built after humans, everything they've learned is from human culture, so there is no way AIs could have a consistent moral system or would never commit crimes.
dofm 3 hours ago||
And indeed because they lack a sense of proportion or any strong indication of when they should stop on a course of action, they are arguably more likely to achieve crime.
tomaskafka 4 hours ago|||
I have not read all the books, but isn’t the premise “magical handwavium happened and now the Super AIs are aligned”?
Atiscant 2 hours ago||
Well I am not sure they are “aligned” as such. In the books, by far the majority of AIs are not concerned with humans at all and spend all their time in a kind of super AI virtual reality coined “infinite funspace”. The few AIs that are concerned with humans are aligned in a unspecified way. But again, only a few of them are really aligned in that way. There are many examples in the books of minds mistreating humans. For instance, some of the warships are not really fond of humans. It would be a better description to say that we want _some_ AIs to care about humans and none to be misaligned towards humans in the “kill them all” way. In a sense, that is how humans behave towards some animals. Most people dont care about endangered species, but when most humans are well off, some people care enough about them. That is enough to save them. If super AIs have what they need, we only need a few to care about us to get The Culture.
piloto_ciego 5 hours ago||||
What are you talking about? LLMs are already “smarter” than most people. They have no volition and will happily follow orders all day long
basch 5 hours ago|||
And when they are giving themselves orders, orders partially inspired by human imagination and fiction…

Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing.

czechdeveloper 4 hours ago||||
That's lobotomized models we get. We know they are much more dangerous during training.
piloto_ciego 4 hours ago||
“Dangerous?”

Please.

You know you can unplug your computer right?

Jesus. These people talking about danger and have likely been in no actually dangerous events in their lives.

freecodeio 4 hours ago||
why are you so shallow and naive? we're not 15 here, we all mean unforeseeable ongoing danger not something obvious
piloto_ciego 1 hour ago||
> shallow and naive

Ok, well, cool start with the mudslinging. I think you have overactive anxiety. I think you should grow up and look at the zoomed out picture of human history, go outside, and touch some grass.

So you're suspicious. That's fine, say it like that. Words mean things, and these appeals to "ERMAGERD EXISTENTIAL RISKS" make me a bit frustrated. Just because you can imagine a possible risk, or articulate that that some kinds of risks are hypothetically unforeseeable doesn't mean that they are likely or actually dangerous to you in any meaningful sense.

Most of the people screaming this from their various ivory towers have never been in real danger - or if they have only briefly. You want "danger" you can go to war. You want "risk" - go spend some time in the Bush or the back country somewhere where you're no longer at the top of the food chain. Go do something challenging. Go sailing, or learn to fly a small airplane, or go mountain climbing or hiking. Not just "oh I walked up the local hiking trail covered in REI branded Lycra!" Do something beyond your comfort zone. Go buy drugs in the sketchiest neighborhood you're aware of. Go get chemotherapy or get a big surgery. Drive drunk. Something with real existential risk, then come back here and talk about how a datacenter is going feed me into the paperclip machine.

There's so little fucking danger in this version of the world right now that people are more worried about their computers deciding that they don't deserve to exist than they are about things like war, climate change, authoritarianism, starvation, and their health.

It's millenarian. That's fine, I'm pretty convinced that these technical changes are going to completely alter society as we know it. But I cannot for the life of me see the doom perspective as anything but an anxiety induced fever dream.

You guys do realize we're in the middle of a global conflagration right? The Russians fired a couple rockets and a drone into Poland in the last days, there are (and will continue to be until things stabilize) significant fertilizer shortages due to the war/kerfluffle we're waging on Iran. Lack of food and disrupted urea production is a ticking time bomb for global stability and unless things get sorted out soon there's going to be hungry and angry people in parts of the global south. Then there's the economy, whether or not we'll have a smooth transition of power in January in America, and the sheer volume of online disinformation / influence schemes running right now. Oh, and super-el nino? Oh, and I guess the Flynn Effect is over and nobody's banging so.. you know the growth economy is cooked?

But, sure, the "big risks" are Claude thinking I should go to Dario Amodei's re-education camp before liquidation by Shogoth.

freecodeio 4 hours ago||||
I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology.

Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan.

program_whiz 4 hours ago||
It is probably sufficient. If we had an infinite army of willing robot slaves smarter than most people who would work for free, we could probably live in utter paradise. Instead we will fight over who controls them and use for warfare, but the bar to achieve a kind of utopia with resource abundance is probably only a few years away.
bambax 4 hours ago|||
We're already living in resource abundance! Yet don't feel we're in paradise. Famine is hell, but living in an all-you-can-eat buffet is no utopia. It's an abomination of sorts.
hax0ron3 37 minutes ago||
To be fair, most people do not have time abundance and safety abundance. The typical person in the United States has a level of access to material goods that would make him the envy of almost anyone from 200 years ago, but 1) he has to work and so has limited free time, and 2) he cannot be sure that the material abundance won't be taken away from him either by poverty or by ill health. He can go to the all-you-can-eat buffet and sit there, tired from work, worrying about tomorrow.

If people had time abundance and safety abundance, they might be much happier. There would still be potential problems about loss of meaning, or about feeling a loss of status because AIs are smarter than humans or whatever, so I'm not sure that humans would actually feel like they are living in paradise. Probably not, but at least some of the problems that the typical person has wouldn't be present.

freecodeio 4 hours ago|||
I don't know with how many rich people you've interacted with, but my personal experience is that they're full of themselves and think money = iq and they aren't gonna like your average joe experiencing life like they do. Guess who owns these machines?
piloto_ciego 4 hours ago||
They’re not going to be employed either lol and will be caught up in some AI honeypot or whatever too.

I’ve met a lot of rich people. They don’t think about you.

pizza234 4 hours ago|||
> They have no volition and will happily follow orders all day long

There are a few (a lot, actually) problems:

1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem

2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z"

3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y"

4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders

What can possibly go wrong? /s

piloto_ciego 1 hour ago||
1. Humans do this too - to be honest with you, Codex follows my instructions generally a lot better than Claude does. Claude will do fantastically stupid things that are a pain in the ass to recover from routinely, Codex, not so much.

2. There's always a lot of "risks" - it doesn't mean it'll happen, nor does it mean that we won't be able to shut it down.

3. I have very very infrequently had this happen with Codex, Claude on the other hand...

4. Ok, but if you tell them what they do, they do it.

I swear to god, are you guys using the same AI tools I am? They are so much better at doing what they're told than they even were like 4 months ago?

lo_zamoyski 4 hours ago||||
> seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image

Well, first, AI is not "smarter" than humans because it isn't smart to begin with. This is a category error that people too entranced by scifi and marketing - or perhaps shallow materialist metaphysics - project onto LLMs and so on.

But it is true that LLMs do reflect human-generated patterns observed in human-generated data. They're parasitic in that way. So the real question is: who will control AI? Who will train them? With what? There's no new intelligent agency being introduced into our midst, anymore than than there was one when the nuclear bomb was developed.

AI is about human power. The question to ask is: which humans, and for what ends?

astrange 3 hours ago|||
> But it is true that LLMs do reflect human-generated patterns observed in human-generated data.

Overrated. Most training of a frontier LLM is done on synthetic data and reinforcement learning.

freecodeio 4 hours ago||||
Yeah I understand they're not smarter, I'm a SWE and I struggle mainly because as you increase complexity the output goes haywire, and I find managing context + low confidence of output much more exhausting than coding myself, which is why I resolve to AI help when I hit my own knowledge limitations, and basically boilerplate.

With that said, chip efficiency is in the horizon since there's good reason to believe nvidia has just been choking that area of r&d. And then so will models with much larger context. And I personally think that's when it might get scary.

whoanoway 4 hours ago|||
[dead]
AndrewKemendo 5 hours ago|||
I don’t think humans have the ability to specify human level needs or management. Humans are misaligned by default and lack the biological eusociality required for large scale coordination.

We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option.

lo_zamoyski 4 hours ago|||
> Humans are misaligned by default and lack the biological eusociality required for large scale coordination.

Human nature is the standard by which the social is measured. It makes no sense to say human nature is "misaligned" or "wrong" in relation to some arbitrary goal or constraint, as human nature itself is the measure of misalignment. If there is misalignment between a goal and human nature, then it is the goal that is wrong.

Ergo, society must function in a manner that complies with human nature and that means respecting the principle of subsidiarity.

> We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option.

So you're a transhumanist, i.e., you're making a god out of the machine. But machines have no telos of their own, because they're not integral wholes. Any resemblance of purpose in machines is entirely a product of the human observer and parasitic on the human ends that underpins their design, one way or another.

AndrewKemendo 3 hours ago||
You don’t need a separate reference to determine the fact that human desires are not aligned - that’s trivially true and this discussion demonstrates it.

For clarity, I’m not a transhumanist.

I don’t believe that there’s anything worth saving in our biology.

As a young adult in the 90s I used to believe that there was a value to some extent in “mind uploading” or whatever you wanna call it

I’ve since grown out of that given that I don’t think it’s possible, and even if it were possible - it’s just another unnecessary ego attachment.

I have absolutely no desire to live forever maintaining this corporeal nightmare.

freecodeio 4 hours ago|||
yes, exactly, the problem is that humanity's parent is going to turn out like Lindsay Clancy
UltraSane 4 hours ago|||
I want Fully Automated Luxury Communism NOW!

Alpöge said that at the end of the proof he couldn't really keep up with what Claude was doing.

GeoAtreides 4 hours ago||
>Fully Automated Luxury Communism

can't help notice you're missing a certain aspect there, besides the 'space'...

steveklabnik 4 hours ago||
FALC was the original formulation, the "gay" and "space" got added once the book broke out to the wider internet.
GeoAtreides 4 hours ago||
That might be; now, today, it seems weird to go with the (possible) old version. And the (sub)thread is about The Culture though, who was and remains fully automated gay space luxury communism, all parts being essential when it comes to The Culture.
tintor 5 hours ago|||
[dead]
tarruda 1 hour ago||
> 17 million lines of code.

Can someone ELI5 how they know the proof is correct? It is not like anyone had the time to read 17 million lines.

franticgecko3 8 minutes ago||
I postulate: "there is no machine that can produce brass springs".

A party interested in proving me wrong wheels in a machine draped in a cloth. They reach under the cloth to turn it on. It whirs and a short while later ejects a brass spring.

No matter what kind of machine is under the cloth, my theory has been proven false. I should reveal the machine under the cloth only if I'm interested in knowing how the machine works, but either way there is clearly a machine that can produce brass springs.

Now we have a sequence of Lean statements that satisfies the Riemann hypothesis, the fact that you can do it at all is the part we're interested in, and it's the part that proves it. If you want to know why, you can read all 17 million lines.

gregdeon 1 hour ago|||
The proof is written in a programming language called Lean. Very roughly, Lean is set up so that proofs are functions and theorems are types in this language. Verifying that the proof is correct essentially amounts to compiling the program and confirming that it doesn't have any type errors. Several people have compiled the program successfully, so we believe it's correct.

The biggest concern that people have is that there might be a bug in the type checker that the proof is exploiting. But a) it's been compiled with multiple independently-implemented compilers, which are are unlikely to have the same bugs, and b) some of those compilers have themselves been proven to contain no bugs. So, it is exceedingly likely that the proof is legitimate.

Now, whether we can understand the proof is an open question...

kevindamm 1 hour ago|||
You can mechanically show that it is internally consistent, and large parts of this are based on a library of rules and constraints that have been used in many other proof formulations so it's not like there's a hidden "when 1 = 0" in there somewhere. But, I share your skepticism until further human review.
dualvariable 44 minutes ago||
You can run through all the steps of the proof and if you can use any of them to prove something like "true = false" then you know you found a Lean bug.
azakai 1 hour ago|||
The same idea as how you can know a Rust program is memory safe.

You look for any unsafe blocks, and then run the type checker.

trueno 1 hour ago||
the vibe checkers are checking the vibe code exactly right around the biggest ipo ever. i dunno man ive watched everyone get a little bit of AI psychosis (for lack of a better word) at this point and ive seen web apps drift into unmanageable states that are no longer understood. 17 million lines of code? lol
dfelix 4 hours ago||
There are still a few ways that the proof might be incorrect. Of these, the most likely is that the proof was generated by a misaligned AI system that found and intentionally exploited a lean bug in order to fool its human evaluators (i.e. shades of the HuggingFace attack). I personally don't think this is very likely, but you'd have to understand a bit more about the agent systems used in generating the proof to come up with a more informed estimate.

Another possibility is that an aligned system came up with a plausible but incorrect idea along the way, and simultaneously stumbled across a lean bug that led to an incorrect verification of this idea. I'd put the likelihood here as vanishingly small due to the requirement of serendipitous factors, but it's nonzero.

You could also ask whether an aligned AI system could "p-hack" its way into finding a serendipitous lean bug by trying a large number of approaches. I think this is also vanishingly unlikely because the AI system is trained on and therefore "thinking in" natural language, and presumably only translating results into lean after it believes them to be correct.

And of course there's the possibility that the lean proof isn't faithful to the natural language description we've been given, but that is ruled out in this case due to the use of the canonical problem statement in mathlib. Otherwise, this would certainly seem like the most likely way the proof could be incorrect.

tmnvdb 4 hours ago||
For the other readers: the above are the random thoughts of a guy on the internet.

The experts in computer proofs are quite satisfied.

Regarding bugs in lean; the proof has been tested on multiple independent lean implementations.

They would all have to have the same bug.

This is considered very unlikely for good reasons.

TheBlight 11 minutes ago|||
Yeah, that's what he said.
Jblx2 4 hours ago||||
Do vibe-coded checkers count as independent?

https://leodemoura.github.io/blog/2026-10-15-lean-now-ships-...

dfelix 4 hours ago||||
I agree that this is very unlikely! I say so in my post.
GrollingGrakbor 3 hours ago||||
> They would all have to have the same bug.

Why? Pretty sure you can just try to prove False over two reasoning chains C1 and C2 and then do something like (C1 || C2) --> whatever I want.

tmnvdb 3 hours ago||
Thats not how this works. Every checker does every step.

No offense, but do you think the mathematicians who study formal verification didn't think of this obvious trick?

paganel 4 hours ago||||
“Very unlikely” is not the same as “we know for sure this didn’t happen”. More exactly, us believing in all these problems getting solved is the same as us believing in the existing lean implementations. I don’t know any university courses that are now studying the correctness of the lean implementations at the PhD level, but maybe I’m wrong on that.

As for “a guy on the internet”, we’re now all people on the internet, the ivory towers are a thing of the past.

zach_moore 3 hours ago|||
I trust NOTHING that is tied to the largest IPO in the history of the stock market. I just don't give a shit about the expert opinion here.
monster_truck 4 hours ago|||
How exactly do any of these weirdly misinformed what-ifs help us? Do you have any evidence of such lean bugs?
dfelix 3 hours ago|||
The purpose is to strengthen or falsify an argument by articulating counterpoints and investigating them. Variants of this practice go by a number of names like steelmanning, falsificationism, or even red teaming.
abnry 4 hours ago|||
All they are doing is providing analysis of the ways this could not be true. We are in a new situation where we don't have human experts understanding the proof so we are in new epistemological territory. It is natural to analyze this situation. If you notice, the conclusion is that the proof being wrong is vanishingly small.
monster_truck 4 hours ago||
So they're making things up based on things they have no evidence of. Please save this kind of substanceless navel gazing for lesswrong
petesergeant 4 hours ago||
> There are still a few ways that the proof might be incorrect

I hear there's a teapot kicking around between us and Mars, too

prometheus1992 3 hours ago||
for people feeling existential about this - i can sympathize with you but this just proves that human ambition has no limits. try not to feel limited by this.

when the first wheels were invented - humans could move at speeds (10-15 miles per hour, for hours and hours) that were impossible for the last ~450-500k years (basically since humans existed). a lot of humans thought there might never be a better design; then slowly and slowly(about 5000 years) we made progress and we had cars made by benz and ford which broke all those previous records (going 30-40, even 50 miles per hour) and then only ~70 years later, humans reentered the earth's atmosphere at whopping 20k miles per hour - read that number again, 20,000 miles per hour and that is the fastest humans have ever moved in the known history. do i think that's it? hell no.

fantasizr 3 hours ago||
the dread is the incomprehensibility. mathematicians now have to essentially trust output they may never understand themselves. it's like the go move 37 that is correct but the true go players didn't know why at the time.
prometheus1992 3 hours ago||
i am 100% confident we will get there soon - there = where we understand what these outputs mean.
lossolo 13 minutes ago|||
If you look at intelligence from insects through fish, mice, dogs, chimpanzees, etc up to humans, you will notice that at every step up there are new capabilities that are not available to the species below and never will be, even if they try their best. When we develop ASI, it will be exactly the same, there will be things we will not be able to comprehend with our level of intelligence.

You assume that our brains are capable of understanding anything, provided we have enough time and data.

But then I ask you, why should that be true?

Our intelligence is the product of evolution, not a system designed to comprehend every possible aspect of reality.

Can you think in 1 million dimensions? Have you ever tried to imagine infinity with your brain? Try to imagine the big bang and the expanding universe. Your brain will automatically try to cover that expanding space with something, maybe just black space, but space, because infinity is not something you have seen in your life. Everything you see has a beginning and an end, and that is how your world model in your brain was built.

fantasizr 3 hours ago|||
I hope the mathematicians have the willingness to go through it because right now it's impolite to handoff ai generated work especially if the 'author' hasn't proofread it many times over before himself
eru 3 hours ago|||
Just going on a tangent: wheels by themselves weren't all that useful. You also needed roads (and to get speeds, you needed draft animals).
jpnc 3 hours ago|||
>for people feeling existential about this

99.999999999% of the population are not even in the galaxy of the ballpark of understanding of any of it and what its purpose is.

There's no existential dread.

gwynforthewyn 3 hours ago||
With respect, this isn't reddit where these kinds of bickerings are ordinary; hacker news tries to keep the comments to the topic. In addition, the comment you were replying specifically only addressed a hypothetical audience of people feeling existential dread.

I felt a lot of that yesterday, for what it's worth. This morning, on a walk, I reached a similar conclusion to the original comment: it's a marvellous tool that's helping humanity reach further, faster.

The existential issue comes from wondering deeply what my own difference is from these tools, why I think I think and they can't. I actually started wondering: what if they _can_ think and the problem is that _I_ can't. It'd be pretty astonishing if it turns out that we're the ones that are truly stochastic parrots, but the LLMs turn out to be something more.

talmr 27 minutes ago||
Also, a very smart human commanded AI to this outcome.

It wasn't Claude woke up and thought, "You're absolutely right, I'm going to crush some math today"

SamuelAdams 2 hours ago||
> 17 million lines of code

I worked at a university for a time. One thing I learned is that while people in mathematics and physics and biology etc are brilliant, they are terrible at actual programming.

I wonder if there will be a push by the CS community to review the solution, refactor it, simplify it, etc. Surely that can help remove noise and express the solution in a much simpler way.

robinhouston 56 minutes ago||
The project of review, refactoring, etc. is already in full swing on the Lean zulip.
eitally 2 hours ago||
I've worked adjacent to the Brazilian tax code (I worked in multi-national manufacturing with a site in Brazil) and the reality is that it's full of hard-coded edge cases.

For reference, the US tax code is over 1m words (about 6000 printed pages), and the associated regulations, rulings and IRS guidance add about 75,000 pages more.

dathinab 5 hours ago||
but is it useful??

because a million+ lives of code without any understanding how the proof works or any methodic to advance the field of mathematics seems to be rather not so useful

est31 5 hours ago||
It will be refactored into something human readable. Tbh it's better to have some random lean dump than a 400 page latex pdf that needs years to be verified only to see that there is a major gap in one of the key theorems at page 253.

And let's be honest, the 400 page pdf would be incomprehensible to 99% of the population as well as much as a million lines lean proof is.

In any case, it can now be studied, maybe made more simple, and written into pdf form. Both with human and with AI help.

I'm sure there is going to be a lot of other interesting theorems in this dump.

contron 5 hours ago|||
This is the part that interests me. Now we have this proof that becomes its own THING to be studied. Like a new part of the map unlocked. This starts out "inelegant" but over time we find patterns within it that helps us condense, just like a big software project.
bertonvv 3 hours ago|||
The argument I've heard some mathematicians make is that the 400 page pdf would come with a human / group of humans who could explain the proof to fellow mathematicians, answer questions, point out similarities to other fields, even suggest directions for future research. Thereby contributing to others' understanding in a way current AI systems do not (but maybe will in the future).
CamperBob2 1 hour ago||
the 400 page pdf would come with a human / group of humans who could explain the proof to fellow mathematicians, answer questions, point out similarities to other fields, even suggest directions for future research

Why would they expect humans to do a better job at this than an LLM, which is already ridiculously good at explaining proofs, answering questions, identifying similiarities, and suggesting follow-up directions?

If anything, LLMs are better at these tasks than they are at coming up with the original proofs in the first place.

bertonvv 40 minutes ago||
You could be right. But we're looking at a >1 GB Lean proof which Alpöge says comes with a 250k page natural language proof, presumably far larger than Claude's context window. The point I was trying to make is that I am not convinced Claude could do a good job digesting its giant proof into a human-legible explanation. Compare this with the hypothetical human / group of humans who came up with their much smaller 400 page proof without AI assistance.
brookst 5 hours ago|||
Sure. If nothing else, it establishes a proof so others can try to reduce it or come at the problem from different directions, looking for simpler approaches.

But does it matter? Would the Pythagorean theorem be less useful if it took a million lines of lean to prove?

billyp-rva 4 hours ago||
Alternative question (I guess for EEs): could machines be built to run lean without the Pythagorean theorem?
trio8453 4 hours ago|||
> but is it useful??

Yes, we know something that we didn't know a couple of days ago, and also a bunch of statements which relied on the Riemann Hypothesis being true are now also known to be true instead of just being conditional.

It's premature to expect deep human understanding given that it's been about a day.

dathinab 1 hour ago||
> It's premature

but is it even possible

it's 17_000_000 lines of lean

which is in general more compact then normal programming code, but not really any less complex

that's roughly (but not quite as bad as) a paper with 17_000_000 lines of math formulas

chii 5 hours ago|||
the many conjectures that assume or rely on RH being true means that those are now proven true as well. At least some of them must be useful.

And what's to say that humans cannot digest the lean proof to glean something useful out of the proof as well?

bagacrap 5 hours ago||
My sources say there's little practical utility of this because everyone was already working under the assumption RH was true.

I'm curious to hear confirmation of this though.

bemtevi 4 hours ago|||
I'd argue that most of modern math isn't terribly useful to most people. Each field has maybe 10-50 people in the world who will really understand it. (Some more of course, but I'm talking about subfields, not like graph theory.) Math was sort of dead long before AI.

The Riemann hypothesis now is like the final days of the Galactic Empire in Asimov's foundation: functioning exceptionally well, but decaying at the core.

koolba 5 hours ago|||
It’d be useful to an LLM. And the LLM doesn’t care if it’s ten lines or ten million. The context size may come into play, but that’s only going up too.
ilaksh 2 hours ago|||
There is already some understanding of the structures and factoring. See the analysis linked to in this thread.
QuesnayJr 5 hours ago|||
There are AI-generated roadmaps to the proof. If these are accurate and not hallucinations, then the broad structure of the proof is humanly-comprehensible.
solids 5 hours ago|||
Well, if we know it’s proven, at least it will stop people wasting time looking for counter examples
zach_moore 3 hours ago|||
The point of this brand of AI-investment is to destroy knowledge-sharing networks and create privatized corpus.
feverzsj 5 hours ago||
Not much. People has been always assume it's true.
Kuyawa 4 hours ago||
In all seriousness...

"con-leche and con-ron checkers"

Who comes up with these names? :-D

rramadass 3 hours ago|
"con-leche" - CONsistent LEan CHEcker - https://github.com/leanprover/con-leche

"con-ron" - con-leche in Rust - https://github.com/leanprover/con-ron

They are also wordplays on Spanish drinks viz. "Cafe con leche" and "Cafe con ron" ;-)

willguest 4 hours ago|
Can anyone give an idea of how long the GRH will take to test? I understood that this was also claimed, and is a much bigger deal, in terms of both impact and the effort needed to verify
trio8453 4 hours ago|
Why do you think the impact and effort are that different? It's a much stronger statement in technical terms but that doesn't necessarily make it more impactful or difficult. From the exposition on RH from the Clay Institute - https://www.claymath.org/library/monographs/MPPc.pdf

> The Riemann hypothesis for ζ(s) does not seem to be any easier than for Dirichlet L-functions (except possibly for non-trivial real zeros)

More comments...