Top
Best
New

Posted by mbustamanter 14 hours ago

GPT-5.6 used a prompt to close a 30-year gap in convex optimization(old.reddit.com)
474 points | 305 commentspage 2
sashank_1509 12 hours ago|
This is all a depressing and bleak future that I don’t look forward to.

One solution is to ban LLM’s, to artificially create a demand for human thought, that just feels like living in an artificially constructed zoo.

Another solution is humans don’t do anything that AI can do better , / doesn’t need the human touch. So I suppose we will all become artists, sportsmen or politicians, the only jobs that will remain except for select few. Maybe this is ok, I don’t know.

Another solution is we find a way to mind-meld with AI so that human + Ai >> AI alone. This is dystopian, who gets to decide who mind melds with AI, how much will it cost etc etc.

For the stupid copes that the prompt required human ingenuity, let me first add that the author used GPT5.6 to write most of the prompt. He just gave some mild direction. That amount of direction does not require deep expertise and the expertise required will keep falling with time, eventually an undergrad can create this loop and then maybe a high school student.

  And prompt engineering / loop engineering nonsense is not real. Calling it engineering is a psy-op because it is something simple, imprecise and future models will be much better at it than you.
In fact, in the future the most likely outcome is you tell the agent what you want (I want this app, or I want this theorem solved) and it will set up the loop, or loop of loops and use all its computing effort to come up with a result. This is completely dystopian to a human life.
natsucks 9 hours ago||
call me naive, but i really think the pursuit for the new, the better, the interesting, is boundless and humans will never stop. and so for those of us that dream and push and are plain curious will never run out of ways to be useful. and hopefully the fruits of all this tech will be ample enough to support the ones that don't want to or can't participate in that way.
thfuran 2 hours ago|||
If AI is better at being (or simulating; I think the distinction is irrelevant in this context) curious, better at examining that curiosity, better at pursuing it to discovery, better at applying the discoveries, better at sharing the discoveries, and able to push the frontier of knowledge (if that’s even the right word) literally beyond human comprehension in every domain, what usefulness exactly is left? Or are you just implicitly saying you don’t believe AI will ever get all that superhuman?
petra 6 hours ago|||
We already drown in useful new things and especially knowledge. There's a limit to how fast we can adopt them.
raincole 9 hours ago|||
It genuinely scares me that some people's first reaction to this news is banning LLM.
derac 9 hours ago|||
Maybe we should also burn books and lobotomize ourselves to make science more fun and challenging. The ego here sickens me. I don't care about your ego. I want accelerated material science, medical science, energy, better outcomes for people across the world.
shinryuu 9 hours ago|||
I also want better outcomes for people around the world.

Memes like the permanent underclass and the massive incentive of replacing workers across the world does not bode well for a better outcome for people across the world.

dag100 7 hours ago|||
> I want accelerated material science, medical science, energy, better outcomes for people across the world.

There will be people benefiting from advances in these fields.

Neither you nor I will be one of them.

_zoltan_ 5 hours ago||
If that's your starting position then for sure you won't, buddy.
moomoo11 5 hours ago||
“you’re talking to someone who woke up a loser today”

looks like you met the reverse Huang lol

malthaus 8 hours ago||||
wasn't that always the reaction historically whenever people felt like their livelihood was threatened by new technology?
arjie 7 hours ago||||
A rational reaction would be to identify the political coalition that would act in this manner and place yourself in opposition to it if you do not see yourself being able to change it.

I wonder which one that is.

Shorel 8 hours ago|||
Why? No one will be able to effectively ban AI. Pandora's box is open, and we can only witness the consequences.
adamtaylor_13 6 hours ago|||
Why is this depressing and bleak? No one is stopping you from doing math if that's what you want to do.

Should I ban table saws because they make people too good at woodworking? Should we ban right-angles?

This line of thought doesn't lead anywhere fruitful.

moomoo11 6 hours ago||
just ignore these people

gig economy is a blessing to keep the LCD busy and doing something productive instead of being nihilistic losers

it’s better to focus on how to keep these “knowledge” workers busy for the AI age

they don’t like to work and complain even on a w2 job (where someone else had to figure out how to capitalize them) so in many ways they’re far more dangerous and hopeless.

cornell532 4 hours ago||
Don’t be so nasty about w2 workers. Incredibly unbecoming.

Also see comparative advantage re best roles for each actor in an economy

moomoo11 3 hours ago||
cool
slashdave 11 hours ago|||
There is more to human life than programming and math proofs.
tripleee 10 hours ago||
unfortunately many won't get to experience it much because we'll be stressed and struggling to make a living
kevincox 8 hours ago|||
The problem isn't that we are gaining more knowledge and better technology. The problem is that we are allowing the rich to use the technology to subjugate the majority.

If AI improves human productivity so much that millions of people no longer need to work that should be an incredible thing. But the flawed structure of our society punishes those people rather than freeing them to persue endeavors that interest then.

tripleee 8 hours ago||
Only solution I can think of is higher taxes for the rich used to provide universal income. I'm not sure how the realities of that would play out, though.

Anything based on a free market just ends up in.. this.

kevincox 8 hours ago||
I'm strongly in favour of this. I think income tax should approach 100%. So your second billion you still make more. But not twice as much. The exact decay function is up to date. But I really don't think your post-tax take home should scale linearly with your income once you hit the max bracket.

We can also remove all of the loopholes that result in the biggest companies paying basically no taxes. I also think it may make sense to have a dramatically different tax structure for businesses than effectively income tax.

Shorel 8 hours ago|||
This is already the case with most human activities, even reading a book for leisure is a luxury many can't afford.
tripleee 8 hours ago||
It's available to most, though.

Outside of really bad luck I've never seen a case where someone was in a situation of working hard + making reasonably okay decisions + struggling, and that's purely due to there being avenues available where you can be rewarded well for your effort if you're of average+ intelligence.

AI is threatening to take that opportunity away.

piloto_ciego 10 hours ago|||
This is utopian friend!

Literally anything you wanted to make is no plausible to make if not now then in the next couple years.

The thing you’re worried about is capitalism and the connection with working to having the right to keep living. If you can throw off that mental shackle you can start to see how this can be amazing, but you have to drop the idea that everyone has to work at a job for someone else to provide some service in order to do it. It’s hard, I know, but change your mindset some and dream for a better world and we can make it.

WarmWash 10 hours ago|||
You ever play a video game with god mode cheats enabled, so you can unlock all the unlocks, get all the best gear, and be an unstoppable force with unlimited money?

Yeah, it's fun for 30 minutes.

nilamo 10 hours ago|||
On the other hand, exploring any of your interests without needing to calculate how it can cover rent means you have more time and opportunities to actually do things you're interested in.

Working all day, then not wanting to do much else after because you're tired, is also fun for all of 30 minutes.

piloto_ciego 9 hours ago||
Right!? Like imagine we could use this stuff to solve world hunger, develop robots to clean up the oceans, or colonize space?

People are all “shucks how am I going to be able to justify my career at $job” and are missing the bigger opportunity. Such a lack of imagination I see…

dudul 6 hours ago||
There is no lack of imagination here, there is realism. You think you display "imagination" by just regurgitating all the tired tropes of old science fiction? Oh wow! Robots to clean the ocean! How novel! Nobody has ever thought about this!

The reality is nobody is going to build robots to clean the ocean because there is no money to be made. There will be robots to clean rich people's pools, sure. And it will put pool boys out of a job, great.

piloto_ciego 6 hours ago|||
I can see (given that you've responded to a few of my points here), that you care about this enough to respond.

What if money wasn't a thing? What if that wasn't the only incentive in the economy? What if there were other ways to balance supply and demand curves (which is basically the principle use for money) so we could reduce shortages, etc.

Dream big man, I'm serious! And who cares if there is no money to be made? Like, what are you (individually you) doing to create the world you want to live in? What world do you even want to live in?

yieldcrv 6 hours ago|||
"let's slow everything down because we haven't figured out the resource appropriation aspect, yet"

there will always be disruption and frictions, 頑張って ください

sashank_1509 7 hours ago||||
Exactly, a lot of people keep attacking me as anxiety for losing my livelihood. It’s not that.

It’s just depression that another avenue for human craftsmanship has been taken over by the machines. Humans are not just infinite consumers. If AI solves all of humanity problems, it’s like living in a zoo, not a life worth living imo.

piloto_ciego 7 hours ago||
This has always been the case though that "another avenue of human craftsmanship has been taken over by the machines."

It's good if we can have robots building things instead of having humans slumped over a workbench in a sweatshop piecing things together. It's good if we can have LLMs spitting out code rather than CS grads working 15 hour days at fintech startups or whatever. The conditions were never (ever) good before.

And, it won't be like a zoo - you'll be able to go wherever you want, do more or less whatever you want. Think about living in The Culture, or the Star Trek universe or whatever. There are options beyond "I'm a pet to the machines." Think big, dream big, then help make it a reality!

Like, out in space you're still going to need a human to make decisions because you can't wait 30min for the tight-beam signal to get back to earth. Also, we're pretty good at soaking up rads and still being "useful" - at least so far I don't see that being a major advantage to the robots. Maybe our place is to be the deep space mechanics that keep the robots alive? I don't know, regardless, you should dream big. What kind of world do you want to live in? Ok, how do we make that world happen?

My big (somewhat unspoken and somewhat immature dream) is that advances in regenerative health tech fix my optic nerves and I can get into the cockpit again one day, then maybe later I can fly some space vehicle like I wanted to since I was a 12 year old. Immature I know, but I miss flying still.

Is that world possible without AI? Probably/maybe? But it's a lot more plausible in a world where we have folded every protein, we have robot surgeons doing robotic procedures, AI generated research, etc.

sashank_1509 6 hours ago|||
Surgeons too now? Another avenue for human skill destroyed.

I actually want to exit. I want to live in a society where humans flourish not AI.

Actually one just needs to walk the streets of Japan and compare that to US. Tokyo has hundreds of small shops with humans doing specific niche stuff, perfecting their arts. That’s all so beautiful.

America has massive warehouses and supermarkets, with completely uninterested and bored out of their mind humans working and I suppose now we will replace them with robots. Great I guess. Maybe all Americans should just sit at home and consume Netflix and Doritos ig.

I want technology to increase human flourishing, not turn us into WallE humans. I am only interested in technological progress when it is done by humans who trained their whole lives for it, as it is a display of human excellence and that can be a beautiful thing. I’m not interested in it if some AI builds it.

piloto_ciego 6 hours ago|||
Then, you know, build that world locally, at least for yourself.

Like, I'm building a cabin in the woods (original, I know), but you can build things and do things. You can be that kind of human if you want. But, if Americans could sit at home and consume netflix and doritos I suppose some would, but many would decide to start doing other things too.

I don't think the worlds we want to live in are that far apart to be honest. If I could make a living doing it, I'd try to build wooden sailboats for a living. That would be awesome. I would love it! In a world where I don't have to work to win capitalism tokens, I would probably spend a few years just building wooden sailboats to sail around the bay by my cabin.

perching_aix 1 hour ago|||
What you write is what's profoundly depressing.

The only way you see people flourishing is through coercion, by society or by the world. You'd explicitly rather prolong this codependency for your aesthetic preferences even, as per your own words. We're already just circus monkeys in your world.

You cannot fathom people pursuing self-improvement because e.g. developing or being capable is inherently enjoyable. You only see a world where such activities are a must, or a manufactured must. That's your measuring stick and that's the entire pie for you.

I mean this in the least combative way possible, but it sounds like you have things to sort out on your end first, before charting a course for the world to follow.

dudul 6 hours ago|||
I admire the naivety. I'm sure CS grads are delighted...
piloto_ciego 6 hours ago||
Why the ad hominem? I mean, seriously, you think I haven't been "in the trenches?"

Dude, I'm nearly 40. I've seen the shit. When I was flying for a living, literal close friends died because of the results of avarice.

Dream big dude! This constant "doom and gloom" narrative is toxic to your ability to flourish. I have been there, I understand the urge to doom and gloom, but we make the world we want to live in. We do. We choose it.

What world do you want to live in? What is your "optimal" version of the future? How do we get there? What steps would we have to take to make it a reality?

If your vision of the future is "oh, like 10 years ago before $problem_du_jour" then you're already off to a bad start because we ain't going back. There's no regulation that will actually change anything materially (seriously, you think the people getting rich off all this stuff in Congress will voluntarily shoot themselves in the foot?), there's no way to go but forward, so how do we proceed?

I want to live in The Culture, or something like it if it's possible. So, let's start building it and ask permission later.

eichin 5 hours ago||
what's getting built is more like Asimov's Spacers/Solarians, though. (Vastly reduced population wielding thousands of robots each)
piloto_ciego 5 hours ago||
I mean, birth rates are crashing hard here in the US so this might be decent future?

Maybe average human lifespan gets kicked up to 200 years or whatever and we make do with robots to fill in the gaps in labor with robots?

I don’t know? But this kind of seems to track with how we’re trending now?

vanuatu 6 hours ago|||
I play the game for a manufactured challenge

People in the real world all having god mode cheats is good, actually

piloto_ciego 6 hours ago||
yeah! Like can you imagine a world where you could just effectively "conjure" new furniture for your house and robots would assemble it in a few hours? Or molecular assemblers would grow it while you slept?

Or imagine a world where we could basically cure every disease? Or a world where people could assume any form factor that they wanted? I don't know, the list goes on and on in a post-scarcity world... and we're seeing how we basically live in a sort of digital post-scarcity now and it is really cool.

If I need a software tool these days I don't buy it, I tend to see if I can make it. Now imagine that for physical things? What a time to be alive.

WarmWash 3 hours ago||
The rub is that we already live in that world relative to people who lived 1000 year ago, and yet somehow we aren't bursting with euphoria 24/7.

We also have humans who essentially live post scarcity lives on the back of a monetary windfall, yet their stories are strangely quite often depressing ones.

I think their is good reason to believe most human desires are illusions.

dudul 9 hours ago||||
If anything one wants to make is now possible to make, how is anyone supposed to make a living?

Can I make food with LLMs? Can I build a house and make clothes? This is stupid. No real wealth is being created for the general population here.

piloto_ciego 9 hours ago||
I literally have had various LLMs generate 3d printable plans for things I have used. Also, I am literally making a living right now being something between a dev and SME and building tools for people in an industry I’m familiar with.

Dream bigger buddy! We can make the world better, we’re not powerless here.

paytonjjones 10 hours ago|||
People like being needed and important to other people. That isn't some artifact of capitalism; it exists across all times and cultures.
piloto_ciego 9 hours ago||
Sure, but it is certainly magnified when you need to make money to justify your right to exist.
skekke 8 hours ago||
What a load of absolute nonsense.

I’m convinced many of you barely go outside and have the capacity for original thoughts.

Sloppity slop slop.

ChrisArchitect 9 hours ago||
Non-reddit: https://medium.com/@kerger.p/an-ai-assisted-breakthrough-in-... (https://news.ycombinator.com/item?id=48939768)
stfnon 7 hours ago||
nah, scientist with the name Shakey Onail found this and all creds are given to LLMs is crazy
VonTum 7 hours ago|
Do you have a link to Shakey's publication?
applfanboysbgon 14 hours ago||
Two points:

- Hasn't been peer reviewed yet, so take with a grain of salt. This applies to all claimed proofs, not just AI-generated ones. Even humans hallucinate proofs too!

- The prompt is on page 27 here[1]. It is ten pages of advanced mathematics priming the model in the right direction, apparently informed by a year of prior research. That doesn't invalidate the result if it is genuine, but it is worth noting that this wasn't a matter of "ChatGPT, solve this unsolved problem. Make no mistakes." and required substantial domain expertise and human research beforehand.

[1]https://arxiv.org/pdf/2607.13335

lozenge 13 hours ago||
It is lean-verified, so it can be trusted unless the Lean statement of the hypothesis is not an accurate description of the hypothesis.
throwthrowuknow 13 hours ago|||
Saying “solve this problem” doesn’t get good results most of the time with humans either, it’s entirely underspecified so the person assigned that problem may solve it in a variety of unacceptable ways or not at all or perhaps worse solve the wrong problem because you weren’t clear about its definition. This actually happens all the time. What matters is the ability to communicate clearly and with precision as well as the “harness” which for humans is procedure, training, planning and management.
camdenreslink 13 hours ago|||
The subtext of this whole post (or at least a subtext that some might read), is "we don't need mathematicians/programmers anymore" or "we will need much fewer mathematicians/programmers". So the fact that this result required a year of prior research and a 10 page prompt of specialized knowledge goes against that subtext. You still needed the human just as much to get to the result, and the LLM ended up being a tool to find the last bit.
applfanboysbgon 13 hours ago|||
> Saying “solve this problem” doesn’t get good results most of the time with humans either

Sure. That is not even remotely the point I was getting at. Already we see the thread filling up with comments about how human skills are irrelevant, using a mathematics PhD applying his expert skills in a way that the people who are saying that could never have done to justify their inane conclusion.

varenc 9 hours ago|||
Digression: You can link directly to a page in a pdf with a url like this: https://arxiv.org/pdf/2607.13335#page=27
andy12_ 9 hours ago||
> but it is worth noting that this wasn't a matter of "ChatGPT, solve this unsolved problem. Make no mistakes."

It wasn't the case for this, but when OpenAI disproved the Unit Distance Conjecture, it was really done autonomously by an automated AI pipeline with a completely AI-generated prompt. No human expertise required at all in the process (well, except for the final human verification).

YeGoblynQueenne 3 hours ago||
Without human verification, an LLM can generate correct or incorrect proofs but it can't tell the difference. A human is necessary to be able to tell one from the other.

Saying that's a solution "done autonomously by an automated AI pipeline" is like saying that a self driving car that can only take you to the nearest train station after which you have to ride the rain to where you're going is "autonomously" driving you to your destination. Which is exaggerating the autonomy of the system, rather.

jdw64 14 hours ago||
What I'm feeling is that there's a need to study how to use AI well. I've seen professors using AI, and it was amazing. In that sense, I think AI prompt input will become stratified. In the past, implementation skills were very important, but these days, concepts feel more important this is one of those things.

It's not that AI brings equality, but rather that the output varies depending on how much background knowledge you have. You could call it a stratification of input

I'm starting to feel like there's no place left for programmers like me who focus on quickly churning out MVPs.

semiquaver 13 hours ago||
You’re at least 18 months out of date claiming that prompting will be the new hot skill. Turns out LLMs are also good at prompting other LLMs.
throwup238 13 hours ago|||
Calling it prompt engineer is doing it a disservice. With agents we’re well into process engineering, which is a ton more interesting.

The obvious baby’s first process is “plan -> execute” but as we learn about the strengths and weaknesses of LLMs you have to start unpacking that process into planning, prototyping, testing, validation, reviews, and tons of research. If you treat it like an extension of your brain that can automate some thought processes, it becomes a lot more powerful.

jltsiren 10 hours ago||||
One of the key skills of a professor is asking the right questions. Figuring out something worth working on, and then framing it in an appropriate way and asking questions that allow someone with specific tools and skills to make progress in the topic. Usually the tools and skills are those available to a new student, but working with an LLM is similar.

That skill comes with experience. Most people don't have it immediately after PhD.

WarmWash 10 hours ago||
>That skill comes with experience.

Well it seems more and more that 3 months of 500k GPUs churning through data 24/7 to build high dimensional landscapes also counts as experience.

brookst 13 hours ago||||
Ah, but who prompts the prompters?
jdw64 13 hours ago||||
I find it strange that people sometimes think of knowledge as 'public property for everyone.' The essence may be one, but the mental model of knowledge is individual. For an LLM's knowledge to become mine, I need to digest it to some extent.

And programming, as the programmer who created Eliza once said, is the act of becoming a legislator of your own universe. So even if there are black boxes, if you want to build a program that fits your own worldview, studying is essential.

cromka 13 hours ago||||
That doesn't make any sense; you can't have one LLM to read your mind to prompt another LLM.
semiquaver 12 hours ago|||

  > you can't have one LLM to read your mind to prompt another LLM
I’m excited to inform you that we as a species have developed a particularly useful facility known as Language which these LLM tools are evidently rather handy at wielding. This facility is particularly useful in this context when it takes the form of “dialog” or “questioning”, which can be used to propagate abstract ideas by means of mutually-feedback-guided-iterative-Language-use-turns, or more concisely, “conversation.”

One might even say that this remarkable facility can be used to “read” the ideas from one entity’s mind, such that after sufficient dialog the second entity obtains a (possibly lossy, but there are mitigations for this) copy of the ideas of the first. You might further be surprised to learn that this sort of idea-transfer business using language has already been happening in our society and species for quite some time indeed.

skeledrew 11 hours ago|||
Made my day XD
pessimizer 11 hours ago||||
This is a lot of words to say that a human can prompt an LLM to tell it what they want.

edit: it reminds me of all that I have to wade through after I've asked an LLM a straightforward question and the answer should have been "yes, you're right."

cromka 12 hours ago||||
You mean promoting, right? Did you read the thread?
thmoonbus 11 hours ago|||
so, promoting?
semiquaver 8 hours ago||
I would not characterize it thus.
sigbottle 13 hours ago||||
I'm going to keep on repeating this on HN threads until I'm blue in the face, but:

There are two ways to solve a problem. Either solve the problem, or deem it irrelevant.

The implication here is that, you, the human operator, clearly are just confused. The LLM knows best. You're just a stupid human. The LLM knows objective truth, you do not. You have concerns, questions, the LLM didn't understand your question "properly"? Do not worry, the LLM objectively knows the optimal course of action. It thought through the implications of what you said, took into account all possible data, and came to the objectively correct design for your software, your society, your life.

In some sense, this problem would have been a societal problem within the next several decades anyways, but it's been hyper-accelerated by AI.

xg15 13 hours ago|||
Waiting for the next Neuralink announcement...
cromka 12 hours ago||
That's still prompting, just justing a different interface.
jdw64 13 hours ago||||
Rather than prompt engineering, I think it should be called overall harness engineering. Anyway, that's how I feel these days
skeledrew 11 hours ago||
I think harness engineering is more broad, including not only the - system - prompt but also tools and skills made available to the LLM.
aprilthird2021 13 hours ago|||
And yet in this case a human prompted the LLM for this result, not another LLM
slifin 14 hours ago|||
I think there's a lot of interesting things to the side of development that don't get the resources they deserve

Debuggers, testing techniques, testing layers

Essentially things that could be used to ground your ai back to reality and work good for humans too

neonbjb 13 hours ago|||
I actually think people who are great at understanding problems, coming up with requirements and designing solutions (all things I would expect someone who is good at churning out MVPs would be good at) are exactly the people most empowered by the current batch of LLMs. Its the people who are only good at working on small chunks of problems that I'm concerned about..
aprilthird2021 13 hours ago|||
> I'm starting to feel like there's no place left for programmers like me who focus on quickly churning out MVPs.

Of course there is. The same way this was only possible as a result from the professor who prompted it with his specialized 10 page prompt and most importantly his deep knowledge of the problem space, the muscle memory and intuition you've built over the years is what will allow you to get more out of any AI than some guy who says "make a door dash clone" as the entire prompt

jdw64 13 hours ago||
So these days I've been writing down my thoughts on my personal homepage. Things I've learned, my background knowledge, and so on.

I've been realizing that there are more books tied to my background knowledge than I expected, but I'm not sure what will happen as AI advances further.

These days, I'm living for the fun of building my own personal wiki on my homepage

parasti 13 hours ago||
Why write it down? LLM crawlers will ingest it in a second.
jdw64 13 hours ago||
Sharing knowledge is good, but just because an LLM crawls it doesn't mean it fits my mental model. The act of writing is fundamentally about drawing the shape of my own mental model.
hilariously 14 hours ago|||
[dead]
redsocksfan45 14 hours ago||
[dead]
ck2 10 hours ago||
could machine-learning even handle a TEN PAGE PROMPT just a year ago?

this is changing my mind, at least about experts using advanced tools like any profession where it's like the magic of watching a lifetime of hard-earned skill at work

> After seeing OpenAI’s CDC result, I wrote a much more elaborate prompt following the same general methodology. My prompt is about ten pages long and attached at the end of the preprint (see collection of links below). There is a lot baked into this prompt, on approaches to try and also on how exactly the model should proceed, but it's built exactly in the style of OpenAI's CDC prompt. One note is that I gave it a relatively small error requirement, to prove the quadratic lower bound under order d⁻⁴ accuracy.

> After 148 minutes, GPT-5.6 Sol Pro returned a proposed proof resolving the quadratic dimension dependence at accuracy of order d⁻³. After checking things myself, I formally verified the proof in Lean, and it passed the formal verification check.

baal80spam 14 hours ago||
Waiting for comments saying that LLMs can't produce anything new and general goalpost moving.
qsera 14 hours ago||
From the post lol

>So I wouldn't really say that this result is using or creating some fundamentally new techniques in convex geometry or optimization theory. What this means from my perspective is that if a result is attainable with existing techniques, modern AI methods will be able to solve those problems. I don't think researchers in math/TCS will be made obsolete, but I think it will instead no longer make sense to work on any low-hanging, or even medium-hanging (you know what I mean) fruit. We'll be needed for problems where actual novel approaches are needed.

WA 14 hours ago|||
If knowledge is a Swiss cheese, LLMs can help fill the holes, but not make the cheese bigger.
peddling-brink 14 hours ago|||
Today maybe. I disagree in the long term.

While they’ll never have the same subjective experience as humans, what stops an LLM from applying similar lines of thought* in a manner that results in a novel conjecture?

They are prediction machines, and so are we in a way. We can give them nearly limitless resources to scale their predictive capabilities. We have billions of years of training baked in. They distill directly from our knowledge and can walk down paths that no human has before.

It’s silly to say they’ll never do anything novel.

At their current capabilities, it sounds like they are already capable of being a specific type is research assistant. What will that look like in 10-20 years?

seiferteric 13 hours ago|||
They also have ability to go deep and wide in a way that humans just can't. We have limits, get tired, distracted and biased where AI does not. I think there a lot of problem where all the information needed to solve them is there, but we just can't put the pieces together. Like no matter how many people you throw at some problems, you hit human limits and more people won't help, but AI will because it is just relentless.
qsera 10 hours ago||
>biased where AI does not.

AI can be totally biased...

The fact that it can spout bullshit all day long to a human who can be tired and would actually act on the said bullshit, is not very comforting...

For example, an LLM could confidently declare something a tired human would take as a fact, but would backfire in a real world.

seiferteric 10 hours ago||
Not really the kind of biased I meant though. There was a recent article about a AI disproving I think an Erdos conjecture by doing similar things humans have tried, but it was much messier and less "beautiful". I think it is a common bias in science and math that things should be "beautiful" but there is no real reason to think that.
qsera 10 hours ago||||
>what stops an LLM from applying similar lines of thought* in a manner that results in a novel conjecture?

One thing is that an LLM can never assume, or find out, an inconsistency in its training data. Novel ideas often require correction of existing assumptions. As far as I understand, it is impossible, by design, for LLMs to contradict what is in its training data.

For example, an LLM trained on the data from an internet comprised of people who believe in the earth centric hypothesis can never say "Hey, that cannot be correct", or come up with the heliocentric alternative

But maybe it is not applicable to pure Math...

WarmWash 10 hours ago||
They can, but it's limited to that specific chat context.
qsera 9 hours ago||
They can spot contradictions in the the prompt. But not in their own training data.
qarl2 13 hours ago|||
> While they’ll never have the same subjective experience as humans

You state this as a fact - are you aware the question is unresolved?

EDIT: I'd love to know why you're downvoting me for stating a known fact.

peddling-brink 8 hours ago|||
Ok, I guess never is a real long time and eventually when we merge our consciousness with the machines we may have the same subjective experience.

I can confidently state that GPT-5.6 Sol is not experiencing the same reality as me. They _might_ be "experiencing" and I personally think they are, but their reality and experience is not the same as ours.

qarl2 7 hours ago||
Well, sure. I'm not experiencing the same reality as you, either. I guess I assumed you were implying something more - a lesser experience or something. No?
skeledrew 11 hours ago|||
Fear spreads.
ben_w 12 hours ago|||
Famously, all of maths is axioms and tautologies, so I'm not sure this will assuage any professional mathematicians currently having an existential crisis.

Maths was already infinite, it's still infinite, but who wants to spend all their lives changing rooms inside Hilbert's Hotel?

tripleee 10 hours ago||||
this is a fairly bleak outlook even when you're trying to make it sound the opposite. Only the cream of the crop talent will have value going on?

Most of us aren't Terence Tao

monster_truck 14 hours ago||||
so it seems like The New Big Question In Math is

How's It Hanging, Brother?

throw310822 13 hours ago|||
The author explains he's an expert in the domain and that he had worked sporadically on the problem for about a year, also with the help of previous LLMs. So whatever he means by "I wouldn't really say that this result is using or creating some fundamentally new techniques" it doesn't mean that the result was trivial. Also, says it might not make sense to work on low or even medium hanging fruits in the future- and I bet that's by far the largest share of work for most mathematicians.

Sure, it's not a breakthrough that opens new roads in mathematics- is this where the goalpost has moved now?

qarl2 13 hours ago|||
HEH. Don't know why you're getting downvoted. It's painfully obvious that there is a vicious AI backlash now, where every amazing advancement is met with denial and loathing.

Oh wait, sorry, I do know why you're getting downvoted. Fear.

piloto_ciego 10 hours ago||
A lot of people who thought they were special and “better” than mere blue-collar workers are realizing that in fact;l they are the same just working with a different medium.
qarl2 10 hours ago||
I see a trend line from anti-AI back to anti-evolution to vitalism all the way to Galileo.

Humans have a deep need to be special magic flowers - and they can't stand it when science eventually shows them they're not.

dudul 6 hours ago|||
Humans just want to be able to work and feed their families. Notice how this is something that is never addressed for example in Asimov's writings where robots do everything. How do people do anything to be able to afford these robots? How do Solarians make money to maintain their massively gigantic estates? It is never explained, but we always jump straight to the "robots do everything, everything is free, nobody works". How about the in between?
qarl2 6 hours ago|||
Oh yes, I agree entirely. I look at The Jetsons or Star Trek, and I see the fruits of technology shared by all of humankind.

But if the current trends continue, Elon will own all of the robots and the rest of us will be at his mercy.

How we change that - I don't know. But I do know we don't change it by putting our heads in the sand. AI is here and it is real. We MUST take it seriously. Shunning is not a viable option.

piloto_ciego 6 hours ago|||
We're going to have to (collectively at some point) decide that we shouldn't tie survival to working.

Whether that's UBI, or Fully Automated Luxury Gay Space Communism, or UBS, or some AI managed economy, or some other such thing, we need to decide that "hey, we don't want to tied survival to output under our current system."

That's really the Rubicon we have to cross, and there are a LOT of people who can't really come up with a better way in their own heads yet.

Look, we all saw how things can be during the pandemic. That was a dark time, but it also gives us a model, we can just... do things. We just have to decide to do them.

dudul 6 hours ago|||
Oh! Damn! Stupid me! "We have to collectively decide this", when is the meeting to vote on that again? When is the last time we all decided something collectively?

WTF does the pandemic have to do with this? "dark time", oh yeah, people stuck at home watching Netflix, what an incommensurable suffering!

Buddy, I can admire the naive childish optimism to a degree, but come on. "We just have to all decide". Do you live in a Disney movie?

qarl2 6 hours ago|||
> WTF does the pandemic have to do with this?

I'm not sure, but if I may guess, I suspect he's talking about the fact that the entire US shut down for a year and people survived because the US Government printed money and gave it away free to businesses so they wouldn't collapse. (PPP loans.)

If we can do something like that for the pandemic, we can do something similar when push really comes to shove.

piloto_ciego 6 hours ago||
Thank you! We can decide to just... you know... do things.

Like, am I crazy here? The rules that we live by are largely made up and the points don't matter - we can decide to live in a better world if we want to. It's hard, and there are obstacles, for sure, but this appeal to doom for the sake of doom just... why? We have made unfathomable progress over the last century and if we keep trying we can make progress like that over the next century too!

dudul 4 hours ago||
> We can decide to just... you know... do things.

OK, this is Twitter-level conversation here, not interested. But hey, stay positive, more power to you.

piloto_ciego 3 hours ago||
You’re the one saying that we can’t. Not me.
piloto_ciego 6 hours ago|||
I mean, a at least something like million people died just in the US with the most conservative estimates that I've seen (and by 2022). It was pretty dark, yeah.

But we also decided during that time to literally pay people to stay home for awhile. That was a really revolutionary thing and it was awesome. We could decide to do that again.

You can ad hominem until the cows come home, but yeah, we literally just kind of have to collectively decide that there are better ways to do things.

There's a fantastic book called "The Last Emperor of Mexico" I read a few years ago that really talks about how the idea of a Republic or Democracy in general was a pretty novel concept in the mid 1800s. People were a lot more skeptical about it than we're lead to believe now. But eventually, the ideas of aristocracy and some "well bred" group of various types of monarchs became silly on it's face. Now the default is that we should have some sort of democratic representation. That would seem utopian AF in 1820.

Well, we're going to have to bridge that sort of gap for getting rid of the need to justify our existence through work too. The transition is going to be weird, but we'll have to come up with something else and run with it.

Dream big buddy, I know it's hard, lord knows I do, but dream big, and work little by little towards those things you want to see in the world.

emp17344 9 hours ago|||
[flagged]
qarl2 7 hours ago||
I hope you understand you're proving my point. Ad hominem doesn't fly well around here.
greenhat76 13 hours ago||
Oh brother I can tell you didn't read the entire article.
threethirtytwo 12 hours ago||
Genuine question: If you still or did think LLMs are just stochastic parrots that just summarize everything and have no form of creativity, what do you think after seeing results like this?

I'm very curious how people reconcile their fear/hatred of AI with actual objective reality. This is actually what interests me most about the whole AI thing. How we tell ourselves what we tell ourselves.

WarmWash 10 hours ago||
No matter what there will always be people who refuse to believe AI is anything beyond a string of if statements.
throwaway1707 11 hours ago|||
I had to create an account to respond to this because I am quite convinced these math problems they are "solving" are pure marketing. Why is it only GPT doing this, why not Claude? Why does Terrance Tao do marketing for OpenAI? I suspect OpenAI has hired math researchers to solve obscure problems and put them in their training set, purely for marketing reasons.

There was a good comment on the Pelican bicycle svg yesterday about how these models aren't getting much better beyond what the companies focus training them on. I think that's what's happening in this case too, they probably put this in the training set.

raincole 9 hours ago|||
It's such a weird train of thoughts lol. You're using the fact that

- Claude isn't doing that

as evidence to support the assumption that

- it's a marketing trick

Which is obviously non sequitur, as if it were a marketing trick, Anthropic could do it too. Anthropic isn't known for not spending on marketing.

Honestly, nowadays I question human's reasoning ability more than I question AI's.

Jweb_Guru 9 hours ago||||
> Why is it only GPT doing this, why not Claude?

Because Claude can't do it. Anyone who tells you that Fable is better than GPT 5.6 at pure math is lying to you.

threethirtytwo 9 hours ago||||
Terrence Tao getting paid by openAI is, to you, the most probable conclusion... much more so then the LLM actually being able to come up with math proofs?
throwaway1707 7 hours ago||
Terrance Tao has for a fact appeared in promotional material for OpenAI. Based on my Googling the consensus seems to be he is paid for it, but I cannot confirm that.

I do think it's very likely that OpenAI pays for solutions like these to put in the training set, and then we get material like this Reddit thread. They market themselves as selling "intelligence", and solving these math problems is something people view as highly intelligent. I'm not a mathematician, so I cannot fully judge it, but based on my experience using LLMs for novel problems in other domains, they seem to really struggle with things that aren't common. That leads me to believe they train for specific outcomes like this. Also, there are a lot of jobs out there for data annotation, including software problems (Meta has basically reorganized its entire engineering department to create training data for coding problems).

This comment on the Pelican svg better articulates what I'm getting at: https://news.ycombinator.com/item?id=48950883

Jweb_Guru 1 hour ago||
You can go through my commenter history and know I'm no fan of LLMs. I don't overstate LLM capabilities and am highly skeptical of them in general. 5.6 Pro is genuinely pretty good at certain kinds of math problems that just require trying out lots and lots of solutions, mostly because it's stubborn and can run a bunch of instance in parallel. It is NOT good at coming up with unique ideas or recognizing when its proof approach is doomed, and if the correct approach isn't in its "bag of tricks" for tackling a specific kind of problem, it is not going to get it without a lot of guidance. That said: I 100% believe that it's solved the problems people are claiming that it solved.

The way you should read this is (IMO) not that LLMs have somehow achieved AGI, but that a lot of mathematical research is more about knowing a huge amount of mathematical background, being stubborn, and getting lucky with an approach than it is about brilliant insight. Many people who don't think of themselves as particularly mathematically gifted could have made progress on these problems if they were given enough time and were interested enough. What's notably different about 5.6 (and born out in benchmark after benchmark) is that it does seem to genuinely "reason" through stuff at all -- without that, persistence is pretty worthless because the LLM just goes wildly off the rails if it's put to work for long enough (5.6 itself will still do this if it can't find an answer in a reasonable amount of time).

vanuatu 6 hours ago||||
kind of a hilarious conspiracy theory

You are correct that LLMs are trained on existing proofs but hiring researchers to solve unsolved problems is just unrealistic, both in terms of how none of the mathematicians simply came out and took credit for their own discovery or exposed this, and how training sets are not easily memorized (rather, the meta techniques are learned).

OpenAI just has better training methods and techniques for pure math over Anthropic, it’s one of their biggest strengths

frozenseven 5 hours ago|||
Terence Tao also uses Anthropic's models in his work. Oh, you didn't know that? Well, now you can pivot to saying that he's getting paid off by both companies. This is actually one of the hallmarks of both conspiratorial nonsense and military-grade cope. Any fact, regardless of how mundane or extraordinary, gets re-imagined as evidence of the same mad-hatter conclusion.

I hope people are screenshotting this stuff. This really needs to be documented. It's remarkable how wild it's getting.

barnacs 11 hours ago|||
I hold my stance that LLMs are stochastic parrots.

Making the parrots ever more complex and training on ever more data produced by intelligent, creative beings may make them more useful or convincing but does at no point give rise to intelligence or creativity.

qnleigh 8 hours ago|||
I won't touch creativity, but if this and other results like it do not demonstrate intelligence, what does? How was it able to solve problems that specialist mathematicians have tried and failed to solve for years?
barnacs 8 hours ago||
Mathematics is a language. If anything, it's much more well defined and formal than most others. Train on enough examples and statistical autocomplete gets you places. I'm surprised how anyone would even consider this intelligence?
tctcd6 10 hours ago||||
Comical human arrogance...
beering 11 hours ago|||
With such high standards, most HN commenters also do not have intelligence nor creativity. I don’t think we can set the bar that high.
slopinthebag 3 hours ago|||
They aren’t really stochastic parrots, they’re next token prediction machines. They aren’t intelligent nor creative imo. However they are quite useful at some tasks. Why would you assume people who don’t kneel at the alter of AI are somehow fearful or hate AI? Most of the hate I’ve seen have been for the people and companies involved with AI not the technology itself.
cindyllm 3 hours ago||
[dead]
qarl2 10 hours ago|||
Heh. I see you're being met with screeching and downvotes.

Not much to do about it, I guess, but continue to call it out.

pessimizer 11 hours ago|||
I'm very curious why people conflate thinking LLMs are stochastic parrots with "fear/hatred" of AI. It seems like you're arguing with people who agree that it works and it helps, but you're trying to insist that this implies that they should kneel down and pray to it.

Is "stochastic parrot" too disrespectful for you? Do you think it is a slur?

edit: and this is a genuine question, also. How do you do stochastic parrot = "just summarize everything" = "no form of creativity" = "fear/hatred" so quickly?

Are summaries not creative? Are Maxwell's equations not summaries? Do people hate and fear parrots?

qnleigh 8 hours ago|||
I have absolutely no problem with people disliking or fearing AI. It's energy consumption, effects on education and potential for displacing good jobs are all quite disturbing. But "stochastic parrot" means that "all it does is randomly repeat things that it has seen before without understanding them." It's infuriating to see this written about an instance of an AI solving an open math probably. Do you think the models are just randomly repeating facts until they accidentally emit a proof? If so, then how do they synthesize that knowledge into something logically coherent?

Alternatively, if you think that even Maxwell was a stochastic parrot, then presumably almost every human who has ever lived was also a stochastic parrot except a few rare examples like Einstein. Not sure what definition you are using but it seems too broad to be useful.

threethirtytwo 10 hours ago|||
I think it's quite clear the proof here shows that it is not a parrot. It objectively isn't.... that's the only rational conclusion. Yet many people claim that it is, so the main conclusion is fear/hatred is causing people to rationalize their logic to fit the narrative they prefer.
slashdave 11 hours ago||
Must be nice knowing you have a clear understanding of "objective reality" that others don't.
threethirtytwo 10 hours ago||
Is it not objective reality that the feat performed by the LLM here is much more then parroting or summarizing something?

It's doing math proofs. At this point, it's fully clear that objective reality is that the LLM is not parroting anything here.

slashdave 8 hours ago||
It's parroting proofs. This is no different than parroting a story.

https://lean-lang.org

elhart05 13 hours ago||
[dead]
luciana1u 12 hours ago|
[dead]
More comments...