Top
Best
New

Posted by srcreigh 21 hours ago

We're gonna need a lot more mathematicians(terrytao.wordpress.com)
357 points | 460 commentspage 4
beebmam 17 hours ago|
I think understanding the output of AI will become more and more likely impossible. It's not necessarily a bad thing, if we can benefit from AI produced knowledge, even if we didn't get there ourselves.
robotpepi 17 hours ago|
The point of the post is that what you call "AI knowledge" is not knowledge.
novia 13 hours ago||
I keep clicking through on these because I am curious about what Terrence Tao has to say, and then they are always guest posts.
atleastoptimal 19 hours ago||
It would be nice to have more mathematicians, but we don't need more. Once AI math goes so far beyond human abilities, any human involvement is like an ant trying to understand quantum physics
jahbrewski 19 hours ago||
Even if that happens, what’s the point if there’s no human involvement? AI doing math for math’s sake? And doing what with it?
tappingdance 16 hours ago|||
I think it is like saying what is the point of playing chess when you can never beat stockfish?

What is Magnus Carlsen going to do when he can't beat the computer?

It seems like a category error between humans using tools and humans building tools.

There is not much point in trying to figure out a better chess engine. There has never been a better time though to want to learn chess.

I find the idea that the computer will discover mathematics and humans call it a day rather ridiculous. As if humans will not then spend their time understanding and incorporating the ideas from the computer.

Alphafold is a better example. Alphafold is only bad if you spent your life trying to solve protein folding. But even if you did, that is the same person who is the most setup to reap the benefits of the unlock in the pragmatic application of protein folding.

We don't figure out how to get machines to harvest corn and then spend all day sitting around eating corn in between naps.

itishappy 19 hours ago||||
> AI doing math for math’s sake? And doing what with it?

Stuff! Inscrutable stuff, maybe, but that's not "doing math for math's sake."

rudy6912 19 hours ago||||
> AI doing math for math's sake?

Yes, why not? And, of course, AI doing math for AI.

We may not be needed forever...

alex_sf 19 hours ago|||
I don't understand how to make a modern CPU. I'm not involved in the manufacturing of it. From my perspective, there may as well not be any human involvement. I can still use the resulting chip (in an larger system of other things I can't make and wasn't involved in) to argue with you on the internet.

It becomes another abstraction, really. As long as we can use it for something useful, it's still valuable.

awepofiwaop 19 hours ago|||
At some level of abstraction it's all built around allowing you to do some work/play/etc that you understand. Some of that work allows you to make money and eat food.

If the LLM is operating at such a high level that it never actually constructs a useful product for humans to use, then how will that be good for humanity?

itishappy 18 hours ago||
> If the LLM is operating at such a high level that it never actually constructs a useful product for humans to use, then how will that be good for humanity?

If you replace "LLM" with "mathematician" than this is the state of the world today. Stuff like Galois theory is beautiful mathematically, but what has it constructed or enabled for you and me?

altmanaltman 18 hours ago|||
There is a difference between manufacturing and design. Yes manufacturing is largely done by machines because of the nature involved but to look at a cpu and think 'no human was involved in creating this', you're wrong and also insulting to the humans who actually worked on things that led to the cpu and the manufacturing process.

A cpu (the physical thing that sits in your mother) is not an abstraction, what are you talking about

aesbetic 17 hours ago|||
I think a better analogy would be comparing to an ancient human instead of an ant. An ancient human would have none of the basic abstractions that we take for granted today like literacy and arithmetic, so it would be very difficult for them to even attempt trying to understand quantum mechanics. But I don't think it's impossible because our ability to learn by stacking abstractions is basically endless——so far as our health permits at least.
dgacmu 19 hours ago|||
We've been those ants for a million years, and only in the last 100 did we start to wrap our heads around quantum physics. We are the purpose behind creating LLMs. There's plenty in the universe we don't understand, and it's very human to keep striving to do so.

If you believe that math is discovering, it's natural to think that all of that AI math already exists and is just waiting for us to find ways to discover and understand it.

Don't write us out quite yet. :)

joshmoody24 17 hours ago|||
Or maybe ants and humans are qualitatively different. Maybe there's a critical mass of intelligence where you can pretty much understand anything, and maybe humans are past that threshold. I don't know that for sure, but I don't think we're anywhere close to hitting fundamental limits to our ability to understand the universe.
gaigalas 19 hours ago|||
Need? We don't need lots of things, including computers. We did well without them for hundreds of thousands of years.

We want to understand. Quantum physics, mathematics, how stuff works. Ants don't.

That want is not a given, not all of us have that drive. In fact, very few of us have it. So far though, it seems multiple disconnected civilizations learned to keep that trait going instead of suppressing it and focusing only on practical ant-like activities.

rvz 19 hours ago||
> Once AI math goes so far beyond human abilities, any human involvement is like an ant trying to understand quantum physics

This makes no sense whatsoever.

We need more, because there will always be far more difficult problems yet to be discovered and solved, and that means, we certainly need expert humans to define and verify them.

If you cannot even explain the problem you are facing, not only you don't understand it, but you certainly would not be able to know if the AI solved your problem correctly.

WarmWash 19 hours ago||
>and that means we need expert humans to define and verify them.

And this will be true for how long? 3-4 months?

xanderlewis 10 hours ago|||
Do you seriously think that in four months’ time all of mathematics will have been ‘completed’ by AI?

We were told in 2023 that there’d be no more jobs within months and the singularity was here. At some point you have to realise it’s not happening.

Let me know when the other (much harder) millennium problems get resolved, let alone explained in a satisfactory way.

WarmWash 8 hours ago||
>We were told in 2023 that there’d be no more jobs within months and the singularity was here.

I never recall hearing that other than from people strawmanning what the labs were saying.

It's the same as conservatives who tirelessly repeat "In 1995 they told us the world would be underwater by 2015, those climate scientists are full of shit" - no, no one ever said that, you just listen to grifters who only can strawman.

xanderlewis 6 hours ago||
Actually it was mostly said by the bonkers AI-obsessed Redditors (for whom it seemed to be the absolute consensus), though the tech bro CEOs like to allude to it too. They just make it just vague enough to scare investors and governments but also be plausibly denied later when it turns out not to happen.

By the way, I don’t think climate denial has (or at least should, though I know Americans like to politicise everything under the sun) anything to do with ‘conservatism’.

rvz 19 hours ago|||
As long as there are problems to discover and solve, which is forever.

The risk of liability is a social problem that is far more difficult to be solved with technical solutions even with AI.

asdewqqwer 13 hours ago||
Always confused by text website that tries to prevent people from select or copy or right click.
class3shock 12 hours ago||
"Imagine that a future AI system proposes a radically new design for a one terawatt nuclear fusion power plant."

I propose we enact a new law that makes it so ai engineers can only fly on ai designed planes powered by ai designed engines flown by ai. Maybe then we'll get some real progress out of this slop producing crapware or the problem will be solved a different way.

newterminus 15 hours ago||
you arent a real mathematician unless you lay around all day thinking about shapes
altairprime 14 hours ago||
> I have in mind something like a “deployable intellectual reserve”: communities of mathematically sophisticated people that humanity can call upon to help understand consequential AI-enabled breakthroughs.

I can’t afford to be one of your credentialed reserves, Amit. ADHD screwed me over in early life or I’d have breezed through that dual masters in cognets/compsci by 2003, and now that I’ve stabilized my brain and am burning through years of school at a rapid pace, my country’s socioeconomically ruined — I’ll be lucky to escape with my accounting degree as my school is visibly being sucked into the vortex every year I progress. The only hope left for me to be what you need of us is to self-study, but without a degree I’ll just be treated as a crank or an AI proxy/puppet if I slip up and talk about interesting math with anyone, so what’s even the point of taking that path? I originally pivoted my math skills into systems theory and process diagnostics instead, which of course now everyone has kicked to the curb and replaced with AI. I’d have made an excellent Susan Calvin — I was working to be a cognitive tech with diagnostics, zeroth law, and group psych specialties, AMA! — but the financial investment to provide the runway to take that lonely, dreary six year slow as molasses slog through maths that universities think is somehow an appropriate teaching velocity (six months for precalculus alone?!) in order to earn the mere chance to have my resume rejected by an AI firm that uses AI hiring and and can’t tolerate someone with a strong moral position regarding societal harms is a very bad choice, whether you use simple probability or game or systems theory to evaluate it. Taking that quarter-mil-plus burden as loans in the hopes of employment at the other end in a field actively having its social, reputational, and moral fabric being ripped apart by AI? That’s not just a bad bet, that’s chasing fool’s gold at the end of a fading rainbow in a desert mirage. So, with sincere apologies, while you’d benefit from having me on your ‘reserves’ list (I have written testimonials spanning some twenty-plus years to that effect) I’ll never come to your attention as a support tech or as an accountant, and I accepted that outcome years before anyone else realized this need for cogsci mathematicians with a teacher’s specialty of analogy-building and the ability to disregard interpersonal nonsense to focus on the needs of societies. Better luck with the next generation, though!

smolder 13 hours ago||
Mathletes, assemble!
calf 18 hours ago||
I think this is the most beautiful letter on the subject I've read all year, it brought a tear to my eye. It's like reading those famous STEM letters/essays from history.
srcreigh 17 hours ago|
I agree. I believe it could be the best piece about AI ever written. The themes of lost dreams reawakened, sobering up of egos, sci fi technological development, the role of humanity. It’s a weird feeling to see that it’s actually really happening.
antonvs 2 hours ago|

    ....-----

    ---/Shark\---Terry Tao
More comments...