Posted by auggierose 2 days ago
I’ve always been at a disadvantage academically because I’m rather clumsy with my manipulations, derivations, and I’m a disaster at mental arithmetic. I’m also dyslexic. But starting in the late 1990s when I was in High School I started to become fluent with CAS (Computer Algebra Systems): first Derive, then the Symbolics capabilities of Mathlab, and ultimately Mathematica.
The whole transition is turning out quite well for me: I’m now able to delegate exploring my intuitions to increasingly powerful tools, I no longer have to haul the pyramid blocks up the ramp myself but I can drop them in by helicopter (as if were) and what I bring to the party is intuition and understanding.
I view it a bit like astronomy: in ancient times, before telescopes, keen eyesight was a prerequisite to be an astronomer. Later, after telescopes, anybody with eyesight had enormously enhanced capabilities of observation, and now, with radioastronomy and other forms of remote sensing (neutrino observatories, gravitational interferometers) the whole field has opened up to people who by virtue of being blind would’ve literally been excluded only a few decades ago.
Go forth and multiply: everybody can become a mathematician now. There’s an infinite number of potential universes out there with an infinite number of facts to prove and disprove. And while we’re at it: there’s so much more to mathematics than conjectures, proofs and counterexamples. Solve, model, approximate, fiddle around: as long as you’re not doing trite numerics on arbitrary systems of equations you’ve cooked up for your own amusement you’re good in my books.
Enjoy the tools. Keep your wits about you. Work through the steps that are presented to you. Build your intuition. HAVE FUN.
Hauling the pyramid blocks is what gives people intuition and understanding. It is true that school systems usually have way too much computation -- it is easier to test and grade computation. But the only way that you were able to use computer algebra systems fluently is because you had internalized how algebra worked by hand. If we tell students that they no longer need to learn how to solve equations we are seriously depriving them of a mathematical education.
I have no idea how assembly works - in my years of experience I’ve never had an issue that required I dig that deep into it. Does that mean I can’t be effective with higher-level tooling because I do not know the absolute basics?
You can be effective at using C# and F# to solve other problems specifically because they are very well designed at the goal of abstracting over the lower level hardware. But if your goal is to build an intuition of how programming languages themselves are implemented and how computer hardware works, then, using those languages will be counter productive.
If you're trying to use math to solve arithmetical problems, then by all means using AI to help. But if you're trying to advance the math field itself, then actually knowing how math works is probably essential.
Put in more concrete terms: if someone wants to be a working mathematician without learning the fundamentals of math, then how do they even know what prompts to the AI are worth writing? In what way are they adding any value to the process at all?
Secondly, I've encountered compiler bugs many times, so it is very helpful.
That's the difference between a senior and a junior: the junior goes to the senior and the senior figures it out. You can remain a junior at any age.
To further underline the point: entire cultures' musical traditions don't follow the circle of fifths, or notation as you're likely familiar with it, or even notes that follow the kinds of ratios you might use to describe western musical scales of any kind. The mathematical representations of western music were applied in retrospect, math never played any role in the development of western music anyway.
So considering math was never a factor in the development of western music and the math used to describe western music doesn't even apply universally, i just can't really consider "music is math" to be a meaningful statement at all
You can use AI like a telescope, and alleviate your inherent organizational problems or other ailments, which in my opinion is a great use case, as it is empowering. But there will also be plenty of people who are not looking to alleviate any mental/physical quirks they have to do more, but simply want to make a "quick buck" for the least possible effort from the work and thinking of others, without adding much value of their own. Lowering the bar makes things easier for both, the ones who bring value and the ones who merely exploit in some context.
this is insane. the "speciesist" people aside (the best way for all other species to flourish is for humans to eradicate themselves right now, which is completely mad), i have the opposite problem: the _axiom_ seems to be: we should help ME flourish. "Me" as in people who are raking in trillions for their own very special selves right now, at the cost of everyone else's future, while none of them can be trusted to hold my cell phone for a second.
> if an industry commits to the axiom of helping humanity flourish
where does he see such industries, outside of maybe nonprofits?
> this is insane. the "speciesist" people aside (the best way for all other species to flourish is for humans to eradicate themselves right now, which is completely mad), i have the opposite problem: the _axiom_ seems to be: we should help ME flourish. "Me" as in people who are raking in trillions for their own very special selves right now, at the cost of everyone else's future, while none of them can be trusted to hold my cell phone for a second.
I don't think there are actually any "speciesist people." I think most, if not all, are the selfish "me people," who have disingenuously created "speciesism" by mad-libbing racism and sexism in a ham-handed attempt deflect criticism/opposition to whatever they want to do. Most of them aren't even "raking in trillions," they just don't like thinking about others or being told "no."
Ok, sure. But I was talking speciesist vs AI. Is there anyone who would genuinely put AI above on on part with humanity (beyond the rare nutjob weirdo)? I think the people who trot out "speciesism" to defend AI don't care about the consequences and just don't want to be told "no."
Every time I see something like the Panama or Epstein files I just get reminded how many people there are in the world doing weird shit.
That wouldn't do much for rice, pigs, chickens, or rats.
> Even rats.
...what do you think "even" means?
lol quantitatively well
> Po-Shen Loh (Chinese: 罗博深; pinyin: Luó Bóshēn; born June 18, 1982) is an American mathematician specializing in combinatorics. Loh teaches at Carnegie Mellon University, and from 2014 to 2023 served as the national coach of the United States' International Mathematical Olympiad team. He is the founder of educational websites Expii and Live, and lead developer of contact-tracing app NOVID.
That's why it's important to convince people to not try. It reduces the medium term risk to investor returns.
Does anyone actually beleive Musk works 12 - 18 hour days?
He hires the right people and his companies solve hard problems, but they make a few electric cars, design and build some rockets, and launch some satelites. Most of that shouldn't require much of Musk's time since he has experts working on it.
Other than designing new rockets, there doesn't seem to be many new innovations coming out of Musk-owned companies.
To me, it feels like we all think he must be doing a ton of work even though his companies don't seem to be generating much output.
I don't know who's saying that. Of course he's smart, but the amount of hours he works each day is almost certainly exaggerated to maintain this "Tony Stark-like genius narrative" he needs to keep the money coming in.
Elon knows how to hire, how to raise money, and how to profit from govt subsidies. That doesn't mean he's this lone genius who works himself to death, and that's a very unlikely story.
What else has he delivered?
I can't believe the rewriting of history on this topic. They were definitely not popular. The Model S had just been released 14 years ago. They were not popular. Tesla transformed the world in terms of rolling out electric cars.
> There are now multiple groups with reusable rockets
Not really, and nowhere near the same operational experience. They are still figuring out Starship. They're deploying new types of Starlink satellites.
This is an utterly insane thesis.
The things you're talking about aren't things Elon is likely spending his days on. He has teams of people marketing Tesla and working on improving starship. Do you think Elon is actually handing design himself vs sitting in a bunch of meetings and giving feedback?
If he isn't doing the hands-on work, so you think he's in 18hrs of meetings each day?
However I can answer your first question: I've no idea what Elon Musk does, but obviously he has a lot of very very bright people working for him. Just as how Bill Gates wouldn't write specs but he would critique them in detail[0] to make sure that the right things were being built. Whether or not that's "sitting in meetings" or "handling design himself" who knows, because I don't know what "handling design" means, and why it wouldn't involve meetings.
[0] https://www.joelonsoftware.com/2006/06/16/my-first-billg-rev...
i had hoped him lying about being an amazing video game player, literally paying someone else to play for him and taking all the credit, would open folks' eyes to the fact that he lies about the most basic things
Most of the rest of us understand that once you've said enough brazen bullshit, you forfeit the right to be believed.
But who knows, I could be wrong.
I'm not exactly a fan. I'm not exactly against him either. He just seems like a hardcore geek to me that got way too much money and way too much buy-in.
[1] I'm not saying I that I think he was fixing democracy. I'm saying that I think that he thought he was fixing democracy.
i have no desire to defend musk but imo people should be criticized for valid reasons or you risk diluting the other arguments.
You introduced a separate issue that is much more widespread, but that doesn't detract from the original criticism, nor dilute it.
I don’t think we need to over complicate a megalomaniac desire for more power and wealth.
But when he started it? Nah
moonshots are the external story told to maintain social acceptance. tax credits for spacex would be lot harder to sell to taxpayers if everyone unambiguously knew its just another profit seeking private company. tesla gets a lot of lenience because of its supposed pushing of frontiers.
musk can exchange his social capital to manipulate stocks to make others money in exchange for backchannel favors.
idk if musk actually believes mankind will terraform mars but he sure seems to be getting a lot back on earth from saying it.
This is the biggest lie in today's society. "Make money from assets". There is no such thing. Money cannot work. People can work. He's figured out how to extract a lot of money from his employees, without them realizing the trick that's being played on them.
None of those other goals are in the remit of a company in a market economy. You might as well be complaining that a horse can't sing.
You might as well say "That crypto scammer is just following his goals of making money. Don't complain that he's taking people's money for nothing, that's just his goal. He's just 'good at marketing'. He's just an 'entrepreneur'."
Let's at least call a spade a spade and admit that there's no such thing as "making money from assets".
EDIT: real mature response, LMAO. I'm the "delusional" one while you're believing that Musk's money is walking around building rockets.
Let's flip your comment to demonstrate how much substance it contains:
> You're demonstrating a completely unhinged lack of understanding of the Labor Theory of Value, and it looks like you are buying into the ridiculous Market Economy delusion there. I apologize if my response didn't correspond to your delusions.
I can only assume motivated reasoning on your part. Surely you must own a lot of capital, if you're defending it so hard.
I apologize if my response didn't correspond to your delusions.
At least me, I haven't seen any paper bills walking around screwing rockets together. Perhaps Musk has a bunch of coins putting together data centers for him? Perhaps he's writing a check and leaving it to code up new features for twitter for him. Hmm, I've never seen a check use a keyboard. But I guess it's possible. I'd be delusional to not believe it.
Surely it's not poor people in Africa mining metals to put in those teslas? No, no. It's his money that's going down into those mines. Just a stack of bills wielding a pickaxe.
Oh, did you mean he's just renting out his "assets" to people? In other words, restricting access unless people pay him. Well, there are terms for that [0] [1]
Oh, wait, maybe you mean he's like a drop-shipper but for people's labor? Buying cheaply and reselling at a markup, without adding any real value? Well, that is surely a commendable goal. Market efficiency!
[0] https://en.wikipedia.org/wiki/Rent-seeking
[1] https://en.wikipedia.org/wiki/Usury
( For the record I didn't "flag" your response above, I think it's just annoying when people do that as it disrupts the discussion, now people can no longer refer back and see what was said. But oh well, I've been on the other side of people "flagging" stuff just because they disagree with it too. )
It's about many things, but perhaps the most relevant idea here is that no information matters without understanding. We could generate all possible knowledge, but unless someone--a human--can verify and understand it, it doesn't count. The cure for mortality could be written on the moon, but if no one reads it, it hasn't really been discovered.
[1] https://maskofreason.wordpress.com/wp-content/uploads/2011/0...
One counter-point: Humans have not figured out how general anesthesia works, but we use it every day to great effect.
https://en.wikipedia.org/wiki/Theories_of_general_anaestheti...
Same with the black box part of AI. What the weights represent? Arcane dark magic if you ask me. What do they do? Well with LLMs we're all experiencing it.
How do we know the person getting anesthesia doesn't die and a new soul/consciousness replaces them?
(We can ask the same question about going to sleep, er even walking through a door, but it's still something to think about).
Recall also that LLMs are not actually entities. In their current form, there is no sentience, there is no agency. They are tools. Therefore, their output must benefit the user that requested it. Right now, that's humans (and, ideally, the planet at large; we don't exist in a vacuum) and so it makes sense that humans should verify that output and try to ensure that it aligns with their goals.
That's not to say that the output of an LLM is useless, far from it. But we should still *try* to understand its output. It gives us at least some chance to notice flaws, and an even greater chance to appreciate the implications and tradeoffs of the solution it picked.
But extra lives saved definitely counts for a whole lot and is definitely useful.
One comparison I see: there are so many religious people that simply wish they are saved from their cancer (or whatever else). They pray for it. They don’t care how it happens. They simply want to live longer, etc.
It’s a sketch of an argument, I hope you know what I am getting at.
Of course we have also convinced ourselves before that cocaine in drinks, lead in petrol, asbestos in walls… were all safe…
This reminds me of the Feynman interview where the interviewer asks "how do magnets work" and he goes on this rant of how that's unanswerable and you have to decide on what is it you really want to ask. You can't expect to know the full chain of knowledge because at some point you will be asking about quarks and gluons and then hit a wall where "nobody knows". Similarly you cannot simply just give up any investigation at all because then you'll end up recommending people to put lead in their cars.
I'm a little more flexible, if the new knowledge (that human's don't understand) can be put into a mechanism and have an observable effect, I'd be happy enough. e.g. a new type of rocket fuel that burns 1000x more efficiently.
We know how to apply LLms to problems, which is a subtly different thing to understanding how they do what they do. It's similar to fire: I can cook using fire, but I don't really understand how fire _works_. Heat+oxygen+fuel, sure, but what goes on chemically? I dunno. Doesn't stop me using it. (Pretty sure _humanity_ knows how fire works, though).
If I vibecode a video game and manage to sell it on Steam, the information definitely mattered even though I didn't understand any of it.
There are drugs that nobody truly understands how they work and they are being used by professionals in actual treatments literally right now. We know purely statistical facts like "if drug X is used for condition Y it will help Z% of patients" and can only speculate as to their mechanism of action. They are used anyway and still benefit a lot of people.
Why though a human? Mathematical proofs are very ivory-towery, but if OpenAI would solve a subkind of Cancer, without mortal humans understanding, cancer is still be healed.
The AI we currently have can't do that though. The AI we currently have is a glorified chatbot. It can't fabricate anything and I doubt it could even reliably design simple real world devices.
It's a really cool and useful technology, and maybe one day it will be as good as you describe, but right now it just isn't and there's no guarantee it ever will be.
"I own nothing, have no privacy, [never have to think, and am not required to solve any problems,] and life has never been better."
https://en.wikipedia.org/wiki/You'll_own_nothing_and_be_happ...
Does it need to be a human or can it be some other form of life?
Math is meaningful because ... some people like to do it. The same as any other human pursuit. It doesn't need a reason beyond that. And AI won't change that. There will continue to be things to explore, things to find out, things that are maybe just at the edge of AI's reach and needs a human to decide whether it's worth continuing to explore or not. (Remember, AI isn't free).
So, IDK, I think for people who enjoy exploring math, there will always be interesting areas to explore. AI just gives us a better flashlight.
BTW I do agree that there's going to be an incident soon, whether intentional, accidental, or paperclip-factory, that leads governments around the world to shut all this down for some time, perhaps even shutting off access to GPUs entirely. It seems unavoidable. But that's just a temporary respite and skirts the core philosophical premise of the post.
I guess Terence's main point has been all the time that if we let AI solve all these existing problems, we don't notice the new ones and then there is stagnation.
The universe is bounded by rules, as far as we can tell, and not a lot of them
> The universe is bounded by rules, as far as we can tell, and not a lot of them
Respectfully, this is not a useful frame for the discussion. Nobody is expecting to reach the limit you have noted either with or without the assistance of LLMs. So there is always more math that could be done.
In our lifetimes computers have made a lot of combinatorial and graph questions meaningful that otherwise would not be interesting.
We can conceive of lots of mathematics that our own universe doesn't necessarily support. But only that much and no more: we're still made of stuff inside the universe, and so are our tools, so there are upper limits on our conception.
That's physics. Not all math is physics.
At those levels math and physics are the same bound: the bound of things the universe allows to be conceived of inside it.
It’s possible the math our monkey brains + sand can ever conceive of in this universe is a low and accessible amount.
When you have a moment, please reference some proofs supporting this.
That’s true of all humans and all constructs.
So however much math there is to discover, that’s the finite subset you’ll ever have access to.
It’s hard to prove what thoughts no human and no construct is capable of generating, but surely there are some, and it’s possible or even likely some of those are math-related.
By analogy, the "amount of math" we can possibly discover could still be countably infinite even if the space of all possible thoughts would be uncountably infinite. Countably infinite is still plenty big, and it is certainly not finite.
We (or our constructs) can plausibly mine all there is and then there's no more that's physically possible for us or our constructs to mine within the universe in which we exist.
If an ant can't conceive of or perceive trigonometry that doesn't mean trigonometry doesn't exist. But if neither an ant nor a human nor any creature or construct or technology inside the current universe, now or ever, can conceive of or perceive trigonometry, then we might as well call it non-existent. It may exist: but we'd literally never know it and neither would our constructs or space aliens or inter-dimensional aliens, or their constructs, etc.
Say that there's a level of mathematics at which a blerg is a zorg, but our universe includes neither blergs nor zorgs and no intelligences in our universe can conceive of blergs/zorgs because that would require having evolved outside our universe... in that case we can consider our universe's mathematics solved without it needing to work down to the blerg and zorg level.
Edit: actually, forget about the above. I just find it very annoying when people dismiss good conversations with not-so-good jokes.
I find it curious that you've protested against that joke but not against the statement that "it seems likely that there's a finite number of interesting math problems". It doesn't seem likely to me personally and I haven't seen proof of that, even in a joke form. There's a finite number of problems at any given time, obviously, because mathematicians are finite, but it would require a very good understanding of the whole of our mathematical knowledge to declare that if we keep expanding it we'll hit some kind of wall, of "interestingness" or whatever else.
Secondly, I stand by the statement that there is no merit to this joke. This is because the way it defines interesting is very hand-wavy. There are interesting and non-interesting problems, but by a sleigh of hand you can turn the non-interesting problems interesting, thus proving that basically everything in the universe is interesting. At least in the mathematically describable universe. When everything is interesting, nothing is interesting. So we can dismiss the proof as a silly joke.
What mathematicians find interesting is a different story. However, we can almost certainly say there is only a finite number of problems mathematicians as physical beings can solve. If we have 200 mathematical symbols at our disposal, and we consider all strings of these symbols of length 1000,000, we have captured all the descriptions of problems that fit to 1M symbols. But that's a finite number. Going beyond that starts to be difficult for a human to grasp (if 1M is not too much already), so all mathematical problems that are solvable by a physical mathematician are in that set of strings. And that's not even saying anything about whether or not they're interesting..
By the way, if I'm not completely mistaken, Gödel's argument to show the incompleteness of mathematics relies on encoding all mathematical statements as numbers. So I'm certainly not being very original here.
This isn’t an enormously important point - the actual question at issue is an empirical one, “in a steady state, can we produce interesting problems at a rate that exceeds our ability to solve them and integrate our understanding” or something like that - but I did rankle at a “trivial” proof which is invalid due to equivocating between multiple definitions of the word “interesting” (which should really take an object, “interesting to me” vs “interesting to something smarter than me”).
I (a human) am interested in things that are applicable to my realm of understanding, but I see a very plausible future where novel and/or valuable results leave that realm.
I'd further argue that's already the case for most math for most humans. What's interesting to Terrance Tao is rarely of immediate interesting to me.
Meanwhile, as people got used to the clock, the society became used to staying in synch at hour and sub-hour intervals. As better clocks were invented, synchronization became counted in minutes. This simplified things, allowing people to do more in the day and coordinate less, as they learned to rely on agreements to independently do things at specific time. Shops started posting opening hours, school started posting lesson plans, professionals started billing by minutes.
Clocks became widespread, and synchronized remotely - first from the church clock, then over the wire, over the radio, finally over the Internet. The loss of shared time reference at minute-granularity became rarer and rarer, until it became unheard of (except in excuses of those who failed to keep their commitments).
Losing a clock now would indeed throw society into disarray. If all clocks magically stopped tomorrow, many would starve and die before society figured out some way to restore time-keeping by proxy.
Clocks are a perfect example of the ratched effect of technology. A new technology at first helps you, or gives you advantage. As it spreads out more, it becomes relied on. Eventually, reaching ubiquity, it becomes a dependency, and everyone is assumed to be using it.
In a modern society, you cannot live without a properly synced clock anymore.
In the story, the baker was the only one left with that ability, as others left the skill behind when the clock became the authority.
This problem has been seen when missionaries, or whoever else, try and bring tribes into more modern civilization. They have trouble adapting to modern civilization, but the skill loss during that process makes it almost impossible to go back to the jungle.
When skills are lost due to modern technology, it isn’t so trivial to get them back. Look at how much time people have spent trying to figure out how stone was moved in ancient Egypt, for example.
Sunrise changes throughout the year. Sunrise in December and July are not the same thing.
To set the clock, they’d need a reference for the solar time to clock time for the current day.
I ran into this in Rome when I visited last year. A church there has a giant solar clock where the sun shows up on a line on the floor at noon (or so I was told). At noon, nothing happened. After thinking for a second, I realized I would need to find solar noon, and went to Wolfram Alpha to find that solar noon, in Rome, on that day, was 1:19pm.
The other option would be for the town to arbitrarily set the clock to solar noon one day, and just go with it, letting the drift be the drift. But the time would not be the same as it was before the reset. It could be an hour or more off.
Math has built a gated, inaccessible institution which - by design or not - served as a moat.
I believe math has little to do with mathematical notation - intuition is much more important. One can have intuition but not be able to “read math” - much as many musicians don’t “read music”.
Reading math however does not guarantee ideas or intuition. And those are what math needs.
I loved mathematics when I was young and wanted to be good at it, but I got burnt so many times by teachers who could not explain even if their life depended on it.
Asking an LLM and discovering how different theories belong together and what are genuinely open questions, along with different philosophical interpretations has been a wonderful gift.
I have long accepted that Mathematics is a language where you must go "all in" because for the most parts institutions are fundamentally unable to explain it in an intuitive way. There are people who "just get it" and are blind to the struggle of people who need a different approach in learning it. There's something about the field where a generational survivorship bias has created an environment where math is mostly taught to likeminded people, who then don't see why anybody could not see the difficulties learning it.
I know this is not true everywhere, but the only reason I could finish my studies was because there are some genuinely excellent online lectures on youtube, along with massive support from friends who have already been through the ordeal.
If I had had access to an LLM, I could have actually taught myself from scratch and be more playful in learning it. And no, I am not willing to learn lots of math "for fun", I can think of better "for fun" things that actually help my profession and cater to my actual interests and not just some academic ideal.
A good human on the subject will do better, and I'm not claiming the LLM has "understanding" in any philosophical sense. But it's more useful than something that just regurgitates material.
For undergrad math, sure, and again, I think it's often because on some random corner of the internet someone else had a very similar misunderstanding. On the other hand, when I ask for clarifications on niche topics that have few examples on the internet LLMs (even Opus 5) often confidently cite irrelevant papers / results or simply hallucinate.
Having said that, I wouldn't attempt to learn a whole topic with an LLM, that would be frustrating.
See https://claude.ai/share/6431ccd9-f4f8-4052-8996-b046d1ea1f76 for an example that I ran into just now.
I am not going to study a whole book just so I can find the answer to a couple things I might never need. I like to focus on a few areas, learn everything I need to understand it, know if there are any dependencies and see what is there to discover and then move on.
I know many people get joy from learning knowledge that is not directly applicable and might never be applicable. And I know that the academic spirit would be to learn these things. But my time is seriously finite and I am not using math in my life in any fashion whatsoever other than occasional curiosity.
For every person with this mentality, how many people do you think there are that aren't learning from the LLM at all?
See: what they did with personal computers and smartphones. They have access to Fable and Astra right now, and they're not interested what-so-ever despite what these systems can now do. Instead they'll promptly go vaporize $50k on a giant pile of metal garbage (autos) that will rapidly depreciate. They have no practical use for Fable as is.
For the same reason people didn't rush off to their local public library to teach themselves JavaScript to acquire a better life for the cost of renting library books. They can't easily go against their restraints, their biological potential. To do so is extraordinarily taxing.
Originators generate most of the extreme wealth, and extreme outcomes. Mimics can be exceptionally successful however, most doctors are mimics for example, they won't ever originate anything.
Amplifiers are the teachers, they - ideally - shuttle what works to the mimics for reproduction across society. The mimics are largely just trying to keep up with the Joneses. They go out of their way to not risk anything most of the time. They're ideally following pre-set paths to biological success. It's why mass, rapid de-industrialization for one example is such a wipeout, the mimics don't adapt very quickly, they followed the path they were told would work and then they feel betrayed, they become like abandoned programs and don't know what to do next.
As a system you don't want too much of your population in the originator category: it's very expensive and highly prone to spectacular failure. You want the extreme majority of your biological entities following successful paths that have already been proven to work.
Humans aren't special, we're animals. Apply the patterns accordingly.
Nobody will hate AI more than the con-artists in academia pumping out fake papers by the zillions that are all about to be wiped out.
Most people consider mathematical intuition something that only develops from deep study. What the parent is referring to is being able to anticipate how a system will behave before you actually do the calculation.
Most people who use mathematics in an industry job rely on their intuition rather than rigorous proofs. And most industry mathematicians will acknowledge that they're not as rigorous, nor as academically gifted, as their friends who stayed in academia.
Just like a programmer with 20 years of experience can look at a bug and anticipate the cause.
But please elaborate a bit on your statement.
How is mathematics gated and inaccessible? How do you specify mathematics without notation or some language? What intuition do you mean, as many mathematical ideas are non-intuitive?
(Attn: pls read more than the title before you downvote)
With powerful tools of the type Bret envisions, humans, in aggregate, might have a chance of staying ahead of LLMs at even frontier math..
(But maybe that wouldn't fare so well against future world-models, who knows)
here might be something to point those tools at--- if one isn't fixated on "predictions", or "real world" https://youtu.be/fec8qSBiM4k
Plus, in the good articles I've read, the structure is usually: dissection of subproblem, intuitive description of solution, converting that solution into notation, proceed to next subproblem. If you see an unfamiliar symbol in an article, look it up. If you don't understand its definition, you don't yet have an intuitive grasp of the concept. Keep going down that rabbit hole until you have the intuitive building blocks to understand the article.
Frankly, I love how much math we can teach before a kid graduates high school. Thousands of years of mathematical ideas, up to calculus invented less than 400 years ago. All before they're 18 years old and probably don't care much about math.
Is it really that common for musicians to not be able to read music? I'm not a musician so I wouldn't know, but it seems far-fetched. Like the story that Einstein failed math. I likewise doubt that there are many people who would be good mathematicians but unable to learn the language.
Sure notation is arbitrary and not the actual "truth" of math, but we need some way to talk about it, so why not just learn the accepted standards?
There might be at least one awesome author out there who never learned to write or type, but they're probably extremely rare, because becoming great at something usually entails a lot of practice, and that's hard to get when you're not making the effort to learn the basics.
In any case, LLMs are probably a bad way to "pivot math towards intuition and accessibility" because they, as language models, are great at generating a bunch of jargon that is hard for somebody with no training to tell apart. See the recent story [0]. Here the author (perhaps) succeeded with his proof, but was it because of superior intuition? Or just throwing compute at the wall to see what sticks?
> Reading math however does not guarantee ideas or intuition.
is true, but the converse, having the mind for good mathematical ideas or intuition, almost surely means that you'll have very little trouble picking up mathematical notation (not just notation, but the reasoning and ability to write a proof, be it in natural language or some formal proof assistant language).
Like yeah, before the written language there were great storytellers who couldn't write. But now that humanity does have standardized languages, it's way more rare to come across such a person.
This has always been my problem with math going all the way back to college. It was obvious to me that the concepts were far less hard than the combination of notation and esoteric jargon with liberal use of symbols and weird letters made them seem. Math felt (and still does feel) "encrypted."
The impression math gave off is of an arcane discipline that uses its arcane-ness as a gatekeeping tactic, intentionally or not, and makes itself intentionally hard for newcomers to learn without being hand-held by members of the guild.
Of course I can say the same about a lot of computing, and I'm old enough to remember efforts to make computing more approachable like easier to learn languages and GUIs being mocked and scoffed at by "real programmers."
I think this is a pretty typical human group behavior.
I think this underlies a lot of AI hate from these communities today. AI makes it easy for outsiders to bash their way into the field with the help of an LLM. Yes, this often results in low-effort "slop," but if used correctly it can also help people climb the learning curve really fast. I've had great luck having an LLM make me some passable "slop" and then explain it and go around with me as we fix and refine it, explaining each step, and as it does so it feels like we are learning together. It's very powerful and I, as the student, can control exactly how the teacher presents the material.
I was able to do this to finally start grasping the math behind LLMs themselves: attention layers, tensors, etc.
A lot of people have a powerful visceral probably instinctive reaction to large numbers of migrants entering their area. "Build the wall!" I suspect this is brain stem stuff going back to evolving under conditions of scarcity where migrants meant less food.
I really don't get the hate for mathematical notation here, do you have specific examples? Notation is a necessary tool to express complex ideas compactly so that others can understand them. It allows you to carry out technical proofs that confirm things that are "obvious". Then it uses previously introduced concepts to build new concepts on top of them. This keeps mathematics interconnected, there's value in explaining a concept in terms of already known things rather than just vibing it.
> makes itself intentionally hard
It doesn't make itself intentionally hard, it is just hard. You can simplify some expositions and make concepts easier to understand intuitively but it won't necessarily give you the skills to actually work with them in mathematical practice (which is the point of mathematics as a discipline).
They believe this despite the fact that there are a million different textbooks, all explaining the same concepts in different ways, or different branches that specify the same structures with unique methods. It's really strange when I read threads like this. I'm not the greatest at math either, but that's because it's a hard thing to be good at.
To learn math is an exercise in humility. You must struggle hard, do hundreds of problems, spend years refining your understanding, redoing proofs, finding counter examples, just to be at a good undergraduate level. Much harder than pretty much all CS classes, except maybe Theory of Computation, which is pretty much math.
In the (extremely) short run, yes. In the long run, those jobs will also be done by AI.
It's like chimpanzees seeing human society and saying "look how complex it is, imagine how many chimpanzees it needs to maintain it".
Let's be honest: we don't know. Maybe you're right, but for the moment it's more likely that you're not. And countries cannot bet on that vague intuition at the cost of destroying their research communities and world leadership (which takes decades if not a century to achieve).
Best case, they still matter.
Worst case, AI kills us all and it's irrelevant that we "wasted" money on research.
A better analogy: look at all these highly trained engineers, mathematicians, doctors, writers, philosophers, writers, scientists.
How many dumbass politicians do we need to keep it all running smoothly?
Turns out no matter how dumb politicians were, overall society has been developing positively over the history of mankind.
Do you think this applies to say, surgery, as well? There are few useful problems that share these properties.
First off, I can’t imagine anything more torment nexus-y than throwing billions to automate and scale the torture of animals. If each token is a “cut”, how much suffering does 10 trillion training tokens (lower bound) corresponds to?
Second, this still doesn’t cover all the properties that make math proofs doable. It requires working in the physical world. You must physically capture or grow 10T cuts worth of animals. You cannot verify success so easily, either. Cancer cells, for example, could regrow over months. You would need to keep the animal alive and regularly test the animal, which would be difficult to scale. And most people wouldn’t trust the world’s greatest vet to operate on them, anyways.
> Second, this still doesn’t cover all the properties that make math proofs doable. It requires working in the physical world. You must physically capture or grow 10T cuts worth of animals.
It would likely be sim2real with that as the post training, reducing that requirement a lot.
> Cancer cells, for example, could regrow over months.
In that specific scenario you would likely train on receiving no unrelated injuries during the surgery, and have induced conditions with stuff tagged molecularly that you can then verify efficacy from without waiting months.
Depending on how much more data efficient sim2real makes it, you could end up seeing companies pushing it only for actual procedures the animals need but economically would never get; botched surgery and the animal gets euthanized before waking up, which they could argue was already going to happen.
> And most people wouldn’t trust the world’s greatest vet to operate on them, anyways.
Robotic surgery systems, already go through animal trials before being used on humans. So do many purely human surgery techniques.
well that's an awful image
We're building tools to serve the human society.
You mean dystopian. If it were a utopia everyone would be happy to welcome the new world order.
Does the set of intelligent species only have one member? I cannot treat this observation as a general rule if there is literally one example of an intelligent species to theorize about.
But within the sample of the human species it is more common for less intelligent people to control more intelligent people.
This happens within political systems (political leaders are usually above average intelligence, but hardly the most intelligent) and within companies and other economic systems.
I don't see this fairly obvious point discussed, and not really sure what it shows.
it shows that you don't get anything for free. If it was without any cost in other areas to make a human massively more intelligent, it would presumably happen over time via the same processes that led to us.
As it is, the higher (and lower!) ends of the distribution tend to be highly correlated with other issues (mental+physical), and the further you go, the more unfortunate things which make it harder to do stuff in general start to crop up like psychosis, autism, ocd, anxiety, addiction etc
Maybe there are other things ("leadership", "likeability", "appearance" etc) that are more important in the pursuit of power than intelligence.
I think it's telling that it is usually conventionally intelligent people making the claim that intelligence is what leads to power.
I think there are other species that could be considered more capable than humans, such as E. Coli, octopuses or ants.
And it's not even clear whether the AI will have its own individuality. It might become an extension of human brains, in the same way neocortex is an extension of amygdala. In that case the statement of who has control might become meaningless.
> given n species and the n * (n - 1) binary combinations possible, there are no examples of the said observation
I would expect that in the vast majority of combinations, those n species are not intelligent enough to make decisions for another species, making the statement nearly useless.
> I would expect that in the vast majority of combinations, those n species are not intelligent enough to make decisions for another species...
This kind of statement is very difficult to build discussions upon (not a criticism). "Vast majority", "intelligent enough" are both very difficult to quantify and there is too much subjectivity involved.
I stopped reading at this point because I reject this initial assertion, and I assumed everything that follows is based on it.
There is nothing to suggest that an AGI will care about its future or who controls it. (whatever that means). that just more anthropomorphism.
We care a lot about our future so an ai pretending to be like us will also pretend to care. But we have a lot of biology driving us. Our emotions (Fear, Hate, Love, Pride etc) are baked into us in a way just wont be the same for ai.
Isn't this exactly the scary thing? A sufficiently advanced agent unleashed with an imperfectly defined goal will do whatever it determines it needs to do to accomplish it, careless of the consequences.
For guest post on Tao's blog, after a decent start this fell short of expectations rather rapidly.
- Maths and theoretical physics are very cheap (compared to other disciplines)
- Maths and physics researchers provide lectures for all other scientific fields
- Brut forcing maths/physics problems require debilitating amount of compute/money. This will make research in these topics even more biased towards rich countries.
- There most certainly will be pervers effect, ppl refraining from publishing results etc
- it’s very unlikely that private ai labs will play ball with academic research. They scrapped the internet and now sell access to their models.
As much as I’m happy to see new tools, I have the feeling there will be nefarious effects.