Posted by srcreigh 20 hours ago
You can't simply prompt a model to be "better" when "better" isnt even properly defined
> Our ability to understand difficult and unfamiliar ideas may become one of the most important contributions we can offer to society. We should be willing to bring that skill to problems far beyond our usual research interests. [3] Doing so asks us to expand our sense of our vocation.
Am I reading this wrong, or is he talking about what (mathematitian) Data Scientists have been doing for years? So he is basically saying that former Data Scientist that have turned into prompt/software engineers should go back to being data scientists.
In any case, people should stop trying to fit AI in the previous status quo. What we need is curious people, that is what we have always needed.
A few centuries ago there were no "mathematitians", there were mathematitians/philosophers/artists/physicists all in one person. So its not like "mathematitias" is something that has existed for millenia.
We need curious and ethical people.
Maybe AI brings back the age of a well rounded scientist/philosopher. I know this sounds counter intuitive because the article is saying that we cannot keep up with the AI.
See proofs never before possible made by someones intuition.
But maybe they wont be mathematicians.
I’m fairly confident that the opposite will be true. The most important decisions will be made by AI, and humans will only be left to guide decisions as a matter of taste. AI has the ability to be impartial, and immutable. You can endlessly probe and reason its decisions.
This isn’t true of our current human decisions. Where we see red tape, bureaucracy, rent seeking, status quo. AI will see through these human constructs.
I do like the idea that we will need more mathematicians, physicists, and scientists to understand the discoveries of AI. That might be the best possible outcome of AI, but I fear the opposite and we are painting ourselves into a corner of which we no longer have the knowledge to sustain ourselves and society itself collapses.
Why would an LLM care about eliminating any of these things? When you say "red tape" and "bureaucracy" you are, in that very statement, applying emotional labels to what are actually just systems working as designed. There are the rules, so we follow them. LLM decision-makers will happily enforce and perpetuate bureaucracy and red-tape. If the rent-seeking is legal behavior then they will fully protect a big corporation's right to engage in it, they don't care about the feelings of the little guy. If a similar situation was decided a certain way in the past, then yeah let's decide it the same way now and maintain the status quo; LLMs very often think that way, they don't care about human ideals like "change" or "progress".
Which AI has this ability? LLMs definitly don't.
It also lends itself nicely for the ability to adjust the AI systems when deficiencies are found. You can tweak the AI systems to align itself with the desired output, and check for regressions, much like tests in a codebase.
Human decision-making lacks this thoroughness. I’ve scarcely come across rigorous documentation of decisions and how they were reached professionally.
Not saying you’re wrong you just can’t be so certain
Not Terrence Tao post. Beware.
today they benefit from human willingness to share publicly and improve ai systems, but once those systems start to threaten their livelihoods, will those dynamics change? can the machines push the frontiers or is the global network of human creativity and tenacity necessary?
Unfortunately that’s a question you’ll have to answer for yourself. Also, people are going to risk going along whatever path gives them work as many today already do.