Posted by giuliomagnifico 23 hours ago
How did Cantor come up with his diagonal proof? It seems to have been dreamed out of nowhere
Why are there advertisements for a shampoo containing caffeine? Does caffeine do something useful other than when you drink it?
What happens in sense and sensibility?
All of them give a decent answer, with the ability to ask follow ups. Eg, how does S&S compare with Pride and Prejudice? What about more recent novels connecting romantic choices with economic choices?
All of them give you links to source material, in case you suspect they are just making it up.
At the start of the millennium, Google search changed everything about how I look for information. Now it seems outdated.
But seems like they won? Why know how to search when you can simply ask your question. You can even tyipe it layke dat and it would still work.
But seeing disney+ now go all ads for all tiers just shows that's the way they arc bends. Eventually AI will take over and when it does, it will then turn into the shittiest shit ad-infused service the world has ever known.
That's how AI will surpass us. Once we enshittify humans sufficiently, AI will flourish. That's why I support extensive AI use in school classrooms, the younger the better, it's the best policy for OpenAI and Anthropic investors.
I would argue this was always a bit silly, and mostly due to UI shortcomings of search platforms. The fact you needed to add "magic" params to shape the results speaks volumes. Any UI that fundamentally tries to reshape how you are expect to interact, or impose certain "behavior" is wrong. This is also why we are using touch instead of a stylus.
AI won because they took the paradigm of presenting a new way of doing something in a familiar way. An LLM works very similarly how you would ask a knowledgeable friend, and google worked similarly how an engineer would query a database.
[1] Yes, we can argue that LLMs are dumb, also. But they magically do "get" your intent with your prompt, unlike the search engines of yesteryear.
Finding the right words to please the currently popular search engine is not a skill that easily translate elsewhere. It is not like programming where precision is key, searching has always been a bit fuzzy. Fact checking, crossing information, understanding primary sources, etc... these are real skills, typing words in a search engine is meh.
That we now have language models that allow let machines capture the intent of the query without the need for special incantations is a clear win to me.
Where LLMs are really excellent compared to search engines is when you don't really know what you want. You don't need to know about "Cantor diagonal proof", you just need to know "That math thing where you trace a diagonal across decimal numbers", and the LLM will immediately tell you about Cantor.
I remember wanting to look up something about the Andrew Niccol/Nicolas Cage movie "Lord of War", during the time the game "God of War" was getting all the hype. Guess which word Google assumed I got wrong, and what all the results were all about.
And it was more difficult, too. You had to make critical decisions while you were working to gather the information you were after. The work had beneficial side effects.
But it also took longer. And free search got shittier. Tradeoffs.
Must be fairly easy as a company to inject your specific topic there, e.g. "Nutris(c) is proven to be better than caffeine for haircare"
I wonder how well a company could establish something like Danone's health-claim for Activia [1] in an AI without ever being clearly accountable for it...
[0] https://www.bbc.com/future/article/20260218-i-hacked-chatgpt...
[1] https://www.ftc.gov/news-events/news/press-releases/2010/12/...
I don't remember actually reading the article, so I have no idea how serious that was, but I'd be surprised if this wasn't being studied actively by all major countries already. And that may be one of the core reasons for the China vs US AI competition.
Which makes it perfect for companies to create an area where they own the majority of material, and "have the AI talk for them".
e.g. how Philip Morris defined their e-cig "Heets" as a separate product to (e-)cigarettes because it doesn't burn tobacco but only "heats" it. It's now a separate domain with the majority of material (including the term "heets") owned by Philip Morris.
i am terrified of the nudging that is/might be already happening in the consumer context. Cambridge analytica showed us what is possible when you just shift the things people see, imagine what is possible when you shift what their personal assistant tells them.
GPT Wormtounge sends his regards
To be clear: I totally agree that manipulating LLMs is super-dangerous. I don't think it is a 20 minutes of work, though. It's more like "years of building credibility, and then 20 minutes of work".
Or, you know, buy their way to the top of a search engine's results.
Advertising killed search.
I don't really like LLMs or AI assisted tools, but I think they are really good for "explain this configuration, tell me what it does, and link to the documentation". Then read the AI summary, verify with the actual docs and go from there. It's almost always the easier path to understanding, for me at least.
For younger people accessing information in this way is definitely a win.
The advertiser can buy logit "boosts" to specific tokens in a given context (the more preceding context, the cheaper). Once an activation has happened, dont do it again for the session.
The LLM will end up pushing a specific product contextual to the conversation. It just needs this slight nudge at the logit level to start talking about it and will fill in the rest.
The expert would then give you his thoughts on which modern books are most similar to S&S/P&P, and you would have to use your own thoughts to decide whether you agreed.
In many ways I find it similar to tutorials. You can go back and forth with the AI if there is something in the argument you want to investigate.
I picked up a broken TV on Craigslist free curb alert and spent a few hours trouble shooting with Google. This included taping contacts on a 90 pin cable. I was getting close when the screen fell over and broke. I told Google it was game over and it replied "take a breath. You have done a great job. Here is list of parts to harvest."
I found that I can't really trust this knowledge becuase I skipped the source and didn't conclude it myself. Like how I can learn anything when being spoon fed with conclusions and summaries without accessing the source?
I'm willing to bet that approximately 0% of users know when to suspect it being made up and then check the sources.
(And here I thought "Alice in Wonderland" was a Disney film—who knew it was a book first?)
Really? I thought that this was common knowledge. On the other hand, my parents loved to quote Lewis Carroll at me and brother when we were growing up so perhaps this knowledge is not as universal as I imagine. “‘Twas a boojum!” was often used in conversation in my household when you expected one thing but discovered another (potentially dangerous) thing.
Am I wrong in saying that the centralized models can make better suggested follow-up questions because they can track and rank the same or similar lines of questioning that have occurred with other users in the past? So instead of getting PageRank to rank web pages, you get AnswerRank to rank follow-up questions?
... actually, I am right, it's The Conversation Graph that's underappreciated. See here: https://share.gemini.google/6fKIzyxuI0Bb
You forgot to mention that when you click the links you will often fail to find the supossedly derived detailed text in that specific link (even though the title seems super related).
If you follow these a good portion do not contain the claims that the AI output links to. This is obviously a hard problem since actual AI "knowledge" lies deep in the weights somewhere.
Google search did the same and more than once the link didn’t contain what I searched for
I never asked them to waste additional resources by injecting my blunt keyword-query into an AI-cluster and guesstimate a well-formed article from that.
But here I am, with (elder) relatives sending me Google search-results on topics like they are proper articles...
For quick reference, sometimes it’s pretty good! The problem is that obviously you can’t dedicate a lot of compute or additional tools for checking those answers so most of it can’t really be trusted.
And yet they is not how it is used, and is trusted beyond sanity.
The sometimes convenience comes alongside ejecting society from the previous system of figuring out what is true and false.
That was a system that was already failing, but we may have gotten on top of. Now we have one that is simply alien and inimical to any human scale solutions to staying ahead of it.
Generation capacity simply outstrips verification capacity, and with search summaries taking over links to the actual sites, the funding/incentives to run sites and publish content is removed.
The curtain call of the era of the open internet, and the opening act of the LLM mediated web, isn’t a show I am excited to have front row seats to.
Wow, I thought you were going to talk about selling ads and how that has made search shite.
They, themselves, sorta proved that a good product could become dominant with ads and without being shite.
The pre-AI enshitification-part where they realized that worse search-results means more searches so more ad-revenue is another story.
If they wouldn't have done that, they could be the proof that a well-maintained search-engine is still better than a LLM.
But now this will never happen, as no-one will be willing to give up that additional search revenue while overall usage is going down...
Beautiful. I shall consider suffixing every random observation I have or action I take with that, for an extra infusion of ominosity and importance.
Back in the day everyone had essentially the same Google, and there was no concept of paying to get better search results. But now the average family is going to rely on the ad-ridden ChatGPT Free tier which is more likely to be wrong, less in depth, with additional commercial incentives. It’s only a minority of adults now that pays for frontier models, and how many are letting their children have access?
You can see this divide right now with medical advice for instance. If you have access to ChatGPT 6 Pro (only available for the $100/month tier I think), it will research Pubmed etc and give you a careful measured answer that likely reflects the latest medical consensus, while a casual user relying on Google AI might be told to eat toilet paper to relieve constipation: https://www.reddit.com/r/medicine/comments/1wmbn87/a_pt_show...
or in the case of gemini, if it even looked at all...
(Is it dead yet?)