Top
Best
New

Posted by sancho-panza 2 hours ago

When did Google get so weird?(sancho.bearblog.dev)
344 points | 179 commentspage 2
ronbenton 2 hours ago|
I had a similar experience with this that actually concerned me. I can’t remember the quote I was googling, but it was verbatim a quote that someone said. The AI interpreted it as my quote and furthermore interpreted it as me intending harm to someone else. Now I’m worried I’m flagged in a system and waiting for the police to show at my door next time google hands over data to the government.
pavodive 58 minutes ago||
https://noai.duckduckgo.com/?q=hes+never+coming+dario

This is my default search engine now. I can't stand those AI summaries. My searches are often depleted of context, specially when I'm looking for some exact phrase, that any AI summary is going to miss badly.

mikgp 1 hour ago||
There was a post today or yesterday where Paul Graham and Nate Silver accused the AP of being woke for saying you shouldn’t anthropomorphize LLMs. But I can imagine there to be quite a few unpredictable consequences to encouraging your customers to project emotions onto your product that humans generally project onto each other.

I’m not sure SV is prepared for what happens when you go down that road.

dolebirchwood 1 hour ago|
> There was a post today or yesterday where Paul Graham and Nate Silver accused the AP of being woke for saying you shouldn’t anthropomorphize LLMs.

I searched, but couldn't find this. Do you have a link? Sounds like a totally unhinged response from totally unhinged people. There's nothing "woke" about wanting my word calculator to avoid pretending it's a person.

When I integrate LLMs into my apps that respond to user queries, I deliberately have my system instructions prohibit all self-referential usage of first-person pronouns. The system can only refer to itself as "this system", never "I" or "me".

Any chat bot that pretends to be a person just grosses me out, especially in a customer experience context. Gives off very manipulative and patronizing vibes.

mikgp 49 minutes ago||
https://news.ycombinator.com/item?id=49866007
solarkraft 2 hours ago||
It's a whole meme category to make the AI overview help with absurd scenarios: https://knowyourmeme.com/memes/where-is-mama-ai-overviews
mattlondon 2 hours ago|
I think these sort of things are actually very "googley" in the old kinda wacky way. It's funny, it's goofy. I like the fact it plays along.

What would you rather it said?

TomGarden 1 hour ago||
Side note but your ending question triggered all my LLM prose engagement bait warning alarms
ACCount39 1 hour ago||
[dead]
furyofantares 1 hour ago||
I have to imagine google would consider this one to be essentially a bug - misreading user intention this badly. Akin to hallucinations.

I know many people want to ask questions to google directly and just read the AI result and very rarely check the links, and I know google wants to convert more people doing this before people switch to chatgpt etc.

But google search does not (yet?) appear to me to be designed as a chatbot you are expected to converse with where it would be normal to just open asking about some guy named Dario in your personal life who isn't globally notable. There's a difference between pushing for a conversational query and a conversational personal assistant. Heck this is a few jumps past that even.

I wouldn't really ask when google got so weird, I'd ask when google's AI overview got so shitty, and the answer is ever since they introduced it.

wisty 2 hours ago||
Haha, had almost the exact thing trying to find a quote from Steins; Gate ("I keep seeing it, I keep seeing it"). Google AI was very "worried" about me.
WillMorr 2 hours ago||
As a heavy user of LLMs professionally, I too am so confused by the decision making process within these orgs. Do people really want them to speak like actual human connections? Why?
password54321 1 hour ago||
I don't but RLHF probably does lead to this behaviour.
hammock 1 hour ago||
Is RLHF the best approach? It’s not how Steve Jobs designed the iPhone, famously. “Customers don’t know what they want” “A faster horse” etc…
AngryData 1 hour ago||
I doubt it, but it makes sycophantic managers feel good to see it serve up the same BS they spew.
8organicbits 1 hour ago||
This is a really good time to do a head-to-head comparison of different search engines. The last time I checked Google does not provide search results above the fold, instead showing AI overview, ads, and YouTube search results. Try a different search engine to see which one is giving you the highest signal results and what other junk they put on the page. Personally I use duckduckgo with AI turned off in settings, but it's best to try the experiment for yourself.
xg15 54 minutes ago||
I feel this is a result of the "make the world a better place" narrative that Silicon Valley companies used to adorn themselves with.

If you just want to play with cool tech and make money, but for marketing reasons, you need to show some ostensible real-world reason why this tech should be developed, then "well, our chatbot could help lonely people with their relationship issues or give people in an abusive relationship a covert channel for help" is probably what comes to mind...

Runners up: Our AI startup will help the poor children in Africa and/or combat climate change (ignore the gas turbines, please).

jstummbillig 1 hour ago|
> In what universe is it Google's job to console me and be an empathetic listener rather than just find what I am looking for on the internet?

In one that changes.

More comments...