Top
Best
New

Posted by acossta 5 hours ago

Perplexity and Intelligence(openai.com)
396 points | 267 commentspage 10
hypfer 4 hours ago|
This is just an ad. Why is it top #1 of the front page?

Just some guys on a payroll claiming that an arbitrary set of milestones is a curve towards a greater magic goal that means that some valuation is actually true.

Why would you read this

semiquaver 4 hours ago||
https://en.wikipedia.org/wiki/Flying_Machines_Which_Do_Not_F...
oxcartctl 3 hours ago||
[dead]
AlexCoventry 4 hours ago||
The graph is informative, at least.
hypfer 4 hours ago||
I don't see how it is?

As said, the labels there are just randomly chosen things that made headlines, thrown on there to imply a clear causal relationship.

That's the level of "science" that gets you banned from campus. In an ideal world, anyway.

spuz 3 hours ago|||
Maybe a poor analogy but I see this as OpenAI releasing their GHz speeds or IPC metrics if we were to imagine they sold CPUs instead of AI services. It doesn't tell you much about the final performance but it does give an interesting core data point.
hypfer 3 hours ago||
I don't think that's the case, because with instructions per second, there is a clear relationship. Whereas here on one axis they plot GHz and on the other they plot matches of StarCraft won.

There is certainly some influence of the Ghz of your processor on how many matches of StarCraft one can win, but.. well. Bogus science.

spuz 3 hours ago||
My point was that it is a core but not necessarily correlated metric and it sounds like you agree with that.
hypfer 3 hours ago||
Okay so, the graph is "informative" because it plots the perplexity value of the various OpenAI models over time?

That's it? That's all this submission has going for it?

Okay.

AlexCoventry 2 hours ago||
That was all I'd apprehended of the post when I replied earlier.

The post argues that NTP perplexity is a good first approximation to model capability, and could therefore form the basis for an industry-wide commitment to pause model development at a given perplexity level until there's a consensus that AI alignment and safety has caught up enough that it's safe to continue developing even more capable models.

It's definitely not simply an ad.

AlexCoventry 3 hours ago|||
They're meaningful to anyone who understands the standard numerical objective used in next-token-prediction pretraining.
hypfer 3 hours ago||
I am so incredibly glad that this is going to be over soon, because the amount of weak replies like this is just.. insufferable.

The whole AI Bubble topic aside, this is just.. ugh. Intellectually repugnant.

There is just nothing here other than a war of religions. Nothing is to be learned here. There is zero curiosity. It's just a screaming match.

I hate this.

inb4 "no you"

Yeah man. Whatever.

AlexCoventry 2 hours ago||
The graph shows the average uncertainty the models have when predicting the next token in natural-language text. That's a highly specific measurement, and informative anyone who understands it.

You're not under any obligation to understand it, of course, but if you ever get past this emotional reactivity, you'd benefit from making the attempt, IMO.

hypfer 2 hours ago||
https://news.ycombinator.com/item?id=50602654
jwpapi 3 hours ago||
I honestly mean that I don’t know, but an alternative way of reading this is:

Anthropic is getting uncatchable by us and we merely keep ahead against chinese models, so let’s all slow down.

I think the reason Anthropic is so far ahead could be that they get way more user conversations, as everybody else distills, the rest is one gen behind...

zodwick 3 hours ago|
> they get way more user conversations

Idt its that simple. Openai is much bigger than anthropic in terms of userbase

jwpapi 3 hours ago||
Not to be non-diplomatic, but I think claude users have the more challenging conversations.

I’m not sure it’s that simple either, it’s just very tough to take anyhing for bare value with everything that’s at stake. Trillions of value, future of humanity.

Tricky..

yipinwong 4 hours ago||
They are touching an elephant's legs, and saying Elephant is like a log.
AIShill101 4 hours ago|
Gah man do I hate AI ethics and stuff. I really hoped the lead scientist at openAI wouldn't be so screwy but they're all part of that cult aren't they?

I really hope we go full speed ahead on AI development.

derac 4 hours ago||
https://x.com/sama/status/2124551883130114403

^ Sam Altman statement, basically saying that's not their intention. I want better AI too, but it seems prudent to move forward with caution.

Ohentis 3 hours ago|||
This is basically the most sane post ever posted by an openai employee. This is just like an opinion. That seems like a good one.
bayindirh 4 hours ago||
> Gah man do I hate AI ethics and stuff.

Why? You hate ethics in general, or only when applied to AI?

AIShill101 4 hours ago||
Mostly when applied to AI, it's just a ploy for regulatory capture by these giant companies.

That's all. Ethics in general is overrated but I digress. LLM development really should go on full steam tho.

reasonableklout 1 hour ago|||
Vast majority of Americans support AI regulation even at the cost of slowing down development, and 2 of the 3 Turing Laureates for neural networks want the same despite not being part of these companies. What are you hoping to see with “full steam ahead LLM development”?
AIShill101 43 minutes ago||
I am hoping to see automation on a scale never seen before - for both knowledge and physical work. And R&D, RSI will get us to what was previously just a sci-fi dream.

That is what I wish for.

bayindirh 4 hours ago|||
I personally disagree with you, because the lack of ethics is what creates today's world. Are you happy to be lied to your face, rugpulled constantly, or left defenseless in cases where you're right but not the owner of a billion-dolar company, in general.

Are you happy that your water is poisoned, air is polluted, food is degraded just because somebody cares more about money than ethics?

LLMs are the same thing. Training data provenance is a big, ugly can of giant worms. License washing is a problem, inefficiencies of data centers is a problem, using open-loop water systems and methane conversion generators just because they are cheaper are borderline crimes in themselves.

We're digging what OpenAI and Nvidia dig to the world economy and consumer prices worldwide. Just because a couple of companies wanted more money in the name of LLM development and cutting edge science.

On the other hand there are projects which are trying to minimize DC impact by scheduling things to places which they have most renewable energy on tap at a given moment.

Go, figure.

AIShill101 42 minutes ago||
Idk I'm an accelerationist engineer - I believe that AI will revolutionize the production of the immaterial and the material. Thus leading to a huge jump in QoL.

You might like the current state of the world, I do not. It has ~800M people living like kings while exploiting the rest.

So for me trying to temper down the rolling out of DCs means AIaaS will always be more expensive and out of reach for the other corners of the world. I want people in Africa/South America/South Asia to use LLMs, learn and live better lives because of it. My allegiance isn't to NA/EU. And contrary to popular belief if anything we need a lot of heavy machinery and architecture rollout there to equilibriate the QoL.

Guess what? I believe AI will help processes of manufacturing become far more efficient - entire towns just filled with dark factories churning out goods.

This isn't the time to be thinking of sustainability - atleast for the rest of the world. The people of NA/EU live like kings like I said. 10-15x the emissions of any third world citizen!

Also finally, my mind says that A) I wish to see a more intelligent machine built by us and B) that humans aren't exactly very moral creatures so that machine would arguably govern us better. This last part is for the far future tho!