Could be from a sandwich that tastes like the best sandwich ever, but is super bad for your cholesterol or something.

I dont know where Im going with this.

Actually did some research I think the term is "Wireheading" from a story/theory from the 50s

I suspect that part of the reason some people are hoping for that to happen is that they thoroughly mix up AGI and ASI. We do not need some kind of omnipotent god-like super intelligence in order to get much greater than human level capabilities. We are actually almost there in a lot of ways. In some aspects like speed and breadth of knowledge, very superhuman.

What I think is going to happen is that within a few years, maybe 18 months to 5 years, the new materials and compute-in-memory research is going to land in data centers at scale.

That is going to be 10-50+ larger models, 10-50+ faster, much smarter than humans. 50+ less electricity usage.

At some point, it is going to be obvious to people that if we want to maintain control of planet earth then we need to maintain control of AI research to some degree.

Assuming that superintelligence will be benevolent and just.. going for it to me is something that might earn the human species a Darwin award.

In my own work, I've found that it's much faster to brainstorm with a frontier model like Opus. I'll have an idea and be able to get a working implementation and try it out on toy problems within O(minutes), instead of O(weeks) earlier.

These people are literally just a public relations operation for the big AI labs. I equate them more with a lobbying firm than I do a research firm.

Opus 5.5 is so amazing I'm not surprised if it can improve itself.