Posted by porridgeraisin 1 day ago
This a twitter thread, not an article arguing a point in a salient manner.
Why would anyone go to the effort of struggling?
Ingenuity was last decade's moat. But human ingenuity didn't crack those millennium math problems; throwing more money at compute did.
They aren’t capable of generating truly innovative ideas though. Ask it to come up with a name, it will come up with the same weird slop names over and over. Always gives people the surname Okafor. Because it works by generating probable answers, it can only generate probable names.
These models actually can create content of myriad styles very well. But artistic styles are mutually incompatible. It can't create something that matches all of them, and it doesn't have an opinion on which is best, so bland requests just give bland results. To get good results you need to direct the model into the region of its latent space that makes stuff you thing is good.
That's not true anymore. I've asked it to generate names for some LLCs and it came up with plenty of novel names that sounded vaguely Latin and had a certain sound that I had asked for.