AI safety is a completely separate question from the hard problem. Also a very tricky one, given these things are still black boxes.

I wouldn't torture a chair, and I would not associate anyone who gains pleasure from such. It is worse if the chair were to expressed displeasure. That indicates something deeply wrong.

Having such psychopaths revealed: use that information to alter your associations, is what I would suggest.

If we learned how the brain works would we suddenly cease to be conscious?

LLM's are reducible to matrix multiplication in the same way that human cognition is reducible to physics. Reducibility does not imply understanding.

>I feel that "YouTube makes you an idiot" is a misdiagnosis.

Signal/noise is much worse (arguably books are catching up thanks to LLMs)

People see emotional signals in youtube videos. They respond to vocal tone, facial expressions, these are known to circumvent critical thinking. Like if you examine crowds of science deniers the usual commonality is that they are having a parasocial relationship with a bunch of youtube creators who are nice to them and reinforce their beliefs. The actual content of the belief is irrelevant, if you are disagreeing with the belief, you are attacking their tribe. Not limited to science deniers either, you get this hacking of human tribal psychology even in stuff like people who watch computer game videos. They pick a few champions of their tribe and follow them without critical examination of the content. At least with a book, while this is still possible its much harder. Its also telling that a lot of cranks who published junk science have all migrated to youtube.

I dont think youtube makes you an idiot, so much as youtube content is designed to bypass your critical defenses and overwhelm you. It develops into a blind spot. People can be perfectly rational in most areas and then suddenly burp up some absolute nonsense they caught on youtube.

Oh and the best part, is when you point this out to someone they tend to go "Oh yeah that totally happens... except for my favourite youtube channel which does x and y and z and yes of course I buy all their products and donate to their charities"

The nice thing about books vs. YouTube is that it's much easier to critically interrogate books while you're reading them. That was the difference with my dad: he thought about what he read. He repeats what he listens to on YouTube.

I hate the proliferation of audiobooks too, by the way. It's the exact same problem.

Exactly.

The Printing Press is good example, one of the first books was on "witch hunting", which panicked people, and lead to a lot of deaths. The first, 'conspiracy theory' to sweep over humans.

Humans are just highly susceptible to manipulation. YouTube is just taking it to next level. Like the difference in eating coca leaves, versus snorting coke.

Why is Grit pseudoscience? I haven't read it.

The point is that it doesn't really make sense to say they're "seeing" anything. You said

  So… are the neurons on that chip seeing?

  We all desperately want to say no.

But I can confidently say "no, that's totally childish, the neurons are clearly not seeing anything." And in fact it's not even especially clear that they're "playing DOOM" vs. hitting a biased random number generator in response to carefully preprocessed inputs that come from DOOM. There is a major distinction when the enemy positions are directly piped into the brain.

Again I share the ethical concern about this stuff. But your blog post is quite misleading.

Suppose someone builds a framework that maps Doom to a large succession of Tic-Tac-Toe games.

Would the person tasked with placing X and O marks still be "playing Doom"?

That's not what I said, I said the blog post was false because the author thoughtlessly digested a YouTube video. It looks like the blog invented some details that weren't actually in the video.