I am genuinely worried about violence, especially if people start losing their jobs due to automation.

Yeah could get interesting. Things like legal, programming, math, etc. are going to be relatively cheap / free. Meanwhile something like natural resources, building things, yardwork, etc. may go up in value. Or perhaps we end up with a relatively "spiky" economy since 90% of people are just doing physical jobs (the only human jobs with value), and the AI owner class of course gains all the value from intellectual products (with value diminishing towards cost of electricity). Thinking as human value may be roughly as valuable as it ever was (which is to say nearly non-existant other than the ability to solve an immediate physical problem). Might also be that physical strength and stamina are the highest value mating traits, since they will be able to protect and provide. Physically weak intellectual types will have little value since they can't out-think the machines, and they also can't provide for a family by doing valuable physical tasks. IQ overall begins to drop as mating favors intelligence less and less, as it can actually be an impedance to being productive.

For a short time in history, the ability to obsessively focus on intellectually interesting abstract concepts was highly lucrative, but just as quickly we returned to the laws of nature: those who can lift and move succeed, those who can only think are automated out of existance.

We go from a species increasingly seeing themselves as "brains with bodies" to "amazing bodies with weak brains". The limitation of robots and AI in the physical realm, power hungry, mobility limited are contrasted with human values: energy efficient, highly mobile and dexterous, extremely good strength/speed/size ratios. The brain on the other hand, while energy efficient, is completely outclassed and seen as we see our swimming/jumping abilities: a novelty for sports, but nothing we seriously consider a defining human trait.

The smartest humans can fill weekends with novelty pursuits like building circuits, games, programs, etc. But they are about as useful as whittling and hobby woodcraft, something to pass time, but ultimately of no economic value.

Of course, but who (what?) is going to make the food and the shelter?