So video gen models basically can be extrapolated to control robotics ? How long until Veo3 robots take over?

> right now, you need to show the robot pictures of what you want it to do. want it to "clean the kitchen"? better have a photo of a clean kitchen handy.

What about using Flux Kontext (or Controlnets) to turn the messy kitchen into a clean kitchen?

Put tiny cams on robot arms and let it control them. They can be flimsy for safety. If it is sure something is happening say nothing, if it is 70-99% sure have it guess what is going on, if <70% have it ask what is going on.

i thought all the cool data driven robotics stuff was like reinforcement learning from sensors that track moving effectors in the real world with online retraining that mimics the sensorimotor experimentation that is observed during the developmental phases of real neurobiological systems?

so you just kinda let it run for a while and it bumps and squirms around until it stands up or whatever.

seems also the future for real ai?

I don't know. I'm not the expert, but if you've ever tried to a backflip or anything where your toes are above your head, then you'll know that spatial awareness goes well beyond vision. Or if you throw a frisbee for the dog to catch, they don't actually look at it while running; they look, predict position, then move in. Veni, vidi, vici. So any model that "learns physics" just through vision seems flawed from the start. What's your thought there?

I wonder how much language does this model understand. If we pan across text will it fill in sensible next word? How good will it be?