Does this mean astra was perhaps trained on neural weights data as a attempt of RSI by openAI?

Given how trivial this seems to be to try, has anyone here attempted to reproduce any of these findings yet?

Can it also tell us what those weights mean?

I had the impression that's the missing piece.

this is actually cool , now thinking that actually weights can be understood by llms , and they can be edited by them . there has to be mindset shift that llms not only understand what we understand (natural language) - but can understand the fundamental language of models.

So can we replace the optimizer (e.g. Adam) by an LLM and get better/faster convergence?

talk about homoiconicity haha

lisp people will be in awe

This would allow a swarm of agents to teach eachother new knowledge, no? Group learning?

I wonder what would happen if it was modifying its own weights during inference.