Posted by falperc 9 hours ago
It can classify MNIST digits, even if you write these digits on the map!
It can talk(kinda)
You can use it to make decisions, so, it can play DOOM. Yes! You can play DOOM with thousands of DOOM games now! The marine's mind can be controlled by DOOM, playing on a map generated by DOOMFORMER. Truly, the possibilities are endless, and even larger-scale training of DOOMFORMER could be done on a measly T4.
If anyone would like to help me scale this up and make crazier things, I'd love to work together.
Nothing on this page looks made by a human, its _all_ generated, not a tiny bit of it, _all_ of it.
Guess having the word "doom" and "transformer"in your publication is enough today.
>a handwritten digit takes 163 seconds of real-time DOOM in one map at the default schedule and 8 seconds at --opt 3.
What does this refer to? What does schedule mean here, and what are these opt levels?
Edit: oh sweet Jesus
https://github.com/mottopanikeiku/doomformer/blob/main/docs/...
I havent fully recursed but what I have done with this is use a DOOMformer to generate a level, have python compile it, have DOOMformer generate the name of the level, and use a DOOMformer brain to complete said level. I have also trained said DOOMformer (you can see the levels "weights" updating as it trains) to aim better lol
I made a classifier play doom[0]. But you turned the whole network into Doom! Amazing