100$ to train a sort of talkable model in 4 hours? wow

Very cool project! Hopefully it will propel SLM development

This is absolutely fantastic. I really can't wait for the final course to be live. It's in the "shut up and take my money" category. I had so much fun with the nanoGPT videos.

This is going to be the single most powerful boost to my indie research efforts in years. Thank you, Andrej!

I see Karpathy, I click

Built so many nano AIs over the last several years. I have played with nanoGPT, its ok. Just hype for Kpathy... So many tiny LLMs out there now that run on cheap SOCs. Try SmolVLM512, runs fine on a sub $100 pi.

These are the time of community posts that are legendary.

End to end training is a different beast, but finetuning and inference of impressive LLMs like QWEN3 can be done on pretty run of the mill hardware like Apple Silicon macs and gaming PCs if anyone wants a personalized assistant with character. Just ask AI how to finetune AI using unsloth (if using NVIDIA) or MLX (for apple) and it will give you ready to run python scripts.

I wonder, if something like this were trained on Wikipedia, could it become a reliable local Wikipedia search engine, basically?

> nanochat is designed to run on a single 8XH100 node