Posted by aratahikaru5 22 hours ago
That said, your computer will still get hot!
Now that model is mostly useful for writing or chatting.
From productivity point of view, it doesn’t make sense to have any notebook running a local LLM.
We have one life. We should spend it wisely.
We need more like this as well as llama.app, which also has a native mac app.