1-Bit Bonsai Image 4B Image Generation for Local Devices

Posted by modinfo 4 hours ago

1-Bit Bonsai Image 4B Image Generation for Local Devices(prismml.com)

121 points | 40 commentspage 2

moralestapia 1 hour ago|

This is why I don't think the big AI companies and nvidia will dominate the market. AIs will just run locally, on whatever hardware you have. Perhaps that's why they worked on this yet-to-be-defined partnership with ARM.

MitPitt 3 hours ago||

Lately I've noticed posts with barely 10 points getting to HN frontpage. Was it always like this?

robbomacrae 3 hours ago||

I believe it's the way the HN algorithm works. In order to give new and obscure posts a shot, it will add them to peoples feeds in their front page and see how they measure. Otherwise new posts wouldn't get seen and the flywheel would never get started.

So everyone acts as a sort of beta tester for obscure posts.

s-macke 3 hours ago|||

On weekends, yes. During the week, that’s also true if they arrive within a short time frame, e.g., three minutes. Almost no one looks at “New”. That is the real issue.

blurbleblurble 2 hours ago|||

Maybe the algorithm has some kind of "momentum" to it, taking into consideration the velocity of upvotes.

DannyPage 3 hours ago|||

Not as much competition on the weekend?

nickvec 2 hours ago|||

If you are looking to see the "true" HN frontpage (i.e. most upvoted posts), I'd recommend using https://hckrnews.com

Aboutplants 3 hours ago||

I just assume bots

iamjackg 3 hours ago||

Bots doing what? How would the poster being a bot influence why the post itself makes it to the front page with just 10 points?

speedgoose 2 hours ago||

It’s about how quickly they get those points. It doesn’t have to be bots. Sending a post to friends with reputable human profiles, and asking for a vote kinda works of most social networks. Some social networks claim they have protection against this but I wouldn’t bet they catch everything.

woadwarrior01 1 hour ago||

The text encoder is still 4-bit quantized.

sudb 2 hours ago||

Very interested to see where this kind of work goes for on-device video generation!

janniks 2 hours ago||

I was expecting to see images of Bonsai trees when I clicked this

tobr 2 hours ago|

I expected a small tree in black and white pixel art.

iJohnDoe 2 hours ago||

Does anyone ever get their stuff to actually work. Like actually load?

jeroenhd 2 hours ago|

The online demos require WebGPU so Firefox on mobilr and privacy enhanced browsers will break. WebGPU support on Linux and other open source systems is also trash, you can force it to work in Chrome but it won't be happy.

SilentM68 2 hours ago||

Question,

Is it compatible with Ollama, ComfyUI or are those providers unneeded, compatible with low-end hardware?

Also, where does "./setup.sh/ drop the components in Linux?

Thank you, Sol

yieldcrv 3 hours ago|

impressive, combines a couple techniques that I always wanted the frontier models to have

having trouble loading the webgl browser demo on my phone but no biggy