Top
Best
New

Posted by jiant 6 hours ago

Show HN: We compressed a 31B video+audio diffusion model to 14B, 6 steps, INT8(github.com)
46 points | 10 comments
swiftcoder 4 hours ago|
This is very cool, I wish they would make quality+time comparisons between the various quantisations though
amelius 2 hours ago||
Yeah this is only meaningful if you can compare quality at least.

Otherwise, it's just like saying: we compressed a JPEG file to 50% of its size using some compression level and we didn't check what it looks like.

Reubend 4 hours ago||
Seconded, I'd like to see a head to head comparison to see how the quant loks vs the original
ricardobeat 3 hours ago||
Their product page has sample videos: https://www.videorebirth.com/lp/hyperflow-flash
kodablah 2 hours ago||
Am curious how this compares perf/quality wise with FastVideo's FastH3 trim/omni which I have been using pretty well with a basic laptop NVidia card (e.g. 5s 480p video w/ audio in 90s).
xrd 4 hours ago||
I see references to comfyui in the readme. Is that the easiest way to run it? I've always found it a bit cumbersome to use and wish I had something like a simple CLI tool to use it like llama.cpp. Perhaps that's not possible with a video diffusion model?
syntaxing 3 hours ago||
I use stable diffusion cpp with a LLM driving it using CLI. It’s been the quickest way for me to run new diffusion models and require near zero skills but the results come out great.
_boffin_ 3 hours ago||
care to go more into your loop that you've setup
syntaxing 2 hours ago||
Not much too it! Use Hermes, *Claw, Claude cowork, etc and go like "setup this model <huggingface link> using stablediffusion cpp on this computer." Then when its done, in the same session "Use this as the main image (or video) generator moving forward" and it'll change the config
swiftcoder 4 hours ago||
They also have references to stable-diffusion.cpp, which is probably the closest analogue to llama.cpp in this space
blovett80 4 hours ago||
[flagged]
jiant 6 hours ago|
[flagged]