Posted by willwhitedc 23 hours ago
Voz is Parakeet 0.6B v3
Clear is DeepFilterNet 3
Ear is the language predictor from whisper-tiny
...
This is very impressive for a 248MB model. I wonder how good the results are, as an LLM 10x the size is still quite bad at that.
> Hate speech triage. On-device moderation that flags hateful, abusive and threatening text
What could go wrong here?
This also could be ideal if you want your child to play online to have auto-censorship
2. Having human in the loop to review it and subject said human to the worst other humans produce.
Once image support drops this could be a cool addition to https://struktur.sh. Will it be on OpenRouter too or will all inference have to be self-managed? I’m thinking about server-side use cases, where budgets are low, so small models shine.
edit: ah I saw mainly iOS for now. But an integration would be possible on macOS then, right?
We aim to make all our models available cross-platform. There's a subset currently only iOS/macOS, because they take some more effort to port over to Android and web.
Check out the CLI for easy experimentation: https://github.com/Desert-Ant-Labs/desert-ant-cli#desert-ant...
So I think it's some buggy code in their UI that even prevents the model from running.