Top
Best
New

Posted by ent1c3d 2 days ago

Show HN: Lightweight Task queue on Erlang/OTP, SQLite-backed, no overengineering(github.com)
Setting up Kafka or such enterprise oriented software with their clusters or dedicated servers is heavy and bothering enough that most small teams or indie hackers skip it entirely and making compromise to use in-memory queues.

I wanted something in between: a persistent queue that is simple to run (one binary, which makes one sqlite db), gets real fault isolation and crash recovery due to Elixir, easy to inspect (open ezra.db in any SQLite browser and see every task), and requires no new client library - it speaks the Redis Streams wire protocol, so any Redis client in any language just works out of the box.

Very short demo video: [https://www.youtube.com/watch?v=MLYyD3DVWmE]

35 points | 6 comments
abrookewood 3 hours ago|
Congrats on the launch. Using the Redis protocol was a pretty clever choice. Does it have to run as a stand-alone server?
neoecos 3 hours ago||
Oban is really awesome, are you inspired by it?
skrebbel 3 hours ago|
Title said “no overengineering” so I doubt it.
xlii 25 minutes ago||
I would argue that Oban isn't overengineered.

If so should we also consider PostgreSQL overengineered?

It's a shame OP decided to use Elixir as base, many ecosystems don't have mature task queues (e.g. for Rust I had to roll my own: simple_queue) so the space IMO would be more welcoming.

On OTP doubt anything can even make a dent in Oban user base.

cpursley 3 hours ago||
This is nice. For those wanting to stay on Postgres for DAG type of workflows, check out pgmq based PgFlow: https://github.com/agoodway/pgflow
tenwz1 3 hours ago||
good
anapeksha 2 days ago|
[flagged]