Top
Best
New

Posted by tomasol 1 day ago

SQLite is all you need for durable workflows(obeli.sk)
638 points | 341 commentspage 5
0x59 23 hours ago|
Big complex data model with ambiguous query patterns? Postgres

Small, well defined, data model with known query patterns? Bespoke model

There probably is a place for sqlite and my project space so far hasn't yet well-aligned with it.

asdff 23 hours ago|
Probably going to get some winces for this but I do everything with flat files. Maybe my data aren't massive enough, but I mean I can do the relational thing by just having these metadata in some column, and returning rows that contain my desired information in these columns. Even if the file were too big to fit into memory one could just subset chunks of it and chew through. All this can be done with no dependencies, just base libraries of a lot of languages.
fathermarz 20 hours ago||
Excellent write up and inspired me for our next IA design run. After reading Fly’s Litestream work it makes me think this is a solid option.
ryanisnan 12 hours ago||
Sweet I get to tell my team we can move off of dapr workflows
delduca 18 hours ago||
No, mmap is all you need.
netik 23 hours ago||
Until you scale past one machine…
bze12 23 hours ago||
Isn’t this very similar to cloudflare durable objects & workflows?
dnnddidiej 16 hours ago||
Butchering the Beatles song again.
tomasol 2 hours ago|
sorry about that, I do love Beatles!
nodesocket 21 hours ago||
The biggest annoyance about SQLite for me is no ability to:

    ALTER TABLE users MODIFY COLUMN…

    ALTER TABLE users ALTER COLUMN…

    ALTER TABLE users ADD CONSTRAINT…

You have to create a new temporary table with correct schema, copy data into this new table, drop the old table, and then rename the temporary table.
simonw 20 hours ago|
They've been improving that recently:

2026-04-09 (3.53.0) - "Enhance ALTER TABLE to permit adding and removing NOT NULL and CHECK constraints"

I use my own sqlite-utils CLI/Python library to work around these limitations: https://sqlite-utils.datasette.io/en/stable/python-api.html#...

nodesocket 20 hours ago||
Ahh that's very nice. Unfortunately the default version of sqlite3 provided by Debian Trixie is 3.46.1.
shevy-java 11 hours ago||
Hmmm. SQLite is great, but I remember years ago, at a university cluster, I had to populate a SQL database via tons of INSERT statements from genomic/meta-genomic workflows. Postgresql was so much faster just at that particular action (inserting data) that it convinced me that SQLite may be useful for many, many applications, but for "big data"(sets), Postgresql is simply better.
3dedb728-3f77 20 hours ago|
Is this just a AWS ads?
More comments...