Top
Best
New

Posted by emschwartz 5 hours ago

Moving our warehouse off DuckDB(posthog.com)
127 points | 93 commentspage 3
solatic 2 hours ago|
There are two kinds of companies: those who know how to build low-level tools that serve as foundation and moat for business growth, and those whose middle managers wring their hands about what their people will be able to maintain and constantly chase off-the-shelf solutions to stitch together.

I know which company I'd rather pick as a vendor.

Thaxll 4 hours ago||
Translation: frontier models are so good that we can rewrite our own warehouse infra.
bhouston 4 hours ago||
6 months from now: We are moving our warehouse off of Trino + HogLake to newer technology XXX.

This is ridiculous. Why can you not foresee such issues? Do you not do testing with mock data at the size you need? Migrating production between stacks so often means you are not getting new features in. This is pure churn.

mgfist 4 hours ago||
HogLake is quite the name ..
jauntywundrkind 3 hours ago||
One thing I really appreciate about CloudFlare blog posts is that often they show their work, by showing what tickets they opened, what improvements they land upstream. With this march across clickhouse, duckdb, now trino, I'd love to know what if any places the team worked with upstream, what improvements got tried.

I'm pretty ok with the march across products myself. It felt like the big shift was from shared giant clickhouse to lots of duckdbs. I wonder what juggling many more clickhouses would have been like. Excited and hopeful to here more back on Trini, with hope!

It's wild how many really really good data stacks are out there. Apache has been collecting some absolutely stellar projects. And it feels like the rest of world meaning everyone but China is kind of sleeping on a lot of these options. Maybe it's just that these projects often go out of their way to have a place for emblems, for who is using the project, but a lot of these have pretty wide ranges of companies using them.

I do wish we were still in an age of company blogging, where people did talk more to the tech getting played with, talk to what's cooking in the shop. It's great to have these outreaches. There's so much tech and we are just so quiet about it! There's so much less signal to go off of, so much less shared awareness than the aughts and 10's.

tonpork 3 hours ago||
[flagged]
sick_of_slop 4 hours ago||
[dead]
kburman 2 hours ago|
[flagged]