Top
Best
New

Posted by ibotty 22 hours ago

A Preview of DuckDB v2.0(duckdb.org)
646 points | 116 commentspage 2
ivolimmen 6 hours ago|
I am a crew member of Joy Of Coding (https://joyofcoding.org) where we invited Hannes to do a talk. He is a great speaker. Seeing this we will need to invite him another time!
aleda145 19 hours ago||
Excited about a stable C++ API for extensions!

I made a dry run extension a few months ago (https://github.com/aleda145/duckdb-dryrun), will be so nice to build it just once and know that it will always work.

Also urge anyone to make an extension, the template makes it quite smooth: https://github.com/duckdb/extension-template

MILP 4 hours ago||
Love DuckDB. It’s so fast and portable! I mainly use the query engine as part of my ETL process for creating SQLite database. I’d love to pitch it at work, but we’re heavily invested in BigQuery, which makes it a bit difficult.
c9cf35860db4 21 hours ago||
The last year of DuckDB enhancements feel like the shift from in-process execution engine (which it is phenomenal at) to an engine that can serve as the foundation of a cloud data warehouse. I know the founders were reticent about not wanting to build that, but I have a feeling it is in the works.
jbmsf 21 hours ago||
I've been using MotherDuck as a data warehouse for some time now. No regrets.
ethagnawl 20 hours ago||
UPDATE: Removed uninformed comment about the relationship between DuckDB and MotherDuck.
Tomte 20 hours ago||
Wait, what? I‘ve always assumed MotherDuck is the company by the main developers of DuckDB? They are unrelated?
ethagnawl 20 hours ago|||
I was wrong. Apologies.

> They decided to work together, and DuckLabs would become a co-founder of the new endeavor.

https://motherduck.com/about-us/

jeremyjh 16 hours ago|||
They launched ducklake: https://ducklake.select/
amluto 19 hours ago||
If I could have a pet feature added to DuckDB, it would be some form of native ordered table. In a database like Clickhouse or any of the dedicated time series DBMSes or log stores, there’s a built-in concept that a table might have an order, and the database will optimize based on the order. But, for databases that are logically just bags of rows (traditional DBMSes and also DuckDB [0]), you either need an index or you need to rely on full table scans or at least scans of big blocks. DuckDB does the latter really well, but I think it would be quite nice for some workflows to have explicit ordering. Also, I bet compression could work a lot better with ordering hints.

All that being said, I’m quite excited about DuckDB 2.0. I want to give the improved VARIANT support a try.

[0] Documentation on DuckDB’s native format is rather sparse AFAICT. But the DDL has nothing resembling an ordered table.

tpetry 15 hours ago||
You‘re not the only one interested in this. But seems its a big change that would have to change many parts within DuckdB:

https://github.com/duckdb/duckdb/discussions/8444

amluto 15 hours ago||
Neat!

I’m sort of amazing that nothing in that thread mentioned ClickHouse, even just as a product that has this capability and from which one might take syntactical inspiration.

ignaciovdk 18 hours ago||
Arc does pruning, and make that scan faster. Check it out: https://github.com/Basekick-Labs/arc
noodlesUK 17 hours ago||
I look forward to DuckDB being the engine that underpins the next gen of analytical data tooling. DuckLake already looks amazing and with the Quack protocol seems like it will be a great natural fit for lots more types of tooling, such as sensor data etc.
dangoodmanUT 13 hours ago||
It's funny to me that we still don't have incremental materialized views. All of the parts are there (export state, agg_state (forget fn name), finalize). I wonder if they're avoiding an explicit war with clickhouse or something. I do recall they mentioned they want to add this to ducklake.

Incremental MVs are ClickHouse's best feature. If DDB adds this, the last moat is distributed query execution.

hantusk 5 hours ago||
It is implemented here as DuckDB extension: https://github.com/ila/openivm/
ghshephard 12 hours ago||
Have you run into scenarios where a simple view doesn't accomplish what you require? I always feel like views do everything I want - because the speed is so great, the full recompute isn't that big a deal.

Maybe it's a bigger deal when you have multiple users/and or more repeated queries against something that's really expensive?

Pedro_Ribeiro 11 hours ago||
I've had some use cases with low latency requirements and frequent data updates. If you want to serve data on a frontend fast it's often not feasible to recompute everything every time
mastermage 5 hours ago||
I love DuckDB genuinely more than sqlite even though they do completely different things but DuckDB has like for me the perfect mix between simplicity, embedded capabilities and expressiveness. (and actual Time and Date Types).
barrrrald 14 hours ago||
We've built our whole platform around DuckDB at Hex. Our product truly could not exist without it.
nikolay 15 hours ago|
It's sad that almost no migration framework supports DuckDB, and overall support is highly limited, but it's a great product I've been using daily for 6 months without encountering a single issue. I hope v2 brings DuckDB more attention and increases third-party support!
More comments...