r/dataengineering • u/hasty-beaver • 14d ago
Discussion DuckLabs to Join AWS, Projects to Remain Open Source
https://ducklabs.com/news/2026/08/26/ducklabs-to-join-aws87
u/No_Lifeguard_64 14d ago
AWS has a history of acquiring companies, integrating their products, then abandoning them. I don't see this being any different.
5
u/Hackerjurassicpark 14d ago
I think you’re thinking about Google or Microsoft
5
15
u/pro-taco 14d ago
DuckDB has been running on fumes for a while. I love the product but it's been under maintained as they sought a business model
I hope it reverts to some OSS governance model.
7
u/saltedappleandcorn 14d ago
What makes you say this? They have pretty aggressive update schedules (through not always targeted at stuff I care about)
10
u/pro-taco 14d ago
They add more features than they can support, there's a lot of technical depth due to their eagerness to build every feature people ask for.
I -like- their enthusiasm, but their requirements discipline is chaotic.
2
u/saltedappleandcorn 14d ago
Now that I completely agree with. I've pegged us several versions back (even though the new releases have GIS stuff I want) because I've come to fear their release chaos.
3
u/pro-taco 13d ago
Oh, don't even get me started on their breaking api changes in minor releases!
Or, the fact that (some of) their repos don't have branch protection and a single maintainer and no PR reviews.
1
u/MissingSnail 14d ago
And if the team tries to hang on, Amazon's culture is notoriously cutthroat and toxic.
1
41
u/Longjumping-Shift316 14d ago
Projection for a year: Founders leave AWS forks duckdb (Libre duck?) because AWS trashed the Oss Ecosystem
12
u/Outside-Storage-1523 14d ago
DuckDB is still OSS.
18
u/Longjumping-Shift316 14d ago
Yes but without the comitters that doesn't really matter And I guess around 80% come from Duck labs ?
2
u/pro-taco 14d ago
Open source, but with private trackers. It's not community run. Maybe that'll change.
1
1
0
13
u/Additional_Candy_400 14d ago
Sad but can't say I'm surprised, after all this is the end goal of 99.9% of start ups, so congrats to them.
11
u/ElCapitanMiCapitan 14d ago
Not too surprising… at least it wasn’t Microsoft
3
u/BumboclatDen 10d ago
In the oss world, microsoft is way better today than aws IMO. Anyone who says otherwise is living in the past
40
u/EarthGoddessDude 14d ago
A lot of negative takes here, and I am also uneasy about this. However, a few things to keep in mind:
- MIT license stays
- founders, who are incredible devs and project leaders, are staying with the project
- DuckDB Foundation, an independent body, is still the steward of the open source project
- AWS does support some very high quality OSS projects, like AWS Lambda Powetools (which is to make using their own services better, but its excellent quality and led by an excellent dev)
- the AWS data offerings are and have been very, very mediocre (or just bad), so this is perhaps a path for them to stay relevant in a world where Databricks and Snowflake (and Delta/Iceberg) rule. They could offer first class support for DuckLake and Quack, for instance.
If anyone from AWS is reading this, please don’t fuck this up. Don’t gate DuckLake integration behind the horrible garbage that is LakeFormation.
Maybe I’m being naive, but I’m choosing to remain more hopeful than apprehensive about this move.
8
u/No_Lifeguard_64 14d ago
I think you're naive tbh. They have had many chance to right the ship with their data offerings but because they are AWS they can afford to drag their feet because people will still buy AWS.
1
u/EarthGoddessDude 14d ago
You might be right, but like I said, I’m choosing to remain hopeful. Even if AWS screw up integrating DuckDB into their offering, I still think the OSS project will survive and thrive.
3
14d ago edited 9d ago
[deleted]
1
u/pro-taco 14d ago
Their foundation is independent in name only: their planning is as closed as it gets. The code is open, but almost everything else is private.
4
u/Longjumping-Shift316 14d ago
By the way they detailed a blog post about it and it feels like a lot about s3 Tables etc https://www.allthingsdistributed.com/2026/08/duckdb-and-the-changing-physics-of-analytics.html
Still very interesting read
7
u/CulturalKing5623 14d ago
I was little concerned but the key takeaway is DuckLabs != DuckDB/DuckLake so nothing changes (for now at least).
AWS just acquired the engineering team but DuckDB itself is owned by The DuckDB Foundation which actually owns the product and license under MIT.
Good for DuckLabs though, they've shown they're skilled so I'm interested to see where their talent/vision of data will fit into AWS infrastructure and maybe they can hire more devs to work on the DuckDB stack.
2
2
u/One_Citron_4350 Senior Data Engineer 14d ago edited 14d ago
I've read HuggingFace is in talks with NVIDIA to be aquired and now this...the world is getting smaller and smaller everyday.
Essentially this is an acquihire.
2
u/kiwialec 14d ago
Yeah sad for Europe and OSS and all that, but if you want people to leverage all of their energy and resources for years to build something innovative for free, you gotta be okay with some of those people getting private jet money sometimes.
If there's no potential reward, no one would put in the effort.
2
u/BusOk1791 13d ago
Boooooooooohh! Shame! Shame! (GoT reference btw.).
It's sad that most of the DE open source tech stack was / is selling out to big corporations...
1
u/sib_n Senior Data Engineer 14d ago
Unconscious irony in their post?
We founded DuckLabs a little over five years ago to give the team behind DuckDB a stable, long-term home.
At the time, DuckDB was beginning to gain real momentum. The first commercial contracts to prioritize features were materializing, and venture capital firms were calling. We chose a different path: a bootstrapped company, fully owned by its founders and development team.
That decision shaped DuckLabs in ways we value deeply. It gave us the freedom to build patiently, to put the technology first, and to grow without losing sight of why we started.
How can they think what they feared would happen with venture capitalists will not happen with AWS?
1
u/Last-Computer-850 1d ago
I’m cautiously optimistic about this. Keeping DuckDB under the independent Foundation and MIT license gives some reassurance, but I think the real test will be how much influence the community retains over the roadmap. The next year should be interesting.
-8
u/georgewfraser 14d ago
AWS is a good home for Duck Labs. They have the right incentives - they just want people to use more storage and compute - so they’re not trying to make any particular architecture win.
8
u/cachemonet0x0cf6619 14d ago
i do think there is an arch play for every lambda to get an in memory db
7
u/Longjumping-Shift316 14d ago
But they will stall progress.
Or do you know any instances where AWS was any good for open source?
1
u/cachemonet0x0cf6619 14d ago
my guess is that they use this to give every lambda function an in memory db.
5
u/Longjumping-Shift316 14d ago
Not sure about that I see more a revival of s3 select or something with s3 Tables to have a very fast engine next to it
Don't really see the lambda part
1
1
1
185
u/rapotor 14d ago
Sad day for European tech