Integration with duckdb #2384
didier-nimble
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi there,
I am wondering if this project would consider adding duckdb integration in a similar fashion to the sqlite integration.
Adding duckdb as IO back end would provides the ability to read duckdb and parquet file formats. Both of these database formats are column oriented. Duckdb reads only the necessary columns (not the entire file) using multiple threads.
In the long run, adding duckdb can even provide abilities to read data from S3, postgres or multi threaded reads from sqlite. All these features requires plugins but could help the soufflé project in the right circonstances.
Beta Was this translation helpful? Give feedback.
All reactions