DuckDB is an open-source, in-process analytical database — often described as "SQLite for analytics." It runs embedded in the host process with no server, delivering columnar, vectorized SQL execution on a single machine.

It queries Parquet and CSV files, object storage, and in-memory dataframes directly, with first-class integrations for Python and R. Extensions add capabilities such as reading Iceberg and Delta tables and remote filesystems.

DuckDB fits local analytics, pipeline steps that comfortably fit one node, embedded analytical features inside applications, and development workflows against lake data. It frequently replaces small Spark jobs where distribution is unnecessary; MotherDuck offers a commercial serverless service built on it.

Capabilities:

Processing

DuckDB

DuckDB is an open-source, in-process OLAP database — an embeddable columnar SQL engine that queries Parquet, CSV, and dataframes with no server to run.

Visit DuckDB

Capabilities:

Processing

Tags:

batch olap open-source python sql

Similar to DuckDB

View all technologies

dbt

SQL-first transformation workflow for analytics engineering

Processing

dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.

Apache Spark

Unified engine for large-scale data processing

Processing

Apache Spark is an open-source distributed compute engine for batch processing, SQL, machine learning, and stream processing across large clusters.

Trino

Distributed SQL query engine for federated analytics

Processing

Trino is an open-source distributed SQL engine that queries data where it lives — object storage, lakehouse table formats, and operational databases — through a single interface.

Similar to DuckDB

View all technologies

dbt

SQL-first transformation workflow for analytics engineering

Processing

dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.

Apache Spark

Unified engine for large-scale data processing

Processing

Apache Spark is an open-source distributed compute engine for batch processing, SQL, machine learning, and stream processing across large clusters.

Trino

Distributed SQL query engine for federated analytics

Processing

Trino is an open-source distributed SQL engine that queries data where it lives — object storage, lakehouse table formats, and operational databases — through a single interface.