One CLI for ingestion, SQL and Python models, and quality checks
Transformation
Bruin is an open-source data pipeline tool written in Go that combines ingestion, SQL and Python transformations, automated quality checks, and column-level lineage in a single CLI, with a managed cloud layer above it.
Python library that loads messy sources into typed datasets
Batch ELT
dlt is an open-source Python library for the extract-and-load stage, inferring schemas, normalising nested data, and handling incremental loading — installed with pip and run wherever Python already runs.
Declarative ELT over the Singer connector ecosystem
Batch ELT
Meltano is an open-source ELT orchestrator that assembles pipelines from Singer taps and targets declaratively in version-controlled YAML, with a hub cataloguing over 600 community-maintained connectors.
Streaming-first data movement with batch and CDC connectors
Batch ELTChange Data Capture
Estuary Flow is a data movement platform built on a streaming core, capturing from databases via CDC and from SaaS APIs, then materialising continuously into warehouses and lakes rather than on a schedule.
Hevo Data is a managed no-code data pipeline platform with over 150 connectors across SaaS applications, databases, and storage, billed by event — each row inserted, updated, or deleted at the destination.
Single-binary CLI for moving data between databases and files
Batch ELT
Sling is a data movement tool distributed as one Go binary, moving data between databases, warehouses, and file storage from the command line or a pipe, with a managed platform available above it.
Visual ELT that pushes transformations into the warehouse
Batch ELT
Matillion is a commercial data integration platform with a visual pipeline builder, loading data into cloud warehouses and pushing transformation work down to the warehouse's own compute rather than processing it separately.
Open-source data integration with a large connector catalog
Batch ELT
Airbyte is a data integration platform that syncs data from APIs, databases, and files into warehouses and lakes, available self-hosted or as a managed cloud service.
SQL-first transformation workflow for analytics engineering
Transformation
dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.
One CLI for ingestion, SQL and Python models, and quality checks
Transformation
Bruin is an open-source data pipeline tool written in Go that combines ingestion, SQL and Python transformations, automated quality checks, and column-level lineage in a single CLI, with a managed cloud layer above it.
Python library that loads messy sources into typed datasets
Batch ELT
dlt is an open-source Python library for the extract-and-load stage, inferring schemas, normalising nested data, and handling incremental loading — installed with pip and run wherever Python already runs.
Declarative ELT over the Singer connector ecosystem
Batch ELT
Meltano is an open-source ELT orchestrator that assembles pipelines from Singer taps and targets declaratively in version-controlled YAML, with a hub cataloguing over 600 community-maintained connectors.
Streaming-first data movement with batch and CDC connectors
Batch ELTChange Data Capture
Estuary Flow is a data movement platform built on a streaming core, capturing from databases via CDC and from SaaS APIs, then materialising continuously into warehouses and lakes rather than on a schedule.
Hevo Data is a managed no-code data pipeline platform with over 150 connectors across SaaS applications, databases, and storage, billed by event — each row inserted, updated, or deleted at the destination.
Single-binary CLI for moving data between databases and files
Batch ELT
Sling is a data movement tool distributed as one Go binary, moving data between databases, warehouses, and file storage from the command line or a pipe, with a managed platform available above it.
Visual ELT that pushes transformations into the warehouse
Batch ELT
Matillion is a commercial data integration platform with a visual pipeline builder, loading data into cloud warehouses and pushing transformation work down to the warehouse's own compute rather than processing it separately.
Open-source data integration with a large connector catalog
Batch ELT
Airbyte is a data integration platform that syncs data from APIs, databases, and files into warehouses and lakes, available self-hosted or as a managed cloud service.
SQL-first transformation workflow for analytics engineering
Transformation
dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.