Transformation Frameworks

Data architecture technologies for sQL-first frameworks that turn raw landed data into modeled, tested, documented tables.

Transformation framework with virtual environments and no wasted rebuilds
Transformation
SQLMesh is a data transformation framework from Tobiko Data that runs SQL and Python models with a plan-and-apply workflow, column-level lineage, unit tests, and virtual data environments that let teams preview changes without rebuilding tables.
SQL transformation workflows for BigQuery, free as a service
Transformation
Dataform is a service for developing, testing, version-controlling, and scheduling SQL transformation workflows in BigQuery, built on an Apache-2.0 meta-language and offered on Google Cloud at no charge beyond the BigQuery it runs.
Column-aware transformation built from reusable patterns, not one-off SQL
Transformation
Coalesce is a commercial transformation platform that builds warehouse pipelines from reusable metadata-driven nodes and templates rather than hand-written SQL, with column-level lineage, cataloging, and quality checks in one managed service.
One CLI for ingestion, SQL and Python models, and quality checks
Transformation
Bruin is an open-source data pipeline tool written in Go that combines ingestion, SQL and Python transformations, automated quality checks, and column-level lineage in a single CLI, with a managed cloud layer above it.
SQL-first transformation workflow for analytics engineering
Transformation
dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.
Transformation Frameworks – Matca