Technologies tagged with "Lineage"

Monte Carlo is a commercial data observability platform: it monitors tables automatically rather than waiting for hand-written tests, enriches alerts with lineage and root-cause context, and routes incidents through triage workflows.

Datafold is a commercial platform built on value-level data diffing: it compares the output of a proposed change against production in CI, validates parity during warehouse migrations, and monitors metrics for deviation, deployable as SaaS or inside the customer's own cloud.

Apache Atlas is an Apache Software Foundation project providing metadata management, classification, and lineage for the Hadoop ecosystem, with an extensible type system and an authorization path through Apache Ranger.

Collibra is a commercial data intelligence platform whose centre of gravity is governance: stewardship workflows, policies, and a business glossary, with a data catalog, lineage, quality and observability, a data marketplace, and AI governance built around them.

Alation is a commercial data catalog and data intelligence platform combining search and discovery, lineage, stewardship, and data quality, deployable either as the Alation Cloud Service or on the customer's own infrastructure.

Atlan is a commercial metadata platform covering discovery, lineage, glossaries, contracts, and policies across 80-plus sources, delivered as SaaS with a self-deployed runtime that keeps metadata extraction inside the customer's own network.

Microsoft Purview combines data governance — a Data Map that scans and classifies assets and a Unified Catalog above it — with data security and compliance solutions, billed through Azure meters for capacity, scanning, and governed assets.

Knowledge Catalog — previously Dataplex Universal Catalog, and the replacement for the retired Data Catalog — harvests metadata from BigQuery, Vertex AI, Pub/Sub, Bigtable, Cloud SQL, and AlloyDB into entries described by aspects, with natural-language search, lineage, and glossaries over the result.

SQLMesh is a data transformation framework from Tobiko Data that runs SQL and Python models with a plan-and-apply workflow, column-level lineage, unit tests, and virtual data environments that let teams preview changes without rebuilding tables.

Coalesce is a commercial transformation platform that builds warehouse pipelines from reusable metadata-driven nodes and templates rather than hand-written SQL, with column-level lineage, cataloging, and quality checks in one managed service.

Bruin is an open-source data pipeline tool written in Go that combines ingestion, SQL and Python transformations, automated quality checks, and column-level lineage in a single CLI, with a managed cloud layer above it.

dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.

Dagster is an open-source orchestrator organized around software-defined assets — declaring the tables and models pipelines produce — with strong local development and testing.

DataHub is an open-source metadata platform providing search, discovery, and end-to-end lineage across warehouses, pipelines, and BI tools via push-based ingestion.

OpenMetadata is an open-source metadata platform combining catalog, lineage, data quality tests, and collaboration on a single schema-first foundation with many connectors.