Discover and compare data architecture technologies
Matca is a curated directory of data architecture technologies, organized by capability. Browse licenses, deployment models, and adjacent tooling to choose the right components for your platform.
Discover and compare data architecture technologies – Matca
Open-source data integration with a large connector catalog
Ingestion
Airbyte is a data integration platform that syncs data from APIs, databases, and files into warehouses and lakes, available self-hosted or as a managed cloud service.
Debezium is an open-source CDC platform that streams row-level changes from databases such as PostgreSQL, MySQL, and MongoDB, typically via Kafka Connect.
Managed cloud data warehouse with separated storage and compute
Storage
Snowflake is a commercial cloud data platform offering elastic SQL warehouses, cross-account data sharing, and multi-cloud availability as a fully managed service.
BigQuery is Google Cloud's serverless, fully managed data warehouse with on-demand or capacity-based pricing, streaming ingestion, and built-in ML functions.
Column-oriented OLAP database for real-time analytics
Storage
ClickHouse is an open-source columnar database designed for low-latency analytical queries over large volumes, available self-hosted or as ClickHouse Cloud.
Open storage framework with ACID transactions for data lakes
Storage
Delta Lake is an open-source table format providing ACID transactions, schema enforcement, and time travel over Parquet files, closely integrated with Spark and Databricks.
SQL-first transformation workflow for analytics engineering
Processing
dbt is a transformation framework that compiles modular, version-controlled SQL models and runs them inside the warehouse, with testing, documentation, and lineage built in.
Distributed SQL query engine for federated analytics
Processing
Trino is an open-source distributed SQL engine that queries data where it lives — object storage, lakehouse table formats, and operational databases — through a single interface.
In-process analytical database for local and embedded analytics
Processing
DuckDB is an open-source, in-process OLAP database — an embeddable columnar SQL engine that queries Parquet, CSV, and dataframes with no server to run.
Apache Kafka is an open-source distributed log for high-throughput, durable event streaming, with a large ecosystem including Kafka Connect and Kafka Streams.
Apache Flink is an open-source framework for stateful computation over unbounded and bounded data streams, with event-time processing and exactly-once state consistency.
Kafka-compatible streaming platform in a single binary
Streaming
Redpanda is a Kafka API-compatible streaming platform written in C++, shipped as a single binary without ZooKeeper or a JVM, available self-hosted or as a managed cloud.
Apache Airflow is the widely adopted open-source orchestrator where pipelines are Python-defined DAGs, with a large provider ecosystem and multiple managed offerings.
Dagster is an open-source orchestrator organized around software-defined assets — declaring the tables and models pipelines produce — with strong local development and testing.
Pythonic workflow orchestration for dynamic pipelines
Orchestration
Prefect is an open-source orchestration framework where plain Python functions become flows and tasks, aimed at dynamic, failure-tolerant pipelines with minimal boilerplate.
DataHub is an open-source metadata platform providing search, discovery, and end-to-end lineage across warehouses, pipelines, and BI tools via push-based ingestion.
Unified metadata platform for discovery, lineage, and quality
Governance
OpenMetadata is an open-source metadata platform combining catalog, lineage, data quality tests, and collaboration on a single schema-first foundation with many connectors.
