Technologies tagged with "Commercial"

The Lakehouse runtime catalog — until April 2026, BigLake metastore — is Google Cloud's fully managed, serverless implementation of the Apache Iceberg REST Catalog API, letting Spark, Flink, Hive, Trino, and BigQuery share the same Iceberg tables without duplicating files.

The Buf Schema Registry stores versioned Protobuf modules rather than individual topic schemas: pushes are linted and checked for breaking changes before they reach consumers, generated SDKs are published to native package managers, and a Confluent-compatible endpoint serves Kafka clients.

The AWS Glue Schema Registry is a serverless registry for streaming schemas — Avro, JSON Schema, and Protobuf — with eight compatibility modes, open-source serialisers, and integrations across MSK, Kinesis Data Streams, Managed Service for Apache Flink, and Lambda. AWS's documentation states it is free to use.

Monte Carlo is a commercial data observability platform: it monitors tables automatically rather than waiting for hand-written tests, enriches alerts with lineage and root-cause context, and routes incidents through triage workflows.

Anomalo is a commercial data quality platform that applies machine learning to detect anomalies without hand-written rules, and can be deployed either as SaaS or entirely inside the customer's own VPC so that data never leaves their environment.

Datafold is a commercial platform built on value-level data diffing: it compares the output of a proposed change against production in CI, validates parity during warehouse migrations, and monitors metrics for deviation, deployable as SaaS or inside the customer's own cloud.

Collibra is a commercial data intelligence platform whose centre of gravity is governance: stewardship workflows, policies, and a business glossary, with a data catalog, lineage, quality and observability, a data marketplace, and AI governance built around them.

Alation is a commercial data catalog and data intelligence platform combining search and discovery, lineage, stewardship, and data quality, deployable either as the Alation Cloud Service or on the customer's own infrastructure.

Atlan is a commercial metadata platform covering discovery, lineage, glossaries, contracts, and policies across 80-plus sources, delivered as SaaS with a self-deployed runtime that keeps metadata extraction inside the customer's own network.

Microsoft Purview combines data governance — a Data Map that scans and classifies assets and a Unified Catalog above it — with data security and compliance solutions, billed through Azure meters for capacity, scanning, and governed assets.

Knowledge Catalog — previously Dataplex Universal Catalog, and the replacement for the retired Data Catalog — harvests metadata from BigQuery, Vertex AI, Pub/Sub, Bigtable, Cloud SQL, and AlloyDB into entries described by aspects, with natural-language search, lineage, and glossaries over the result.

Amazon DataZone is AWS's data management service for cataloguing, discovering, sharing, and governing data across AWS, on-premises, and third-party sources, organised around projects that publish assets and subscription requests that are approved through a governed workflow.

AWS Step Functions is a serverless orchestrator built on state machines: each step is a state that calls an AWS service or an external worker, execution history is retained and visually debuggable, and the bill is per state transition rather than per server.

Power BI is Microsoft's business intelligence platform — free Windows authoring in Power BI Desktop, publishing and sharing through the Power BI service at a per-user price, and an on-premises Report Server for organisations that cannot publish to the cloud.

Tableau is Salesforce's business intelligence platform, licensed by role — Creator, Explorer, Viewer — and deployable either as the hosted Tableau Cloud or as Tableau Server on the customer's own Windows or Linux machines.

Looker is Google Cloud's business intelligence platform, built around LookML — a version-controlled modelling language in which metrics and joins are defined once and every dashboard, explore, and API call is generated from that definition rather than from ad-hoc SQL.

Amazon Quick Sight — until October 2025, Amazon QuickSight — is AWS's serverless business intelligence service, billed per user or per session, with SPICE, its in-memory engine, caching data for dashboards that must stay fast without hammering the source.

Sigma is a cloud analytics platform whose interface is a spreadsheet: business users pivot, filter, and add formulas against live warehouse tables, with input tables writing values back into the warehouse rather than into a local file.

Coalesce is a commercial transformation platform that builds warehouse pipelines from reusable metadata-driven nodes and templates rather than hand-written SQL, with column-level lineage, cataloging, and quality checks in one managed service.

Amazon Athena is a serverless interactive query service that runs SQL directly against data in Amazon S3, with no infrastructure to provision and a bill computed from the data each query scans.

Starburst is the commercial platform built on Trino, sold as Starburst Enterprise for self-managed clusters and Starburst Galaxy as a fully managed service, adding governance, performance work, and a supported Iceberg lakehouse on top of the open-source engine.

Google Cloud Dataflow is a fully managed service that executes Apache Beam pipelines for batch and streaming, provisioning and autoscaling worker VMs automatically and processing every record exactly once by default.

Azure Stream Analytics is a fully managed stream processing engine using a SQL dialect extended with temporal constraints, running in the cloud or on IoT Edge with the same tools and query language.

Confluent is the commercial data streaming platform built around Apache Kafka by its original creators, sold as self-managed Confluent Platform and as the Confluent Cloud service, and acquired by IBM in March 2026.

Amazon Kinesis Data Streams is AWS's managed event streaming service, organising data into shards with provisioned or on-demand capacity and integrating directly with the rest of the AWS analytics stack.

Google Cloud Pub/Sub is an asynchronous, scalable messaging service that decouples producers from consumers, offering push and pull subscriptions, configurable exactly-once delivery, and roughly 100-millisecond latency.

Azure Event Hubs is Microsoft's fully managed event streaming platform, natively supporting the Apache Kafka protocol alongside AMQP and HTTPS so existing Kafka workloads run without code changes or cluster management.

WarpStream is a Kafka-compatible streaming platform with no local disks, writing directly to S3-class object storage, and running its stateless agents inside the customer's own cloud account under a bring-your-own-cloud model.

AWS Database Migration Service moves data between relational databases, warehouses, and NoSQL stores, either as a one-time migration or as ongoing replication that keeps a source and target in sync.

Datastream is Google Cloud's serverless change data capture and replication service, streaming changes from Oracle, MySQL, PostgreSQL, SQL Server, MongoDB, and Spanner into BigQuery and Cloud Storage with minimal latency.

Oracle GoldenGate is a real-time data replication and change data capture platform spanning Oracle and non-Oracle databases, NoSQL stores, warehouses, and messaging systems, available self-managed or as a managed OCI service.

Striim is a commercial real-time data integration platform combining change data capture with streaming SQL, moving data from operational databases and SaaS applications into warehouses, lakehouses, and Kafka as it changes.

Qlik Replicate is a commercial data replication platform using agentless, log-based change data capture, spanning mainframe and mid-range systems, SAP estates, and modern cloud warehouses without installing software on the source.

Hevo Data is a managed no-code data pipeline platform with over 150 connectors across SaaS applications, databases, and storage, billed by event — each row inserted, updated, or deleted at the destination.

Matillion is a commercial data integration platform with a visual pipeline builder, loading data into cloud warehouses and pushing transformation work down to the warehouse's own compute rather than processing it separately.

SingleStore is a commercial distributed SQL database that runs transactional and analytical workloads in one engine, combining rowstore and columnstore tables with vector search, and delivered as the managed Helios service or self-managed.