Technologies tagged with "Real Time"

RisingWave is a PostgreSQL-compatible streaming database that maintains materialized views incrementally rather than recomputing them, storing state and tables in object storage so compute and storage scale separately.

Materialize incrementally updates SQL results as data arrives rather than recomputing them, built on Timely and Differential Dataflow and reachable over the PostgreSQL wire protocol, with strict serializability by default.

Google Cloud Dataflow is a fully managed service that executes Apache Beam pipelines for batch and streaming, provisioning and autoscaling worker VMs automatically and processing every record exactly once by default.

Azure Stream Analytics is a fully managed stream processing engine using a SQL dialect extended with temporal constraints, running in the cloud or on IoT Edge with the same tools and query language.

Arroyo is a distributed stream processing engine written in Rust that defines pipelines in SQL, performing stateful computation over bounded and unbounded sources with event-time processing and watermarks.

Apache Pulsar is an open-source messaging and streaming platform that splits brokers from storage, keeping segments in Apache BookKeeper so capacity and serving scale independently, with multi-tenancy and geo-replication built in.

Confluent is the commercial data streaming platform built around Apache Kafka by its original creators, sold as self-managed Confluent Platform and as the Confluent Cloud service, and acquired by IBM in March 2026.

Amazon Kinesis Data Streams is AWS's managed event streaming service, organising data into shards with provisioned or on-demand capacity and integrating directly with the rest of the AWS analytics stack.

Google Cloud Pub/Sub is an asynchronous, scalable messaging service that decouples producers from consumers, offering push and pull subscriptions, configurable exactly-once delivery, and roughly 100-millisecond latency.

Azure Event Hubs is Microsoft's fully managed event streaming platform, natively supporting the Apache Kafka protocol alongside AMQP and HTTPS so existing Kafka workloads run without code changes or cluster management.

NATS is a messaging system distributed as one small Go binary, offering at-most-once core messaging with JetStream adding a persistence layer for at-least-once delivery, replay, and server-side consumer state.

WarpStream is a Kafka-compatible streaming platform with no local disks, writing directly to S3-class object storage, and running its stateless agents inside the customer's own cloud account under a bring-your-own-cloud model.

AutoMQ keeps Apache Kafka's compute layer and replaces its storage with cloud object storage, claiming 100% Kafka API compatibility and substantially lower cost by removing multi-replica local disks and cross-zone transfer.

Datastream is Google Cloud's serverless change data capture and replication service, streaming changes from Oracle, MySQL, PostgreSQL, SQL Server, MongoDB, and Spanner into BigQuery and Cloud Storage with minimal latency.

Oracle GoldenGate is a real-time data replication and change data capture platform spanning Oracle and non-Oracle databases, NoSQL stores, warehouses, and messaging systems, available self-managed or as a managed OCI service.

PeerDB is an open-source change data capture engine built specifically for PostgreSQL sources, acquired by ClickHouse in 2024 and kept as a distinct component powering the managed Postgres CDC in ClickPipes.

Sequin is an open-source CDC tool that streams PostgreSQL changes to queues, streaming platforms, and webhooks with strict ordering and exactly-once processing, shipped as a Docker image rather than a Postgres extension.

Striim is a commercial real-time data integration platform combining change data capture with streaming SQL, moving data from operational databases and SaaS applications into warehouses, lakehouses, and Kafka as it changes.

Qlik Replicate is a commercial data replication platform using agentless, log-based change data capture, spanning mainframe and mid-range systems, SAP estates, and modern cloud warehouses without installing software on the source.

Estuary Flow is a data movement platform built on a streaming core, capturing from databases via CDC and from SaaS APIs, then materialising continuously into warehouses and lakes rather than on a schedule.

Apache Druid is a real-time analytics database combining ideas from data warehouses, time-series databases, and log search systems, with columnar storage, time-based partitioning, and bitmap indexes serving sub-second queries over streaming data.

Apache Doris is an MPP analytical database for real-time reporting and ad-hoc analysis, speaking MySQL-compatible SQL over a Java front end and a C++ back end, and the project StarRocks was originally forked from.

SingleStore is a commercial distributed SQL database that runs transactional and analytical workloads in one engine, combining rowstore and columnstore tables with vector search, and delivered as the managed Helios service or self-managed.

Tinybird is a managed ClickHouse platform that turns a SQL query into a deployed HTTP endpoint, aimed at developers building real-time analytics into applications rather than operating a database.

TimescaleDB is a PostgreSQL extension that adds automatic time-based partitioning, hybrid row-columnar storage, and incrementally refreshed aggregates, keeping full PostgreSQL SQL and its entire ecosystem of drivers and tools.

QuestDB is an open-source time-series database with a column-oriented, time-partitioned storage engine and SIMD-vectorized execution, extending SQL with time-series operators like SAMPLE BY and ASOF JOIN.

kdb+ is KX's commercial columnar time-series database, long the standard for financial tick data, queried through the vector language q rather than standard SQL.

CrateDB is an open-source distributed SQL database for real-time analytics and search, querying relational, JSON, time-series, geospatial, vector, and full-text data through one PostgreSQL-compatible interface.

GreptimeDB is an open-source observability database handling metrics, logs, and traces in one Rust engine, with columnar storage on object storage and both SQL and PromQL as query languages.

Amazon Redshift is AWS's managed analytical data warehouse, offering provisioned RA3 clusters with managed storage or a serverless mode that scales compute automatically and bills per second.

Firebolt is a cloud data warehouse built for sub-second analytics on customer-facing applications, pairing stateless elastic engines with primary, join, and aggregating indexes, and shipping a free self-hosted edition alongside the managed service.

StarRocks is an open-source MPP OLAP database combining streaming ingest, strong join performance at query time, and direct querying of lakehouse table formats.

Apache Pinot is a distributed real-time OLAP store built to serve analytical queries at very high concurrency with millisecond latency, ingesting directly from streams.

BigQuery is Google Cloud's serverless, fully managed data warehouse with on-demand or capacity-based pricing, streaming ingestion, and built-in ML functions.

ClickHouse is an open-source columnar database designed for low-latency analytical queries over large volumes, available self-hosted or as ClickHouse Cloud.

Apache Kafka is an open-source distributed log for high-throughput, durable event streaming, with a large ecosystem including Kafka Connect and Kafka Streams.