Amazon Kinesis Data Streams is AWS's managed event streaming service, organising data into shards with provisioned or on-demand capacity and integrating directly with the rest of the AWS analytics stack.
Fully managed and serverless: create a stream, choose provisioned shards or on-demand capacity, and pay per shard hour and payload (or per GB on-demand). There is no connector framework; Firehose, Lambda, and Managed Service for Apache Flink fill that role. Cross-region replication is your own consumers' job.
How Amazon Kinesis Data Streams answers the questions Event Streaming turns on.
| How it works | |
| Protocol | Own API: not Kafka |
| Consumption model | Replayable log; consumers track position per shard |
| Storage | Managed shards; 24 hours to 365 days retention |
| Delivery guarantee | At-least-once: producer and consumer retries duplicate |
| Running it | |
| What you run | Nothing: AWS runs it; shards are the only knob |
| Scaling | On-demand splits shards automatically; provisioned is your shard count |
| Multi-region | None built in: replicate across regions with your own consumers |
| Connections | |
| Connectors | No connector framework; Firehose, Lambda and Managed Flink instead |
| Transformations | None in the stream; transform in Lambda or Managed Flink |
| Cost | |
| Billing unit | Shard hours and PUT payload units, or per GB plus stream hours |
vs Amazon Kinesis Data Streams: Open source (permissive) · Self-hosted · Managed · Hybrid · Free · Operational complexity: High · Java, Scala
vs Amazon Kinesis Data Streams: Open source (permissive) · Self-hosted · Managed · Hybrid · Free · Operational complexity: High · Java
vs Amazon Kinesis Data Streams: Open source (permissive) · Self-hosted · Managed · Hybrid · Free · Subscription · Operational complexity: Medium · Java