Favicon of Amazon Kinesis Data Streams

Amazon Kinesis Data Streams

Amazon Kinesis Data Streams is AWS's managed event streaming service, organising data into shards with provisioned or on-demand capacity and integrating directly with the rest of the AWS analytics stack.

LicenseCommercial
DeploymentManagedServerless
PricingSubscription
Operational complexityLow
WorkloadStreaming

Use it when

  • Your stack is already on AWS and you want durable streaming with IAM, Lambda, Firehose, and Managed Flink wired in natively.
  • You want capacity to be a billing decision, not an operational one: on-demand mode splits shards automatically as traffic grows.
  • Multiple applications need to replay the same stream independently, with retention configurable from 24 hours to 365 days.
  • Nobody on the team wants to run brokers; AWS runs everything and shards are the only knob.

Think twice when

  • You want the Kafka protocol or its tooling; Kinesis speaks its own API, so clients, Connect pipelines, and skills do not transfer (Amazon MSK is the AWS answer for that).
  • Your partition keys are uneven: a single hot key is capped at 1 MB/s and 1,000 records per second per shard, and on-demand mode cannot absorb that.
  • You may leave AWS later; the workload and its tooling are tied to the platform.

How it runs

Fully managed and serverless: create a stream, choose provisioned shards or on-demand capacity, and pay per shard hour and payload (or per GB on-demand). There is no connector framework; Firehose, Lambda, and Managed Service for Apache Flink fill that role. Cross-region replication is your own consumers' job.

Details

Compare

How Amazon Kinesis Data Streams answers the questions Event Streaming turns on.

Event Streaming
How it works
ProtocolOwn API: not Kafka
Consumption modelReplayable log; consumers track position per shard
StorageManaged shards; 24 hours to 365 days retention
Delivery guaranteeAt-least-once: producer and consumer retries duplicate
Running it
What you runNothing: AWS runs it; shards are the only knob
ScalingOn-demand splits shards automatically; provisioned is your shard count
Multi-regionNone built in: replicate across regions with your own consumers
Connections
ConnectorsNo connector framework; Firehose, Lambda and Managed Flink instead
TransformationsNone in the stream; transform in Lambda or Managed Flink
Cost
Billing unitShard hours and PUT payload units, or per GB plus stream hours

Share:

Alternatives to Amazon Kinesis Data Streams

Favicon

 

  
  
Favicon

 

  
  
Favicon