04 - Kinesis 101 Flashcards Preview

AWS-CDA-2019-08 - Other Services > 04 - Kinesis 101 > Flashcards

Flashcards in 04 - Kinesis 101 Deck (6):
1

 Kinesis 101

 Kinesis 101

  • Know the difference between Kinesis Data Streams and Kinesis Data Firehose to choose the relevant service

2

Core Kinesis Services

Core Kinesis Services

  • Kinesis Video Streams
  • Kinesis Data Streams
  • Kinesis Data Firehose
  • Kinesis Data Analytics

3

Two Types of Data Kinesis Streams

Two Types of Kinesis Streams

  • Kinesis Data Streams 
    • Consist of Shards
    • Build custom applications processing data in real time
  • Kinesis Video Streams
    • Securely stream video from connected devices to AWS for analytics and machine learning

4

Kinesis Data Firehose

Kinesis Data Firehose

  • No shards to configure
  • No retention period
  • Used to capture, transform, load data streams into AWS Data Stores for near real time analytics / business information tools
    • Once the data comes in, it is either analyzed with Lamba or sent to S3 (copied to RedShift from S3) or ElastiSearch Cluster
    • You can configure Lambda to subscribe to a Kinesis stream and execute a function on your behalf when a new record is detected, before sending the processed data onto its final destination 

5

Kinesis Data Analytics

Kinesis Data Analytics

  • Allows you to run SQL queries on the data as it exists in firehose or streams
  • Can use the SQL query to store the results in S3, RedShift, ElastiSearch Cluster

6

Kinesis Data Streams

Kinesis Data Streams consist of Shards

  • Data Retention
    • 24 hours (default) up to 7 Days
  • Reads - 5 transactions per second for reads
    • Up to a maximum total data read rate of 2 MB per second
  • Writes - 1,000 records per second for writes
    • Up to a maximum total write rate of 1 MB per second (including partition keys)
  • Data Capacity of Stream
    • Is a function of the number of Shards that you specify for the stream
    • The total capacity of the stream is the sum of the capacities of its shards