Data Lambda Architecture
Abstraction
Data Collecting
EC2
- instance environment
- regional option
- Persisting Volume permanently by Amazon EBS
- Providing EIP for static IPv4 address
S3
Bucket
- all of the instances are belongs to some buckets like folder in Windows
- Container for instances.
Objects
- smallest concept in S3
- An object consist of object data and meta data.
RDS
- Support relational database.
API Gateway.
- bridging from external service to internal AWS services.
- supporting consistance accessing methods from and to web, mobile.
Cloud Watch
Kinesis Streamer
Amazon Pinpoint
Real-Time Processing
real-time item recommenation
- Spark Streaming
- Flink (Kinesis Analysis)
- real-time analysis.
Amazon ES
Data Cataloging(AWS glue)