In this project, you need to execute an End-To-End Data Engineering Project on Real-Time Stock Market Data using Kafka.
You use different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL.
- Programming Language - Python
- Amazon Web Service (AWS)
- S3 (Simple Storage Service)
- Athena
- Glue Crawler
- Glue Catalog
- EC2
- Apache Kafka
For some Mac user, you need to request the editing permission in the terminal. You open the terminal and go to the directory where you have your aws key placed.
chmod 400 kafka-stock-market-project-v1.pem