This project aimed to create Docker Container for ETL process development to analyse sentiment score of tweets.
Whole process is designed by following steps:
- Step 1: Create Docker-compose file
- step 2: Define tweet collector
- Step 3: Create requirement file
- Step 4: Add MongoDB and Postgres to docker-compose
- Step 5: Create an ETL job
- Step 6: Add the ETL job to docker-compose
- Step 7: Add requirements for the ETL job
- Step 8: Connect to MongoDB
- Step 9: Import tweets in MongoDB
- Step 10: Clean Tweets and claculate sentiment scores
- Step 11: Connect to Postgres
- Step 12: Create Table and insert data