Batch processing with AWS (EMR, REDSHIFT, S3, EC2), Airflow and Metabase

Project information

Batch processing helps organization in getting useful data which are needed for analytical and business descisons in an organization.

Lets assume you work for a bank as a data engineer and you have been tasked to create a batch processing workflow that tracks the number of loan in each loan category of the bank every day. Using your experience as a data engineer you need to make the loan tracker metric data available to both decision-makers and end users.