Batch processing with AWS (EMR, REDSHIFT, S3, EC2), Airflow and Metabase
Project information
- Category: Batch processing
- Project URL: www.github.com/Adematics/beginners_batch_project
Batch processing helps organization in getting useful data which are needed for analytical
and business descisons in an organization.
Lets assume you work for a bank as a data engineer and you have been tasked to create a
batch processing workflow that tracks the number of loan in each loan category of the bank
every day. Using your experience as a data engineer you need to make the loan tracker metric
data available to both decision-makers and end users.