Amazon MWAA
#90 · Level 3 · Modern architecture · Application IntegrationConcept
Section titled “Concept”Amazon MWAA (Managed Workflows for Apache Airflow) is an AWS-run version of open source Apache Airflow. In Airflow, a workflow is written in Python as a DAG, which defines which task runs after which. In MWAA you create an environment, and DAG files are usually stored in S3. AWS takes responsibility for running Airflow’s scheduler, workers and web interface. It is mostly used to schedule and organize work across data services such as S3, Glue and Redshift.
Simple example
Section titled “Simple example”A factory’s production schedule — which machine runs when, and which one after which, following the same rules every day.
Why it’s needed
Section titled “Why it’s needed”Many steps — bringing in data every day, cleaning it, building reports — need to run on time. Running Airflow yourself is hard.
Where it’s used
Section titled “Where it’s used”Nightly data pipelines and step-by-step ETL jobs.
Azure equivalent
Section titled “Azure equivalent”Azure Data Factory (Workflow Orchestration Manager)
Learn more
Section titled “Learn more”For details and the latest information, see the official documentation: