Data Engineer – Apache Airflow to Amazon MWAA Migration
4 months Contract Opportunity | AWS | Data Engineering | Airflow | MWAA
We are partnering with a well-established organisation undertaking a significant cloud and data platform initiative and are seeking an experienced Data Engineer to lead the migration of an existing Apache Airflow environment to Amazon Managed Workflows for Apache Airflow (MWAA).
This is a hands-on contract role suited to someone who has strong experience with Airflow in production environments and has previously worked on cloud migration or modernisation projects within AWS.
The Opportunity
You will play a key role in assessing the current Airflow environment, designing the migration approach, and delivering a successful transition to Amazon MWAA. Working closely with data engineering, cloud and platform teams, you will help ensure workflows are migrated efficiently, securely and with minimal disruption to business operations.
Key Responsibilities
• Assess and review the existing Apache Airflow environment, including DAGs, plugins, dependencies and integrations
• Design and execute the migration strategy to Amazon MWAA
• Refactor, optimise and deploy Airflow workflows where required
• Configure and manage MWAA environments across AWS
• Implement best practices around CI/CD, monitoring, logging and operational support
• Collaborate with cloud, infrastructure and security teams to ensure alignment with enterprise standards
• Conduct testing, validation and production cutover activities
• Document architecture, processes and operational procedures
About You
You will be a hands-on Data Engineer with strong workflow orchestration experience and a track record of delivering cloud-based data platform projects.
Key Skills & Experience
• Strong experience administering and developing solutions within Apache Airflow
• Experience migrating Airflow environments between platforms or cloud environments
• Hands-on experience with Amazon MWAA
• Strong AWS experience across services such as S3, IAM, CloudWatch, Secrets Manager and VPC networking
• Strong Python development skills
• Experience working with CI/CD pipelines and Infrastructure as Code
• Strong troubleshooting, performance optimisation and operational support experience
• Excellent stakeholder engagement and communication skills
Desirable
• Experience with Terraform or CloudFormation
• Experience working within modern data platforms and data lake architectures
• Exposure to Databricks, Spark or cloud-native analytics platforms
• Experience within enterprise-scale environments
What's on Offer
• Opportunity to be a part of a high-impact cloud migration initiative
• Work with modern AWS and data technologies
• Highly collaborative technical environment
• Flexible working arrangements
If you have proven experience with Apache Airflow and Amazon MWAA migrations and are looking for your next contract opportunity, we would love to hear from you.
