Best Practices for Running Airflow at Scale

 
 
Best Practices for Running Airflow at Scale

Leading companies like Uber, Ford, and LinkedIn rely on Apache Airflow to orchestrate hundreds of thousands of tasks daily. However, scaling multiple Airflow deployments effectively requires optimized resource management, streamlined workflow development, and robust observability to avoid performance bottlenecks and developer inefficiencies.

Join this webinar to discover practical strategies for running Airflow efficiently at scale.

You'll learn:

  • How to select and optimize Airflow configurations tailored to your workloads.
  • Techniques for automating Airflow infrastructure management with Terraform, REST APIs, and self-service platforms.
  • Ways to accelerate workflow development using templating tools.
  • Approaches to standardize shared code libraries to reduce redundancy.
  • How to maintain the health of your Airflow environments and enhance visibility into complex workflows.

Whether engineering resilient pipelines or managing scalable Airflow infrastructure, this session will equip you with actionable insights for successful Airflow operations.

Don't miss this live event on Tuesday, August 5th, 11 AM PT / 2 PM ET.

Register Now to attend the webinar Best Practices for Running Airflow at Scale.



SPEAKERS       MODERATOR
headshot headshot image
Naveen Sukumar
Head of Product Marketing and DevRel
Astronomer
Jacob Roach
Field Data Engineer
Astronomer
Stephen Faig
Research Director
Unisphere Research and DBTA
 
 

Sponsors