Item: Apache Airflow
Rating: 9
Author: Verified User

Use Cases and Deployment Scope

We use Apache Airflow to perform data integration in AWS S3 region. With this we are able to connect to a relational database, easily execute data extracts, and compile them all in multiple flat file segments. Airflow brings a lot of standardization as well as modularity. We also use it to send data to partners and score ML models. It allows us to implement complex data pipelines easily.

Pros and Cons

Multiple helpful features
Very intuitive flow charts
Reruns and backfills are very easy
SLA and DAGs are easy to set up

Potentially a steep learning curve
The browser UI could do with a few enhancements

Return on Investment

A lot of helpful features out-of-the-box, such as the DAG visualizations and task trees
Allowed us to implement complex data pipelines easily and at a relatively low cost

Alternatives Considered

Yarn

Apache Airflow is far superior!

Key Insights

Do you think Apache Airflow delivers good value for the price?

Yes

Are you happy with Apache Airflow's feature set?

Yes

Did Apache Airflow live up to sales and marketing promises?

Yes

Did implementation of Apache Airflow go as expected?

Yes

Would you buy Apache Airflow again?

Yes

Likelihood to Recommend

Using Apache Airflow has been extremely helpful, as it means we can get to our endgame faster. This product has enabled us to translate our ideas into projects at a much faster speed than before we had this software. We manage data ingestion and modeling for multiple products and customers within each product. Each has its own pipeline with its own code.

Apache Airflow is flawless

Overall Satisfaction with Apache Airflow