Apache Airflow
Overall Satisfaction with Apache Airflow
We are using apache airflow for managing the ETL pipelines. We are using programmatically to monitor the data pipeline. I have been helping the data team in creating the pipeline using apache airflow.
Pros
- We are using for the workflow management system
- managing the etl pipelines.
- We can manage the task scheduling as code & need not monitor as there is no data in & out.
Cons
- they should bring in some time based scheduling too not only event based
- they do not store the metadata due to which we are not able to analyze the workflows
- they only support python as of now for scripted pipeline writing
- We had a better understanding of data as ETL pipelines were giving data using airflow
- We were able to automate most of the ETL pipelines so it reduced manual efforts
- Airflow UI was extremely helpful which made it easy to understand
Airflow was best suited in my use case for designing the ETL pipelines in a scripted manner for workflows & the UI was very good & easy to use.
Do you think Apache Airflow delivers good value for the price?
Yes
Are you happy with Apache Airflow's feature set?
Yes
Did Apache Airflow live up to sales and marketing promises?
I wasn't involved with the selection/purchase process
Did implementation of Apache Airflow go as expected?
Yes
Would you buy Apache Airflow again?
Yes
Comments
Please log in to join the conversation