Apache Airflow vs. Luigi's Box

For a quick job scanning of status and deep-diving into job issues, details, and flows, AirFlow does a good job. No fuss, no muss. The low learning curve as the UI is very straightforward, and navigating it will be familiar after spending some time using it. Our requirements are pretty simple. Job scheduler, workflows, and monitoring. The jobs we run are >100, but still is a lot to review and troubleshoot when jobs don't run. So when managing large jobs, AirFlow dated UI can be a bit of a drawback.

Incentivized

Superb support: the discovery of our needs was very well organised. The support with the specifications gave me confidence (compared with other companies that don't take our specific needs into account). Once the tool was in place, we had 2 meetings to get to grips with it, with recorded videos so that we could go through the motions again

Incentivized

• In charge of the ETL processes.
• As there is no incoming or outgoing data, we may handle the scheduling of tasks as code and avoid the requirement for monitoring.

Incentivized

• Responsive and easy to cooperate with
• Very robust search engine with many options for individual settings and result optimization
• advanced analytics tool

• they should bring in some time based scheduling too not only event based
• they do not store the metadata due to which we are not able to analyze the workflows
• they only support python as of now for scripted pipeline writing

Incentivized

• Hide products and categories that are out of season
• Improve CTR automated adjustment
• Improve explanations in set-up tool to facilite customisation

Incentivized

There are a number of reasons to choose Apache Airflow over other similar platforms- Integrations—ready-to-use operators allow you to integrate Airflow with cloud platforms (Google, AWS, Azure, etc) Apache Airflow helps with backups and other DevOps tasks, such as submitting a Spark job and storing the resulting data on a Hadoop cluster It has machine learning model training, such as triggering a Sage maker job.

Incentivized

Easier to implement and use in daily, the search engine is faster and better, to be honest is the best. We have one solution for recommenders, searching, and listings. We managed to agree to favorable contract terms + Communication with tool support is perfect. We have solved our main problem very quickly and flexibly

Incentivized

• A lot of helpful features out-of-the-box, such as the DAG visualizations and task trees
• Allowed us to implement complex data pipelines easily and at a relatively low cost

Incentivized

• We've gone from an average basket of 90 euros to around 100 euros.
• The product managers have new ideas for products to integrate.

Incentivized