Apache Airflow vs. SAP Data Services

For a quick job scanning of status and deep-diving into job issues, details, and flows, AirFlow does a good job. No fuss, no muss. The low learning curve as the UI is very straightforward, and navigating it will be familiar after spending some time using it. Our requirements are pretty simple. Job scheduler, workflows, and monitoring. The jobs we run are >100, but still is a lot to review and troubleshoot when jobs don't run. So when managing large jobs, AirFlow dated UI can be a bit of a drawback.

Incentivized

It's definitely one of the leading ETL tools, and it's the best ETL tool to use with SAP integration. If you use SAP HANA, then you should think about Data Services as your primary ETL tool.

Incentivized

• In charge of the ETL processes.
• As there is no incoming or outgoing data, we may handle the scheduling of tasks as code and avoid the requirement for monitoring.

Incentivized

• Integration with SAP ERP/ECC works really well.
• A lot of flexibility in data creation, with different types of communication capabilities like BAPIs, IDocs, and Batch input.
• Reliable and consistent results and easily enforceable data templates.

Incentivized

• they should bring in some time based scheduling too not only event based
• they do not store the metadata due to which we are not able to analyze the workflows
• they only support python as of now for scripted pipeline writing

Incentivized

• Debugging is not very easy. When one wants to see the flow of data from one Query to another, the process is not very smooth and efficient.
• A lot of functions do not behave the way they should. I have faced problems with the count() function.
• I have faced problems while loading Excel files. The same set of options will work in one case but not in the other.

Incentivized

As other SAP products, there is excellent support by SAP on this tool. You can access the SAP Help portal in order to give support either from the huge community or directly from SAP.

Incentivized

There are a number of reasons to choose Apache Airflow over other similar platforms- Integrations—ready-to-use operators allow you to integrate Airflow with cloud platforms (Google, AWS, Azure, etc) Apache Airflow helps with backups and other DevOps tasks, such as submitting a Spark job and storing the resulting data on a Hadoop cluster It has machine learning model training, such as triggering a Sage maker job.

Incentivized

You cannot afford to run your business on questionable data. With SAP® Data Services software, you can access, transform, and connect data to fuel your critical business processes. Together, these enterprise-class solutions enable data integration and data quality, providing the right level of insight across your business so you can make better decisions and operate more effectively.SAP Data Services was previously known as SAP BusinessObjects Data Services, SAP BusinessObjects Data Integrator, BusinessObjects Data Integrator.

Incentivized

• A lot of helpful features out-of-the-box, such as the DAG visualizations and task trees
• Allowed us to implement complex data pipelines easily and at a relatively low cost

Incentivized

• Very positive impact in jobs maintenance since support auto-documentation.
• Great impact on learning curve.
• Great results in our Data Quality Projects.

Incentivized