Apache Airflow vs. Astera Data Pipeline Builder (Centerprise)

Airflow is well-suited for data engineering pipelines, creating scheduled workflows, and working with various data sources. You can implement almost any kind of DAG for any use case using the different operators or enforce your operator using the Python operator with ease. The MLOps feature of Airflow can be enhanced to match MLFlow-like features, making Airflow the go-to solution for all workloads, from data science to data engineering.

Incentivized

I have only been using Astera Centerprise for about 6 months and I am still learning the ins and out of it. A scenario where it seems to do well is in generating reports from SQL queries that we already had and no longer have to run the reports manually. The SQL Query Source object has been the most useful tool for me thus far. I have yet to fully stress test the server side of Astera Centerprise, but currently there have been some version updates that required me to re-set up all the scheduled jobs that we have. We only have 8 jobs thus far but have plans to expand this into the hundreds and those same updates would require exponential amounts of work.

Incentivized

• Apache Airflow is one of the best Orchestration platforms and a go-to scheduler for teams building a data platform or pipelines.
• Apache Airflow supports multiple operators, such as the Databricks, Spark, and Python operators. All of these provide us with functionality to implement any business logic.
• Apache Airflow is highly scalable, and we can run a large number of DAGs with ease. It provided HA and replication for workers. Maintaining airflow deployments is very easy, even for smaller teams, and we also get lots of metrics for observability.

Incentivized

• API integrations vis REST Web Service transformation
• Stored Procedure integration via SQL statement Lookup transformation
• Bulk imports and exports to and from tables
• Data dumps from SQL tables to excel, csv, text files etc...
• EDI Integrations like 810, 856, 940, 945 etc.. via Astera Centerprise Data Integrator plus EDI Connect

• UI/Dashboard can be updated to be customisable, and jobs summary in groups of errors/failures/success, instead of each job, so that a summary of errors can be used as a starting point for reviewing them.
• Navigation - It's a bit dated. Could do with more modern web navigation UX. i.e. sidebars navigation instead of browser back/forward.
• Again core functional reorg in terms of UX. Navigation can be improved for core functions as well, instead of discovery.

Incentivized

• When purchasing Astera Centerprise you are given options on how you would like to be trained and each option comes with a different price tag. We chose to be trained using online meetings over several days. The training went too fast and it was not always easy to understand until I started using the product.
• I am a person that wants to learn how and why something works so that I can use the knowledge in the future. When contacting the support team they take the problem, create a solution for you and send it back. The solutions always work, but when I get the solution I have to review every field and function to understand how it works so that I can re-create it for another solution I need. I would much rather have the support team explain what I had done incorrectly and what they changed or I would like to find a solution with them instead of having it handed to me.
• Astera uses license keys to allow their customers rights to only the functionality that was purchased. Each user and server has its own key and each key is only good for one year. There have been 2 different times that we received keys that had less functionality that we purchased. It wasn't until it created problems that we noticed and had to request new keys. This year our sales representative made sure she was available when we updated our keys so that if there was a problem she could fix it right away; however, there were not issues this year. I believe this is something they pay closer attention to now.

We've been using Astera Centerprise application for the last 6 years and we've already added EDI connect to it. Both applications are working really well for our enterprise needs so far with no issues, so we'll continue renewing the licenses.

For its capability to connect with multicloud environments. Access Control management is something that we don't get in all the schedulers and orchestrators. But although it provides so many flexibility and options to due to python , some level of knowledge of python is needed to be able to build workflows.

Incentivized

Centerprise is highly usable; however the version we are currently using could be a little more intuitive in some areas though by no means unworkable. I think some of the issues we have have been addressed and solved in the latest version.

In most cases Astera is stable. However, our client experiences the error from time to time. Mostly they are related to cdc file and ServerAdminConfig.xml file.

Incentivized

I think the performance for Astera is great when compare with other similar software.

Incentivized

Support is great! No matter if you need technical assistance or you have general questions about the tool - the support is very responsive and provides solutions quickly. They are available via various channels, which makes it very convenient to get in touch with them (Support portal, direct email contact, LinkedIn).

Incentivized

Astera support provided us implementation/installation tutorial and we were able to perform all the activities. Also one of the support was there to shadow us to make sure the process was smooth with no issues

Multiple DAGs can be orchestrated simultaneously at varying times, and runs can be reproduced or replicated with relative ease. Overall, utilizing Apache Airflow is easier to use than other solutions now on the market. It is simple to integrate in Apache Airflow, and the workflow can be monitored and scheduling can be done quickly using Apache Airflow. We advocate using this tool for automating the data pipeline or process.

Incentivized

We looked at continuing to use SSIS as an alternative. Although we own SSIS as part of our SQL licensing, we found that it takes a much higher skill level to create solutions. It also does not have the ability to parse unstructured data the way that Centerprise Data Integrator can. We also looked at Datawatch Monarch as a possibility but found it over-all to be cost-prohibitive. We also looked at a cheaper alternative called SimX but did not have a strong confidence in the product as we evaluated it. We landed on Centerprise Data Integrator as it met all of our business requirements and we know we could leverage it for many uses across our enterprise.

I was helping on purchase this product but I am not sure about the term and pricing for it. But based on what I understand that the term of the licenses are good.

Incentivized

I think Astera can do multiple things. However, we are not sure what it can do. We only know the basic features. If they can give us some kind of training, then we maybe able to benefit for it. We are planning to use their Azure connection in the future. If they can provide the training for it, it will be wonderful.

Incentivized

Centerprise is very easy to use and can transfer the data quickly

Incentivized

• Impact Depends on number of workflows. If there are lot of workflows then it has a better usecase as the implementation is justified as it needs resources , dedicated VMs, Database that has a cost
• Donot use it if you have very less usecases

Incentivized

• It is tough to say on how Centerprise would have helped us with ROI. Unfortunately our project (after 3 years) was scrapped (put on hold) due to the impromptu purchase of another Crop Insurance company. But with that, Centerprise was huge in getting our warehouse loaded for our BI Team to make important decisions about our policies.