Apache Spark Streaming vs. Astera Data Pipeline Builder (Centerprise) vs. Confluent

Apache Spark Streaming is a tool that we are using for almost a year and is excellent in managing batch processing. It is user-friendly. Using it, we can even process our massive data in fractions of seconds. Its pricing is its other plus point. Only its In-memory processing is its demerit as it occupies a large memory.

Incentivized

I have only been using Astera Centerprise for about 6 months and I am still learning the ins and out of it. A scenario where it seems to do well is in generating reports from SQL queries that we already had and no longer have to run the reports manually. The SQL Query Source object has been the most useful tool for me thus far. I have yet to fully stress test the server side of Astera Centerprise, but currently there have been some version updates that required me to re-set up all the scheduled jobs that we have. We only have 8 jobs thus far but have plans to expand this into the hundreds and those same updates would require exponential amounts of work.

Incentivized

If you have a need to stream data, real time or segmented structured data then Confluent is a great platform to do so with. You won't run into packet transfer size limitations that other platforms have. Flexibility in on-prem, cloud, and managed cloud offerings makes it very flexible no matter how you choose to implement.

Incentivized

• It is amazing in solving complicated transformative logic.
• It is straightforward to program.
• It is a very quick tool.
• It processes large data within a fraction of seconds.

Incentivized

• API integrations vis REST Web Service transformation
• Stored Procedure integration via SQL statement Lookup transformation
• Bulk imports and exports to and from tables
• Data dumps from SQL tables to excel, csv, text files etc...
• EDI Integrations like 810, 856, 940, 945 etc.. via Astera Centerprise Data Integrator plus EDI Connect

• Products work great.
• Training is available.
• Customer support is good.

Incentivized

• There must be more documentation.
• It is a profoundly complex tool.
• Its in-memory processing consumes massive memory.

Incentivized

• When purchasing Astera Centerprise you are given options on how you would like to be trained and each option comes with a different price tag. We chose to be trained using online meetings over several days. The training went too fast and it was not always easy to understand until I started using the product.
• I am a person that wants to learn how and why something works so that I can use the knowledge in the future. When contacting the support team they take the problem, create a solution for you and send it back. The solutions always work, but when I get the solution I have to review every field and function to understand how it works so that I can re-create it for another solution I need. I would much rather have the support team explain what I had done incorrectly and what they changed or I would like to find a solution with them instead of having it handed to me.
• Astera uses license keys to allow their customers rights to only the functionality that was purchased. Each user and server has its own key and each key is only good for one year. There have been 2 different times that we received keys that had less functionality that we purchased. It wasn't until it created problems that we noticed and had to request new keys. This year our sales representative made sure she was available when we updated our keys so that if there was a problem she could fix it right away; however, there were not issues this year. I believe this is something they pay closer attention to now.

• Cloud based Azure platform features for Confluent lacks behind AWS And GCP

Incentivized

We've been using Astera Centerprise application for the last 6 years and we've already added EDI connect to it. Both applications are working really well for our enterprise needs so far with no issues, so we'll continue renewing the licenses.

Centerprise is highly usable; however the version we are currently using could be a little more intuitive in some areas though by no means unworkable. I think some of the issues we have have been addressed and solved in the latest version.

In most cases Astera is stable. However, our client experiences the error from time to time. Mostly they are related to cdc file and ServerAdminConfig.xml file.

Incentivized

I think the performance for Astera is great when compare with other similar software.

Incentivized

Support is great! No matter if you need technical assistance or you have general questions about the tool - the support is very responsive and provides solutions quickly. They are available via various channels, which makes it very convenient to get in touch with them (Support portal, direct email contact, LinkedIn).

Incentivized

The support from the Confluent platform is great and satisfying. We have been working with Confluent for more than a year now. They sent out resident architects to help us set up Confluent cluster on our cloud and help us troubleshoot problems we have encountered. Overall, it has been a great experience working with the Confluent Platform.

Incentivized

Astera support provided us implementation/installation tutorial and we were able to perform all the activities. Also one of the support was there to shadow us to make sure the process was smooth with no issues

Apache Spark Streaming stands above all the huge data transformative tools because of its speed of processing which was quite slow in Presto as it takes a lot of our time in the data processing. Spark, comfortably provides integration with Jupyter like notebook environment. and Spark's combination with Jupyter and Python results in enhancing the speed .

Incentivized

We looked at continuing to use SSIS as an alternative. Although we own SSIS as part of our SQL licensing, we found that it takes a much higher skill level to create solutions. It also does not have the ability to parse unstructured data the way that Centerprise Data Integrator can. We also looked at Datawatch Monarch as a possibility but found it over-all to be cost-prohibitive. We also looked at a cheaper alternative called SimX but did not have a strong confidence in the product as we evaluated it. We landed on Centerprise Data Integrator as it met all of our business requirements and we know we could leverage it for many uses across our enterprise.

For our use case it was very important that the technology we were working with fit into our Azure architecture, and met our data processing size requirements to stream data within certain SLAs. Confluent more than met our performance requirements and compared to the others scale options and cost to run it was more than financially viable as a platform solution to our global operations.

Incentivized

I was helping on purchase this product but I am not sure about the term and pricing for it. But based on what I understand that the term of the licenses are good.

Incentivized

I think Astera can do multiple things. However, we are not sure what it can do. We only know the basic features. If they can give us some kind of training, then we maybe able to benefit for it. We are planning to use their Azure connection in the future. If they can provide the training for it, it will be wonderful.

Incentivized

Centerprise is very easy to use and can transfer the data quickly

Incentivized

• Cost and time-effective tool for our business.
• We can integrate with Jupyter with many conveniences.
• Its high-speed data processing has proved beneficial for us.

Incentivized

• It is tough to say on how Centerprise would have helped us with ROI. Unfortunately our project (after 3 years) was scrapped (put on hold) due to the impromptu purchase of another Crop Insurance company. But with that, Centerprise was huge in getting our warehouse loaded for our BI Team to make important decisions about our policies.

• It enables us to develop event driven application.
• It increases our ability to handle streaming data.
• It reduces latency of communication.

Incentivized