Apache Spark Streaming vs. IBM StreamSets

Apache Spark Streaming is a tool that we are using for almost a year and is excellent in managing batch processing. It is user-friendly. Using it, we can even process our massive data in fractions of seconds. Its pricing is its other plus point. Only its In-memory processing is its demerit as it occupies a large memory.

Incentivized

IBM StreamSets excels in real-time logistics data ingestion and transformation across hybrid systems. It’s less ideal for lightweight ETL tasks or static datasets where simpler tools can achieve similar results with less overhead and complexity.

Incentivized

• It is amazing in solving complicated transformative logic.
• It is straightforward to program.
• It is a very quick tool.
• It processes large data within a fraction of seconds.

Incentivized

• It helps streaming huge data that we have in our Teradata database to various reporting applications that runs on cloud seamlessly.
• We also use IBM StreamSets to power few BI dashboards that our product managers use on regular basis to showcase various data with clients.
• I think the data quality is way better compared to Informatica tool.

Incentivized

• There must be more documentation.
• It is a profoundly complex tool.
• Its in-memory processing consumes massive memory.

Incentivized

• The error messages I feel aren t always very descriptive so troubleshooting can take longer
• Maybe more customisation options for scheduling can be done, rest it works pretty well.

Incentivized

IBM Stream sets has been a wonderful addition to our technology stack. It has helped in some of our initiatives such as data engineering, data integration for not only external customers but also for internal purposes. The tool has also helped on our use cases related to streaming data. Moving to another tool would require significant amount of work and time.

Incentivized

The StreamSets platform is very easy to use and the interface is extremely intuitive. The drag-and-drop, low-code design makes it accessible for teams with varying technical skills, allowing us to quickly connect sources, define transformations, and deploy pipelines without heavy coding. StreamSets allows us to get started quickly and not have to worry about our pipelines breaking once they're built.

Incentivized

Streamsets support has improved a lot in the last couple of years. We had some challenges in the beginning with support, but now the quality of the support and the responsiveness to tickets are better. We have contacted support multiple times when it came to scenarios where the system was slow or the output as not as we expected

Incentivized

I was not involved in the implementation

Incentivized

Apache Spark Streaming stands above all the huge data transformative tools because of its speed of processing which was quite slow in Presto as it takes a lot of our time in the data processing. Spark, comfortably provides integration with Jupyter like notebook environment. and Spark's combination with Jupyter and Python results in enhancing the speed .

Incentivized

First advantage is that this software is particularly new and it keeps updating according to the needs of the user. Other advantage is the it organises and produces conclusions on the basis of data without leaving any relevant information. Other softwares lack in data summarising and readability of the charts and sheets they produce.

Incentivized

• Cost and time-effective tool for our business.
• We can integrate with Jupyter with many conveniences.
• Its high-speed data processing has proved beneficial for us.

Incentivized

• time saving for automatic collection and integration of data
• time saving thanks to live monitoring and reaction
• time saving for standardization of data

Incentivized