Stitch from Talend vs. StreamSets DataOps Platform

Stitch is very cheap and useful for small to medium size companies to ingest data from common apis/platforms in a quick and cheap way.

Incentivized

Majorly for all Batch and Streaming Scenarios we are designing StreamSets pipelines, few best suited and tried out use cases below : 1. JDBC to ADLS data transfer based on source refresh frequency. 2. Kafka to GCS. 3. Kafka to Azure Event. 4. Hub HDFS to ADLS data transfer. 5. Schema generation to generate Avro. The easy to design Canvas, Scheduling Jobs, Fragment creation and utilization, an inbuilt wide range of Stage availability makes it an even more favorable tool for me to design data engineering pipelines.

Incentivized

• Easy integration with many sources
• Extensible
• Not as expensive as fivetran

Incentivized

• A easy to use canvas to create Data Engineering Pipeline.
• A wide range of available Stages ie. Sources, Processors, Executors, and Destinations.
• Supports both Batch and Streaming Pipelines.
• Scheduling is way easier than cron.
• Integration with Key-Vaults for Secrets Fetching.

Incentivized

• Stitch is not good at replicating document stores like MongoDB to relational databases. To be fair, this is a difficult task. Stitch flattens the objects, but the result is unwieldy.
• Stitch cannot replicate the same source to multiple sinks, which is inconvenient if you want to replicate some of a datastore's tables to Redshift and others to Redshift Spectrum, for instance.

Incentivized

• Monitoring/Visualization can be improvised and enhanced a lot (e.g. to monitor a Job to see what happened 7 days back with data transfer).
• The logging mechanism can be simplified (Logs can be filtered with "ERROR", "DEBUG", "ALL" etc but still takes some time to get familiar for understanding).
• Auto Scalability for heavy load transfer (Taking much time for >5 million record transfer from JDBC to ADLS destination in Avro file transfer).
• There should be a concept of creating Global variables which is missing.

Incentivized

Stitch from Talend is way more cost effective and has a business model that better aligns with our company. From what I can tell Stitch from Talend has a better customer support platform as well and has been very easy to work with when issues have come up. They also seem less pushy when it comes to sales.

Incentivized

StreamSets is a one-stop solution to design Data engineering Pipelines and doesn't require deep Programming knowledge, It's so user-friendly that anyone in Team can contribute to the Idea of pipeline design. In Hadoop One has to be programming proficient to use its various components like Hive, HDFS, Kafka, etc but in StreamSets all these stages are built-in and ready to use with minor configuration.

Incentivized

• Good ROI in terms of being able to monitor cost performance from Google, Facebook, etc.
• Easy to have Salesforce data and Intercom data for dashboards.

Incentivized

• Simplified Improvised Overall data ingestion and Integration Process.
• Support to various Hetrogenous Source systems like RDBMS< Kafka, Salesforce, Key Vault.
• Secure, easy to launch Integration tool.

Incentivized