AWS Data Pipeline vs. Spotfire Streaming

AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals. With AWS Data Pipeline, you can regularly access your data where it’s stored, transform and process it at scale, and efficiently transfer the results to AWS services such as Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR.

Incentivized

Taking data from various sources including files, databases, web services, applying some complex rules, transforming, aggregating and producing a result. This is what Spotfire Streaming does best.
- If one needs connectivity to special services as secured databases or web services, building interactive web apps, those are probably tasks that shall be addressed with different tools.

Incentivized

• Helps you easily create complex data processing workloads
• Fault tolerant
• Highly available

Incentivized

• Processing events in real-time with real low latency and high throughput.
• 100% visual program language, which can be extended by common languages like Java, Python and .NET.
• Reduced time to prototype, create an application and deployment, which reduces the software lifecycle.
• Real robust engine and server. Barely heard of customers having issues in production.

• Pipeline Stuck in Pending Status
• Pipeline Component Stuck in Waiting for Runner Status
• EMR Cluster Fails With Error

Incentivized

• Not all problems are suited to the event driven paradigm.
• As the complexity of an application grows, finding your way around code in the GUI takes some getting used to.
• The Spotfire Streaming development environment is built in Eclipse, which is not everyone's cup of tea.

Spotfire Streaming support is prompt and to the point. They help with best practices and learning from existing projects.

Incentivized

AWS data pipelines are easy to use over data factory for data engineers

Incentivized

We are using Dataflow (by Google).The development time in Spotfire Streaming is definitely shorter because its GUI based. Dataflow handles late arrivals after the window closes, not sure Spotfire Streaming can do that. Dataflow can run GCP as a managed service which is why we chose that tool for our new product.

Incentivized

• Easy to use
• Data engineers are able to create the data pipelines quickly and effectively
• Scalable and Fault tolerant

Incentivized

• While we haven't specifically integrated Spotfire Streaming into our product development, it has allowed us to see the benefits of real-time streaming data.
• We have much more visibility into how our longer term roadmap will look and what we should focus on.

Incentivized