Google Cloud Dataflow vs. Spotfire Streaming

Based on my experience, streaming / real time / machine learning / AI type of processing and batch processing which needs less transformation are very well suited. Work load that needs complex transformation / multiple hops gets very complicated to implement. New feature like Dataflow SQL option will come in handy for sql heavy users.

Taking data from various sources including files, databases, web services, applying some complex rules, transforming, aggregating and producing a result. This is what Spotfire Streaming does best.
- If one needs connectivity to special services as secured databases or web services, building interactive web apps, those are probably tasks that shall be addressed with different tools.

Incentivized

• Streaming, Real time work load
• Batch processing
• Auto scaling
• flexible pricing

• Processing events in real-time with real low latency and high throughput.
• 100% visual program language, which can be extended by common languages like Java, Python and .NET.
• Reduced time to prototype, create an application and deployment, which reduces the software lifecycle.
• Real robust engine and server. Barely heard of customers having issues in production.

• inbuild template options can be expanded
• more data connector options
• easy of use

• Not all problems are suited to the event driven paradigm.
• As the complexity of an application grows, finding your way around code in the GUI takes some getting used to.
• The Spotfire Streaming development environment is built in Eclipse, which is not everyone's cup of tea.

Spotfire Streaming support is prompt and to the point. They help with best practices and learning from existing projects.

Incentivized

Google Cloud Dataproc Cloud Datafusion

We are using Dataflow (by Google).The development time in Spotfire Streaming is definitely shorter because its GUI based. Dataflow handles late arrivals after the window closes, not sure Spotfire Streaming can do that. Dataflow can run GCP as a managed service which is why we chose that tool for our new product.

Incentivized

• cost saving from managing our own data center for ETL servers
• consumption based pricing
• with auto scaling feature, we were able to expand components to support work load

• While we haven't specifically integrated Spotfire Streaming into our product development, it has allowed us to see the benefits of real-time streaming data.
• We have much more visibility into how our longer term roadmap will look and what we should focus on.

Incentivized