Spotfire Streaming vs. SQL Server Integration Services (SSIS)

Taking data from various sources including files, databases, web services, applying some complex rules, transforming, aggregating and producing a result. This is what Spotfire Streaming does best.
- If one needs connectivity to special services as secured databases or web services, building interactive web apps, those are probably tasks that shall be addressed with different tools.

Incentivized

As I mentioned earlier SQL Server Integration Services is suitable if you want to manage data from different applications. It really helps in fetching the data and generating reports. Its automation make it very easy and time efficient. It works well with large database as well. But it doesn't work well with real time data, it will take some time to gather the real time data. I would not recommend using it in a real time/fast-paced environment.

Incentivized

• Processing events in real-time with real low latency and high throughput.
• 100% visual program language, which can be extended by common languages like Java, Python and .NET.
• Reduced time to prototype, create an application and deployment, which reduces the software lifecycle.
• Real robust engine and server. Barely heard of customers having issues in production.

• Standard ETL use cases for daily loads
• Loading incoming data from Vendors which is placed on FTP and adding them to the SQL Warehouse
• Creating outgoing data files and writing them to Vendor FTPs
• Easy Active Directory integration for seamless connections to SQL Server
• CI/CD by hosting the code on visualstudio.com

Incentivized

• Being a niche tool, there's not much community support
• It is on prem, making it slow to boot. not cloud native (It could be that it is our org's issue)
• The dev environment is very tough to understand for large projects due to the wire style UI/UX

Incentivized

• Connection managers for online data sources can be tricky to configure.
• Performance tuning is an art form and trialing different data flow task options can be cumbersome. SSIS can do a better job of providing performance data including historical for monitoring.
• Mapping destination using OLE DB command is difficult as destination columns are unnamed.
• Excel or flat file connections are limited by version and type.

Incentivized

Some features should be revised or improved, some tools (using it with Visual Studio) of the toolbox should be less schematic and somewhat more flexible. Using for example, the CSV data import is still very old-fashioned and if the data format changes it requires a bit of manual labor to accept the new data structure

Incentivized

The usability is good in terms that it gets well integrated with the Spotfire suite but the only few issues I have is the tough UI/UX (learning curve, if the project is huge) and unable to find many users and devs to help with the queries. At the end it is solely based on the documentation provided which is never enough

Incentivized

SSIS is a great tool for most ETL needs. It has the 90% (or more) use cases covered and even in many of the use cases where it is not ideal SSIS can be extended via a .NET language to do the job well in a supportable way for almost any performance workload.

Incentivized

SQL Server Integration Services performance is dependent directly upon the resources provided to the system. In our environment, we allocated 6 nodes of 4 CPUs, 64GB each, running in parallel. Unfortunately, we had to ramp-up to such a robust environment to get the performance to where we needed it. Most of the reports are completed in a reasonable timeframe. However, in the case of slow running reports, it is often difficult if not impossible to cancel the report without killing the report instance or stopping the service.

Incentivized

Spotfire Streaming support is prompt and to the point. They help with best practices and learning from existing projects.

Incentivized

The support, when necessary, is excellent. But beyond that, it is very rarely necessary because the user community is so large, vibrant and knowledgable, a simple Google query or forum question can answer almost everything you want to know. You can also get prewritten script tasks with a variety of functionality that saves a lot of time.

Incentivized

The implementation may be different in each case, it is important to properly analyze all the existing infrastructure to understand the kind of work needed, the type of software used and the compatibility between these, the features that you want to exploit, to understand what is possible and which ones require integration with third-party tools

Incentivized

We are using Dataflow (by Google).The development time in Spotfire Streaming is definitely shorter because its GUI based. Dataflow handles late arrivals after the window closes, not sure Spotfire Streaming can do that. Dataflow can run GCP as a managed service which is why we chose that tool for our new product.

Incentivized

I think SQL Server Integration Services is better suited for on-premises data movement and ADF is more suited for the cloud. Though ADF has more connectors, SQL Server Integration Services is more robust and has better functionality just because it has been around much longer

Incentivized

• While we haven't specifically integrated Spotfire Streaming into our product development, it has allowed us to see the benefits of real-time streaming data.
• We have much more visibility into how our longer term roadmap will look and what we should focus on.

Incentivized

• Without this, we would have to manually update a spreadsheet of our SQL Server inventory
• We would also have poor alerting; if an instance was down we wouldn't know until it was reported by a user
• We only have one other person who uses SQL Server Integration Services , he's the expert. It would fall to me without him and I would not enjoy being responsible for it.

Incentivized