Palantir Foundry vs. SQL Server Integration Services (SSIS) vs. SolarWinds Task Factory

As I mentioned earlier SQL Server Integration Services is suitable if you want to manage data from different applications. It really helps in fetching the data and generating reports. Its automation make it very easy and time efficient. It works well with large database as well. But it doesn't work well with real time data, it will take some time to gather the real time data. I would not recommend using it in a real time/fast-paced environment.

Incentivized

Since I started working with this great tool all data analysis programs have been running effectively. Implementation of projects and tasks have been effective and reliable. Data collected from each department gives us working plan on better management of various programs. The Dimension Merge SCD Transform helps us to load large volumes of data within a short period of time.

Incentivized

• Standard ETL use cases for daily loads
• Loading incoming data from Vendors which is placed on FTP and adding them to the SQL Warehouse
• Creating outgoing data files and writing them to Vendor FTPs
• Easy Active Directory integration for seamless connections to SQL Server
• CI/CD by hosting the code on visualstudio.com

Incentivized

• The single most beneficial component to Task Factory is the Upsert component. If you're familiar with writing MERGE statements in T-SQL, you'll appreciate the Upsert component. Drag the component into your Data Flow and a few clicks later you have a MERGE without the code complexities.
• Where some native SSIS components leave you wanting more, Task Factory extends on many of these components as well as support for data sources not native to SSIS components.
• The number of extra components that come in the Task Factory tool kit will expand your tool belt to do just about anything you need or want to accomplish in SSIS.

Incentivized

• Connection managers for online data sources can be tricky to configure.
• Performance tuning is an art form and trialing different data flow task options can be cumbersome. SSIS can do a better job of providing performance data including historical for monitoring.
• Mapping destination using OLE DB command is difficult as destination columns are unnamed.
• Excel or flat file connections are limited by version and type.

Incentivized

• It was built by Pragmatic Works who sold it to SentryOne and now Solar Winds, concerned about future support. SolarWinds is discontinuing support for related products such as BiXpress.
• Had issues with connecting to certain versions of SQL Server - would fail when deploying one package - had to deploy the entire solutions.
• Occasional random failures observed with the Filter tranform.

Incentivized

Some features should be revised or improved, some tools (using it with Visual Studio) of the toolbox should be less schematic and somewhat more flexible. Using for example, the CSV data import is still very old-fashioned and if the data format changes it requires a bit of manual labor to accept the new data structure

Incentivized

Task Factory has become a key product for our use of doing ETL work in SSIS. Their custom SSIS components allow us to work simply on the data engineering side of things. We can ignore the lower level work needed to connect to disparate data sources. This allows us to work faster and provide more value to the business

Incentivized

SSIS is a great tool for most ETL needs. It has the 90% (or more) use cases covered and even in many of the use cases where it is not ideal SSIS can be extended via a .NET language to do the job well in a supportable way for almost any performance workload.

Incentivized

Compared to some of the other transformations I have worked with, it really is pretty simple for the type of functionality you get

Incentivized

SQL Server Integration Services performance is dependent directly upon the resources provided to the system. In our environment, we allocated 6 nodes of 4 CPUs, 64GB each, running in parallel. Unfortunately, we had to ramp-up to such a robust environment to get the performance to where we needed it. Most of the reports are completed in a reasonable timeframe. However, in the case of slow running reports, it is often difficult if not impossible to cancel the report without killing the report instance or stopping the service.

Incentivized

The support, when necessary, is excellent. But beyond that, it is very rarely necessary because the user community is so large, vibrant and knowledgable, a simple Google query or forum question can answer almost everything you want to know. You can also get prewritten script tasks with a variety of functionality that saves a lot of time.

Incentivized

Overall, the best vendor we currently have on the data side of the house. No issues, issues are resolved very quickly and upgrades go without any issues.

Incentivized

The implementation may be different in each case, it is important to properly analyze all the existing infrastructure to understand the kind of work needed, the type of software used and the compatibility between these, the features that you want to exploit, to understand what is possible and which ones require integration with third-party tools

Incentivized

Overall it went smoothly. Had a couple of gotchas with licensing and upgrading but nothing that really stopped us.

Incentivized

I think SQL Server Integration Services is better suited for on-premises data movement and ADF is more suited for the cloud. Though ADF has more connectors, SQL Server Integration Services is more robust and has better functionality just because it has been around much longer

Incentivized

ZappySys is an alternative provider that we tested. However, we found the ease of use, set up and installation to be much simplier and quicker using Task Factory. ZappySys has a number of the same connectors but are more difficult to setup and the GUI is not as intuitive and simple to use.

Incentivized

• Without this, we would have to manually update a spreadsheet of our SQL Server inventory
• We would also have poor alerting; if an instance was down we wouldn't know until it was reported by a user
• We only have one other person who uses SQL Server Integration Services , he's the expert. It would fall to me without him and I would not enjoy being responsible for it.

Incentivized

• We were able to support our developers with Task Factory features and reduce the development time by 40%.
• Recently Task Factory has changed their pricing module and it seems to be pretty costly for our process. Our business team has started to evaluate whether this is worth it going forward.

Incentivized