dbt vs. SolarWinds Task Factory

If you can load your data first into your warehouse, dbt is excellent. It does the T(ransformation) part of ELT brilliantly but does not do the E(xtract) or L(oad) part. If you know SQL or your development team knows SQL, it's a framework and extension around that. So, it's easy to learn and easy to hire people with that technical skill (as opposed to specific Informatica, SnapLogic, etc. experience). dbt uses plain text files and integrates with GitHub. You can easily see the changes made between versions. In GUI-based UIs it was always hard to tell what someone had changed. Each "model" is essentially a "SELECT" statement. You never need to do a "CREATE TABLE" or "CREATE VIEW" - it's all done for you, leaving you to work on the business logic. Instead of saying "FROM specific_db.schema.table" you indicate "FROM ref('my_other_model')". It creates an internal dependency diagram you can view in a DAG. When you deploy, the dependencies work like magic in your various environments. They also have great documentation, an active slack community, training, and support. I like the enhancements they have been making and I believe they are headed in a good direction.

Incentivized

Since I started working with this great tool all data analysis programs have been running effectively. Implementation of projects and tasks have been effective and reliable. Data collected from each department gives us working plan on better management of various programs. The Dimension Merge SCD Transform helps us to load large volumes of data within a short period of time.

Incentivized

• user experience makes it easy to work with SQL and version control
• customer success team and the dbt (data build tool) community help establish best practices
• thorough and clear documentation

• The single most beneficial component to Task Factory is the Upsert component. If you're familiar with writing MERGE statements in T-SQL, you'll appreciate the Upsert component. Drag the component into your Data Flow and a few clicks later you have a MERGE without the code complexities.
• Where some native SSIS components leave you wanting more, Task Factory extends on many of these components as well as support for data sources not native to SSIS components.
• The number of extra components that come in the Task Factory tool kit will expand your tool belt to do just about anything you need or want to accomplish in SSIS.

Incentivized

• Slow load times of the dbt cloud environment (they're working on it via a new UI though)
• More out-of-the-box solutions for managing procedures, functions, etc would be nice to have, but honestly, it's pretty easy to figure out how to adapt dbt macros

Incentivized

• It was built by Pragmatic Works who sold it to SentryOne and now Solar Winds, concerned about future support. SolarWinds is discontinuing support for related products such as BiXpress.
• Had issues with connecting to certain versions of SQL Server - would fail when deploying one package - had to deploy the entire solutions.
• Occasional random failures observed with the Filter tranform.

Incentivized

Task Factory has become a key product for our use of doing ETL work in SSIS. Their custom SSIS components allow us to work simply on the data engineering side of things. We can ignore the lower level work needed to connect to disparate data sources. This allows us to work faster and provide more value to the business

Incentivized

Compared to some of the other transformations I have worked with, it really is pretty simple for the type of functionality you get

Incentivized

Overall, the best vendor we currently have on the data side of the house. No issues, issues are resolved very quickly and upgrades go without any issues.

Incentivized

Overall it went smoothly. Had a couple of gotchas with licensing and upgrading but nothing that really stopped us.

Incentivized

Most ETL pipeline products have a T layer, but dbt just does it better. The transformation is on steroids compared to the others. Also, just allows much more Adhoc solutions for very specific projects. Those ETL tools are probably better on the T part if you don't need too many transforms - also dbt is pretty much free dependent on how you work it, also extremely scalable.

Incentivized

ZappySys is an alternative provider that we tested. However, we found the ease of use, set up and installation to be much simplier and quicker using Task Factory. ZappySys has a number of the same connectors but are more difficult to setup and the GUI is not as intuitive and simple to use.

Incentivized

• Simplified our BI layer for faster load times
• Increased the quality of data reaching our end users
• Makes complex transformations manageable

Incentivized

• We were able to support our developers with Task Factory features and reduce the development time by 40%.
• Recently Task Factory has changed their pricing module and it seems to be pretty costly for our process. Our business team has started to evaluate whether this is worth it going forward.

Incentivized