IBM DataStage vs. Snowflake

Excellent Cloud data mapping tool and easy creating multiple project data analytics in real-time and the report distribution are excellent via this IBM product. Easy tool to provide data visualization and the integration is effective and helpful to migrating huge amounts of data across other platforms and different websites insights gathering.

Incentivized

I am over our HR data, and we use Workday for our HR management system. I have a script in place that runs reports on Workday and saves the results as CSVs. I can then use stages in Snowflake to insert these CSVs into Snowflake, then I can insert or truncate and replace these staged tables into a final schema. Then once these are in a schema I can reference them and build out my data models. In addition to ingesting CSVs, Snowflake has the ability to write a CSV file to our Amazon S3 bucket. Ingesting these CSVs, transforming the data, then delivering it to a destination would've involved so much more coding than my current process if we were on any other platform.

Incentivized

• Data movement
• Seamless integration of scripts and etl jobs
• Descriptive logging
• Ability to work with myriad of data assets
• Direct integration for Governance catalog

Incentivized

• Snowflake scales appropriately allowing you to manage expense for peak and off peak times for pulling and data retrieval and data centric processing jobs
• Snowflake offers a marketplace solution that allows you to sell and subscribe to different data sources
• Snowflake manages concurrency better in our trials than other premium competitors
• Snowflake has little to no setup and ramp up time
• Snowflake offers online training for various employee types

Incentivized

• Connector Stages to Snowflake on the cloud. We had some issues initially but since then had been corrected.
• Accessing tool from a browser (zero foot-print). Currently we need to either install locally or connect to a server to do ETL work.
• Diversify ways of authenticating users.

Incentivized

• This tool is very much technical and proper knowledge is required, so mostly you have to hire an IT team.
• I wish if various videos could be available for basic quires like its initiation, then I think it would act as a guideline and would help the beginners a lot.

Incentivized

SnowFlake is very cost effective and we also like the fact we can stop, start and spin up additional processing engines as we need to. We also like the fact that it's easy to connect our SQL IDEs to Snowflake and write our queries in the environment that we are used to

Incentivized

Because it is robust, and it is being continuously improved. DS is one of the most used and recognized tools in the market. Large companies have implemented it in the first instance to develop their DW, but finding the advantages it has, they could use it for other types of projects such as migrations, application feeding, etc.

Incentivized

The interface is similar to other SQL query systems I've used and is fairly easy to use. My only complaint is the syntax issues. Another thing is that the error messages are not always the easiest thing to understand, especially when you incorporate temp tables. Some of that is to be expected with any new database.

Incentivized

It could load thousands of records in seconds. But in the Parallel version, you need to understand how to particionate the data. If you use the algorithms erroneously, or the functionalities that it gives for the parsing of data, the performance can fall drastically, even with few records. It is necessary to have people with experience to be able to determine which algorithm to use and understand why.

Incentivized

I believe that IBM generally has one of the worst and most complex assistance systems (physical and online) that exists.

Incentivized

We have had terrific experiences with Snowflake support. They have drilled into queries and given us tremendous detail and helpful answers. In one case they even figured out how a particular product was interacting with Snowflake, via its queries, and gave us detail to go back to that product's vendor because the Snowflake support team identified a fault in its operation. We got it solved without lots of back-and-forth or finger-pointing because the Snowflake team gave such detailed information.

Incentivized

It's obvious since they both are from the same vendors and it makes it easier and can get better rates for licensing. Also, sales rapes are very helpful in case of escalations and critical issues.

Incentivized

I have had the experience of using one more database management system at my previous workplace. What Snowflake provides is better user-friendly consoles, suggestions while writing a query, ease of access to connect to various BI platforms to analyze, [and a] more robust system to store a large amount of data. All these functionalities give the better edge to Snowflake.

Incentivized

• Reduce development time by 65% compared with hand coding.
• Reduces ETL process maintenance times.
• Better data governance for technical and non-technical people.
• Improve time to market for initiatives that require data integration.

Incentivized

• Positive impact: we use Snowflake to track our subscription and payment charges, which we use for internal and investor reporting
• Positive impact: 3 times faster query speed compared to Treasure Data means that answers to stakeholders can be delivered quicker by analysts
• Positive impact: recommender systems now source their data from Snowflake rather than Spark clusters, improving development speed, and no longer require maintainence of Spark clusters.

Incentivized