Apache Sqoop vs. DemandTools

Sqoop is great for sending data between a JDBC compliant database and a Hadoop environment. Sqoop is built for those who need a few simple CLI options to import a selection of database tables into Hadoop, do large dataset analysis that could not commonly be done with that database system due to resource constraints, then export the results back into that database (or another). Sqoop falls short when there needs to be some extra, customized processing between database extract, and Hadoop loading, in which case Apache Spark's JDBC utilities might be preferred

Incentivized

DemandTools is perfect for any system that constantly adds new records to its database. For example, in higher education, we are constantly purchasing search names from various vendors and DemandTools allows us to make sure we are not doubling up on the same records. It saves us money in the long run as we are not mailing out multiple copies of our brochures to the same person.

• Provides generalized JDBC extensions to migrate data between most database systems
• Generates Java classes upon reading database records for use in other code utilizing Hadoop's client libraries
• Allows for both import and export features

Incentivized

• Job Builder batches that allow you to run batches of updates for data integrity.
• De-duplicating data for loading and to ensure we do not load redundant records.
• Using PowerGrid like excel to drill and filter to particular record sets.
• Support - The team is very helpful and will provide you with as many resources as you need to succeed.

Incentivized

• Sqoop2 development seems to have stalled. I have set it up outside of a Cloudera CDH installation, and I actually prefer it's "Sqoop Server" model better than just the CLI client version that is Sqoop1. This works especially well in a microservices environment, where there would be only one place to maintain the JDBC drivers to use for Sqoop.

Incentivized

• I wish I could make changes to my existing scenarios using save rather than having to create a whole new scenario. Maybe you can, I just haven't been able to.
• Some features aren't user intuitive and it takes a while to learn.

Incentivized

It's a great product. The only thing that holds us back is it was frustrating working with their sales team. We also don't like that when Validity purchased DemandTools they immediately started charging us quite a bit while it had been free for non-profit users when CRMFusion owned it. They also don't let you buy it for just 1 or 2 seats, you have to pay, I believe, in batches of 100 seats.

Incentivized

Allows for control in uploading lists, saved processes for checking duplicate records.

Allows for backup files and quick reverts if something goes wrong.

Extends reporting when Salesforce.com cannot support specific pieces of info being put together in a report.

Automated processes for set and forget hygiene tasks

There has not been a time since I started 9 months ago that I've encountered any kind of downtime.

Incentivized

DemandTools is a bit clunky and slow at times

Incentivized

Support can be slow so do not expect quick turn for urgent issues.
Help for specific queries not not there. Product tech support is offered. It would be great if query support, even if paid, was offered
The training webinars help with the basics but not much if you need advanced functionality.

The trainings are free live webinars that give you a solid base for getting started with the program. The only weakness is they don't have any advanced classes.

I had just started using Salesforce about 3 months before I did the implementation myself, and it was easy to do just following their step-by-step instructions.

• Sqoop comes preinstalled on the major Hadoop vendor distributions as the recommended product to import data from relational databases. The ability to extend it with additional JDBC drivers makes it very flexible for the environment it is installed within.
• Spark also has a useful JDBC reader, and can manipulate data in more ways than Sqoop, and also upload to many other systems than just Hadoop.
• Kafka Connect JDBC is more for streaming database updates using tools such as Oracle GoldenGate or Debezium.
• Streamsets and Apache NiFi both provide a more "flow based programming" approach to graphically laying out connectors between various systems, including JDBC and Hadoop.

Incentivized

Though RingLead has much more to offer in terms of automation (and it is in Salesforce rather than a separate program), DemandTools still has our heart. DemandTools is very cost-friendly and we were able to increase the value of DemandTools by programming in additional saved scenarios. I decreased admin time in the DemandTools suite by approximately 25% after implementing saved scenarios for every reoccurring update or list upload.

Incentivized

it has worked just fine for our purposes, but I can not speak to its scalability

Incentivized

• When combined with Cloudera's HUE, it can enable non-technical users to easily import relational data into Hadoop.
• Being able to manipulate large datasets in Hadoop, and them load them into a type of "materialized view" in an external database system has yielded great insights into the Hadoop datalake without continuously running large batch jobs.
• Sqoop isn't very user-friendly for those uncomfortable with a CLI.

Incentivized

• Sales Rep can work on more accurate data and have better chance to win opportunities, boost ROI.
• It is so efficient when working the scenarios for repeated work, so I can manage the whole org data without needing to hire another one.
• Time saving- so simple to use and reliable, help maintain data integrity.

Incentivized