TrustRadius
Apache Sqoop is a tool for use with Hadoop, used to transfer data between Apache Hadoop and other, structured data stores.https://dudodiprj2sv7.cloudfront.net/product-logos/bN/zJ/38XBGZCA9KJR.pngSimplistic CLI tool for RDBMS and Hadoop transfersSqoop is being used to offload relational databases into Hadoop HDFS, Hive, or HBase. From there, big data analysis processes can be run, then Sqoop is used to reload different tables in the source database for relational queries by external systems such as web applications. Sqoop helps bridge the gap between traditional RDBMS systems and the Hadoop ecosystem.,Provides generalized JDBC extensions to migrate data between most database systems Generates Java classes upon reading database records for use in other code utilizing Hadoop's client libraries Allows for both import and export features,Sqoop2 development seems to have stalled. I have set it up outside of a Cloudera CDH installation, and I actually prefer it's "Sqoop Server" model better than just the CLI client version that is Sqoop1. This works especially well in a microservices environment, where there would be only one place to maintain the JDBC drivers to use for Sqoop.,9,When combined with Cloudera's HUE, it can enable non-technical users to easily import relational data into Hadoop. Being able to manipulate large datasets in Hadoop, and them load them into a type of "materialized view" in an external database system has yielded great insights into the Hadoop datalake without continuously running large batch jobs. Sqoop isn't very user-friendly for those uncomfortable with a CLI.,Apache Kafka and Apache Spark,Apache Kafka, Apache Flume, Apache Spark, Apache Pig, Qubole, Amazon Elastic MapReduce, Cloudera Manager, Amazon Relational Database Service, Amazon S3 (Simple Storage Service), Logstash, Elasticsearch, Splunk Enterprise
Unspecified
Apache Sqoop
4 Ratings
Score 8.7 out of 101
TRScore

Apache Sqoop Reviews

Apache Sqoop
4 Ratings
Score 8.7 out of 101
Show Filters 
Hide Filters 
Filter 4 vetted Apache Sqoop reviews and ratings
Clear all filters
Overall Rating
Reviewer's Company Size
Last Updated
By Topic
Industry
Department
Experience
Job Type
Role
Reviews (1-1 of 1)
  Vendors can't alter or remove reviews. Here's why.
Jordan Moore profile photo
February 19, 2018

Apache Sqoop Review: "Simplistic CLI tool for RDBMS and Hadoop transfers"

Score 9 out of 10
Vetted Review
Verified User
Review Source
Sqoop is being used to offload relational databases into Hadoop HDFS, Hive, or HBase. From there, big data analysis processes can be run, then Sqoop is used to reload different tables in the source database for relational queries by external systems such as web applications.

Sqoop helps bridge the gap between traditional RDBMS systems and the Hadoop ecosystem.
  • Provides generalized JDBC extensions to migrate data between most database systems
  • Generates Java classes upon reading database records for use in other code utilizing Hadoop's client libraries
  • Allows for both import and export features
  • Sqoop2 development seems to have stalled. I have set it up outside of a Cloudera CDH installation, and I actually prefer it's "Sqoop Server" model better than just the CLI client version that is Sqoop1. This works especially well in a microservices environment, where there would be only one place to maintain the JDBC drivers to use for Sqoop.
Sqoop is great for sending data between a JDBC compliant database and a Hadoop environment. Sqoop is built for those who need a few simple CLI options to import a selection of database tables into Hadoop, do large dataset analysis that could not commonly be done with that database system due to resource constraints, then export the results back into that database (or another). Sqoop falls short when there needs to be some extra, customized processing between database extract, and Hadoop loading, in which case Apache Spark's JDBC utilities might be preferred.
Read Jordan Moore's full review

Apache Sqoop Scorecard Summary

About Apache Sqoop

Apache Sqoop is a tool for use with Hadoop, used to transfer data between Apache Hadoop and other, structured data stores.
Categories:  Hadoop-Related

Apache Sqoop Technical Details

Operating Systems: Unspecified
Mobile Application:No