Best Hadoop-Related Software
TrustMaps are two-dimensional charts that compare products based on satisfaction ratings and research frequency by prospective buyers. Products must have 10 or more ratings to appear on this TrustMap, and those above the median line are considered Top Rated.
Hadoop-Related Software Overview
What is Hadoop Software?
Hadoop is a very unusual kind of open-source data store from the Apache Foundation. However, an entire ecosystem of products has evolved around the Hadoop data store, to the point where it has become its own technology category.
The central idea of Hadoop is that data is spread across many commodity, inexpensive servers, although there are several commercial distributions of Hadoop from Cloudera and Hortonworks who wrap services around the technology.
Unlike a traditional database, Hadoop can handle huge volumes of both structured and unstructured data including log files, streaming data, images, audio and video files. All of this data can be put into the Hadoop cluster and accessed, modified and processed in place, eliminating the need to duplicate and structure data in a traditional warehouse.
Once this huge volume of structured and unstructured data has been stored, how do you extract any value from it? Since Hadoop is not a structured database, structured query languages like SQL do not work. But Hadoop has its own data processing and query framework called MapReduce. Developers can use MapReduce to write programs that can retrieve whatever data is needed. However, MapReduce has several constraints affecting performance and a newer product like Apache Spark provides an alternative distributed computing framework, which is significantly more efficient. Similarly, products like Hive and Cloudera Impala provide a SQL-like query language, which is much easier for data analysts to learn and use.
Hadoop is an open source software from Apache, supporting distributed processing and data storage. Hadoop is popular for its scalability, reliability, and functionality available across commoditized hardware.
Apache Hive is database/data warehouse software that supports data querying and analysis of large datasets stored in the Hadoop distributed file system (HDFS) and other compatible systems, and is distributed under an open source license.
Analytics that make it easy for businesses to aggregate big data, leveraging the power and scale of Hadoop.
Hortonworks Data Platform (HDP) is a data analytics platform which leverages hadoop.
IBM BigInsights is an analytics and data visualization tool leveraging hadoop.
Apache Pig is a programming tool for creating MapReduce programs used in Hadoop.
Amazon Elastic MapReduce (EMR) is a web service for processing big data (hadoop).
Presto is an open source SQL query engine supported by Teradata designed to run queries on data stored in Hadoop or in traditional databases. Teradata's development of Presto followed the acquisition of Hadapt and Revelytix.
Cloudera Manager is a management application for Apache Hadoop and the enterprise data hub, from Cloudera.
SAP Vora is a computing engine designed to provide better accessibility to Hadoop data from SAP HANA. SAP Vora manages unstructured Hadoop data by building structured data hierarchies and making the data queryable through an SQL interface.
Apache Drill is a schema-free query engine for use with NoSQL or Hadoop data or file storage systems and databases.
Apache Sqoop is a tool for use with Hadoop, used to transfer data between Apache Hadoop and other, structured data stores.
HDInsight is an implementation of the Apache Hadoop technology stack on the Microsoft Azure cloud platform: It is based on the Hortonworks Hadoop distribution. Microsoft Azure HDInsight includes implementations of Apache Spark, HBase, Storm, Pig, Hive, Sqoop, Oozie, Ambari, etc. It also integra...
Cloudera Data Science Workbench enables secure self-service data science for the enterprise. It is a collaborative environment where developers can work with a variety of libraries and frameworks.
Apache Flume is a product enabling the flow of logs and other data into a Hadoop environment.
The Oracle Big Data Cloud features managed and secure platform cloud service of Apache Hadoop and Apache Spark delivered as an elastic, integrated platform – for streaming, batch and interactive analysis.
NGDATA Lily CDP is a hadoop-based platform acquired by and supported by Belgian company NGDATA since original developer Outerthought's acquisition by that company.
Pivotal Greenplum (formerly from EMC) is a massively parallel processing (MPP) data platform, based on the open source Greenplum Database. The data warehouse application is supported by Pivotal Software.
Alluxio (formerly Tachyon) is an open source virtual distributed storage system.
Jethro, from the company of the same name headquartered in New York, delivers interactive enterprise business intelligence and enterprise data warehouse services on hadoop.
Trillium Quality for Big Data supports enterprises using a Big Data framework like Hadoop with data quality functions like data integration, data cleansing, standardization and parsing, with prebuilt process flows that can be configured to meet business needs.