Hadoop-Related Software
All Products
(1-25 of 41)
Cloudera Manager is a management application for Apache Hadoop and the enterprise data hub, from Cloudera. Its automated wizards let users quickly deploy a cluster, no matter what the scale or the deployment environment, complete with intelligent, system-based default settings.
IBM BigInsights is an analytics and data visualization tool leveraging hadoop.
Hortonworks Data Platform (HDP) is an open source framework for distributed storage and processing of large, multi-source data sets. HDP modernizes IT infrastructure and keeps data secure—in the cloud or on-premises—while helping to drive new revenue streams, improve customer experience,…
Bodo is an SQL and Python data processing platform powered by advanced compilers and MPI parallelization technologies. Bodo enhances data engineering by aiming to provide improvements in speed, scale, and cost efficiency, bringsing HPC levels of performance and efficiency to data…
AtScale, headquartered in San Mateo, offers intelligent data virtualization which they state provides live, secured and governed access to Big Data across disparate systems wherever it resides—and without disruption.
Apache Hive is database/data warehouse software that supports data querying and analysis of large datasets stored in the Hadoop distributed file system (HDFS) and other compatible systems, and is distributed under an open source license.
Amazon EMR is a cloud-native big data platform for processing vast amounts of data quickly, at scale. Using open source tools such as Apache Spark, Apache Hive, Apache HBase, Apache Flink, Apache Hudi (Incubating), and Presto, coupled with the scalability of Amazon EC2 and scalable…
Apache Kylin is an open source, distributed Analytical Data Warehouse for Big Data; it was designed to provide OLAP (Online Analytical Processing) capability in the big data era. By renovating the multi-dimensional cube and precalculation technology on Hadoop and Spark, Kylin is…
HDInsight is an implementation of the Apache Hadoop technology stack on the Microsoft Azure cloud platform: It is based on the Hortonworks Hadoop distribution.
Microsoft Azure HDInsight includes implementations of Apache Spark, HBase, Storm, Pig, Hive, Sqoop, Oozie, Ambari, etc. It…
TCS Digital Software & Solutions developed the TCS Connected Intelligence Platform (CIP) as a unified data analytics platform that enables business and technical stakeholders to harness multi-domain data from across the organization to gain a competitive advantage faster, and at…
A solution presented as the smallest, fastest columnar storage for Hadoop workloads.
Tanzu Data Services is a family of data-driven solutions built to store, process, and query critical data resources in real-time and at massive scale, both on-premises and in the multi-cloud world.
Azure Data Lake Storage Gen2 is a highly scalable and cost-effective data lake solution for big data analytics. It combines the power of a high-performance file system with massive scale and economy to help you speed your time to insight. Data Lake Storage Gen2 extends Azure Blob…
Apache Sqoop is a tool for use with Hadoop, used to transfer data between Apache Hadoop and other, structured data stores.
Bitwise Hadoop Adaptor for Mainframe Data acquires mainframe data and converts it to Hadoop format for processing.
IBM Analytics for Apache Spark for Cloud is a service designed to provide the fast in-memory performance of Apache Spark without the hassle of self-managing Spark clusters, relying instead on the convenience of IBM Cloud.
Combining cloud computing and community open-source technologies such as Hadoop, Hive, Spark, HBase, Presto, and Storm, Tencent Cloud Elastic MapReduce (EMR) provides cloud-based Hadoop services featuring high reliability and elastic scalability. Using EMR, users can create a secure…
MapReduce Service (MRS) on Huawei Cloud provides enterprise-level big data clusters on the cloud. Tenants can control clusters and run big data components such as Hadoop, Spark, HBase, Kafka, and Storm.
Learn More About Hadoop-Related Software
What is Hadoop Software?
Hadoop is a very unusual kind of open-source data store from the Apache Foundation. However, an entire ecosystem of products has evolved around the Hadoop data store, to the point where it has become its own technology category.
The central idea of Hadoop is that data is spread across many commodity, inexpensive servers, although there are several commercial distributions of Hadoop from Cloudera and Hortonworks who wrap services around the technology.
Unlike a traditional database, Hadoop can handle huge volumes of both structured and unstructured data including log files, streaming data, images, audio and video files. All of this data can be put into the Hadoop cluster and accessed, modified and processed in place, eliminating the need to duplicate and structure data in a traditional warehouse.
Once this huge volume of structured and unstructured data has been stored, how do you extract any value from it? Since Hadoop is not a structured database, structured query languages like SQL do not work. But Hadoop has its own data processing and query framework called MapReduce. Developers can use MapReduce to write programs that can retrieve whatever data is needed. However, MapReduce has several constraints affecting performance and a newer product like Apache Spark provides an alternative distributed computing framework, which is significantly more efficient. Similarly, products like Hive and Cloudera Impala provide a SQL-like query language, which is much easier for data analysts to learn and use.