Amazon EMR (Elastic MapReduce) vs. Cloudera Enterprise Data Hub

We are running it to perform preparation which takes a few hours on EC2 to be running on a spark-based EMR cluster to total the preparation inside minutes rather than a few hours. Ease of utilization and capacity to select from either Hadoop or spark. Processing time diminishes from 5-8 hours to 25-30 minutes compared with the Ec2 occurrence and more in a few cases.

Incentivized

Cloudera excels at seamless migrations and upgrades.



Cloudera supports self-healing and data center
replacement of failed cloud instances while maintaining the state.



Cloudera is essential to increase or decrease
capacity through the user interface or API.



Cloudera is great at simplifying big data analytics
by providing the technology and tools needed to gain insights from IoT and
connected devices to help monitor and condition our assets.



Cloudera's cybersecurity platform option offers
stronger anomaly detection, visibility, and prevention, as well as faster
behavioral analysis.



Cloudera is beneficial for enabling and utilizing
the platform's machine learning and ad-hoc queries while securely storing,
retrieving, and analyzing any volume of data at scale.

Incentivized

• EMR does well in managing the cost as it uses the task node cores to process the data and these instances are cheaper when the data is stored on s3. It is really cost efficient. No need to maintain any libraries to connect to AWS resources.
• EMR is highly available, secure and easy to launch. No much hassle in launching the cluster (Simple and easy).
• EMR manages the big data frameworks which the developer need not worry (no need to maintain the memory and framework settings) about the framework settings. It's all setup on launch time. The bootstrapping feature is great.

Incentivized

• Excellent management capabilities via Cloudera Manager.
• Open source and does not restrict our data to be bound by a proprietary format.
• Offers excellent support for data governance and auditing.
• Has all the components that would help us build a data hub.
• Excellent platform support offered by Cloudera.

• It would have been better if packages like HBase and Flume were available with Amazon EMR. This would make the product even more helpful in some cases.
• Products like Cloudera provide the options to move the whole deployment into a dedicated server and use it at our discretion. This would have been a good option if available with EMR.
• If EMR gave the option to be used with any choice of cloud provider, it would have helped instead of having to move the data from another cloud service to S3.

Incentivized

• Not fully Open Source, couple of components of the distributions are privately owned, meaning with public contributions are not welcome
• Improvements to Cloudera manager can only be recommended. its very hard to get it done once recommended as the full control is with them.
• Should make components more aligned to Open Source rather than making it closed sourced.
• Custom Features of open source software tools supported only by Cloudera are tricky. Cant commit changes to tools like Hue.
• Improvements to Cluster Management tool is required, which are already available to its competitors.

Incentivized

Likely to renew the use in case the requirements for Cloudera remain valid. The rapid change in customer requirements and solutions that must be validated, integrated or tested changes. As the maturity of the solution increases, the requirements to renew use decrease. From a solution feature perspective by itself would probably grade 10.

I give Amazon EMR this rating because while it is great at simplifying running big data frameworks, providing the Amazon EMR highlights, product details, and pricing information, and analyzing vast amounts of data, it can be run slow, freeze and glitch sometimes. So overall Amazon EMR is pretty good to use other than some basic issues.

Incentivized

There's a vast group of trained and certified (by AWS) professionals ready to work for anyone that needs to implement, configure or fix EMR. There's also a great amount of documentation that is accessible to anyone who's trying to learn this. And there's also always the help of AWS itself. They have people ready to help you analyze your needs and then make a recommendation.

Incentivized

Snowflake is a lot easier to get started with than the other options. Snowflake's data lake building capabilities are far more powerful. Although Amazon EMR isn't our first pick, we've had an excellent experience with EC2 and S3. Because of our current API interfaces, it made more sense for us to continue with Hadoop rather than explore other options.

Incentivized

Cloudera is
compatible with Windows operating systems, and Mac allows cloud-based
deployment, it is also very useful to configure data encryption, guarantee
protocols, and security policies. It also provides integrated auditing and
monitoring capabilities, as well as a control comprehensive data repository for
the enterprise, and ensures vendor compatibility through its open-source
architecture.

Incentivized

• It was obviously cheaper and convenient to use as most of our data processing and pipelines are on AWS. It was fast and readily available with a click and that saved a ton of time rather than having to figure out the down time of the cluster if its on premises.
• It saved time on processing chunks of big data which had to be processed in short period with minimal costs. EMR solved this as the cluster setup time and processing was simple, easy, cheap and fast.
• It had a negative impact as it was very difficult in submitting the test jobs as it lags a UI to submit spark code snippets.

Incentivized

• Cloudera products are the most widely. It is more business friendly as data is more secure. The sensitive data that you operate on is local to you and your project rather than processing this data on Cloud.
• Cloudera is definitely faster as wait time is reduced if on Cloud.
• A lot range of products are covered. So it is definitely good for businesses and had good returns on investments.