Name: Azure HDInsight
Rating: 4 (36 reviews)
Author: Microsoft

Help Desk

Web and Video Conferencing

Customer Support

Beta Testing

Continuous Integration

Development

Alumni Management

Education

Business Intelligence (BI)

Collaboration

Contract Analysis

Demand Planning

Emissions Management

Knowledge Management

Online Notary

Payment Facilitation

Enterprise

Accounting

Travel Management

Finance and Accounting

Applicant Tracking

Corporate Learning Management

HR Management

HR Service Delivery

Payroll

Talent Intelligence

Talent Management

Workforce Analytics

Workforce Management

Human Resources

AIOps

API Design

App Development

Cloud Storage

Data Center Backup

Data Center Networking

Data Center Outsourcing (Canada)

Data Integration

Data Replication

Database-as-a-Service (DBaaS)

Enterprise Printing

Fraud Detection

Integration Platform as a Service (iPaaS)

Managed Detection and Response (MDR)

Mobile Data Security

Network Performance Monitoring

Secure Access Control

Service Virtualization

Value Stream Management

Information Technology

A/B Testing

Ad Serving & Retargeting

All-in-One Marketing

Content Management

Content Marketing

Creative Management

Ecommerce Personalization

Email Marketing

Market Research

Marketing Automation

Marketing Resource Management

Social Media Analytics

Social Media Management

Survey & Forms Building

Web Analytics

Marketing

Project Management

Professional Services

Customer Onboarding

Customer Relationship Management (CRM)

Point of Sale

Predictive Sales Analytics

Sales Consulting

Sales Dialer

Sales Incentive Compensation Management

Sales Training

Sales

Virtualization Security

Security

Financial Services CRM

Hospital Management

Medical Office EMR & EHR

Revenue Cycle Management (RCM)

Shipping

eDiscovery

Vertical-Specific

Find top rated software and services based on in-depth reviews from verified users. 400+ software categories including PaaS, NoSQL, BI, HR, and more.

Amazon EMR (Elastic MapReduce)

Amazon AWS

Databricks Data Intelligence Platform

Databricks

Azure Synapse Analytics

Microsoft

Cloudera Data Platform

Cloudera

Azure Data Factory

Azure Data Lake Analytics

Synapse

Synapse (formerly SynapseFi)

Apache Hadoop

Apache

Hortonworks Data Platform

Tech Cares 2020

Tech Cares 2022

Tech Cares 2024

Integration Capabilities: Users have praised the platform for its seamless integration with Azure Datafactory and Azure Management API, facilitating deployment from powershell, API, ADFv2, and other Azure Resources. This versatile integration enhances workflow efficiency by allowing users to easily access and utilize various Azure tools within the platform.

Cost-Effective Scalability: Reviewers have expressed satisfaction with the platform's cost-effectiveness in creating and deleting dynamically on-demand clusters. By offering a budget-friendly solution for scaling operations as needed, businesses can efficiently manage resources without incurring high costs or unnecessary expenses.

Efficient Data Management: Customers appreciate the platform's efficient data management features that ensure proper organization and accessibility of data. The ability to retrieve data at any time without relying on outdated storage methods like CD/DVDs or Pendrives simplifies workflows and promotes effective data analysis and utilization.

Instability and Cluster Creation Issues: Users have experienced instability for months, encountering various problems such as difficulty controlling resource escalation and costs, unreliable on-demand clusters, and frequent cluster creation failures. These ongoing issues have hindered user workflows and led to frustration with the platform's operational reliability.

Support Team Dissatisfaction: Users expressed dissatisfaction with the support team's performance, highlighting issues with responsiveness and effectiveness, as well as noting concerns about outdated software versions. Some users felt that the lack of timely assistance impacted their overall experience negatively and impeded their ability to address critical issues promptly.

Performance Challenges with Handling Data: Some users faced performance issues when handling large volumes of data, including concerns about cost implications and occasional challenges related to lower bandwidth capabilities. The limitations in handling high data volumes coupled with sporadic bandwidth difficulties have resulted in user frustrations over the system's overall efficiency.

Azure HDInsight

Hadoop-Related

Murali Krishnaprasad joins Lara Rubbelke to discuss Interactive Query (also called Hive LLAP, or Low Latency Analytical Processing, or Live Long and Process), which is an Azure HDInsight cluster type. Interactive Query supports in-memory caching, which makes Hive queries super-fast and interactive. See how to use HDInsight Interactive Query to analyze extremely large datasets (~100TB) in common file formats such as ORC and CSV using common BI/SQL tools including Zeppelin notebooks and VS Code.
[04:12] Demo Start 

For more information, see:

+ Use Interactive Query with HDInsight (docs) https://aka.ms/azfr/458/01
+ HDInsight overview https://aka.ms/azfr/458/02
+ HDInsight pricing details https://aka.ms/azfr/458/03
+ Create a free account (Azure) https://aka.ms/azfr/458/free

HDInsight: Fast Interactive Queries with Hive on LLAP | Azure Friday

Dhruv Goel and Scott Hanselman discuss why enterprise customers trust Apache Kafka on Azure HDInsight with their streaming ingestion needs. Integrate Kafka with Azure Active Directory for authentication and set up fine-grained access control with Apache Ranger to let multiple users access Kafka easily and securely. With Azure HDInsight, you get the best of open source on a managed platform.
[04:45] Demo Start 

For more information, see:

Tutorial: Configure Kafka policies in HDInsight with Enterprise Security Package (Preview)
https://aka.ms/azfr/491/01

Azure HDInsight - Hadoop, Spark, and Kafka Service
https://aka.ms/azfr/491/02

Azure HDInsight pricing
https://aka.ms/azfr/491/03

Create a free account (Azure)
https://aka.ms/azfr/491/free

Fine-grained security with Apache Ranger on HDInsight Kafka | Azure Friday

Are you looking to gain more control of the costs of operating your growing Azure HDInsight clusters? Are you interested in driving higher utilization of your Azure HDInsight clusters? If yes, then you should definitely watch this video to learn about how to leverage Azure HDInsight Autoscale feature to help you achieve higher cost efficiency. 

Found our more at the following links:
- Drive higher utilization of Azure HDInsight clusters with autoscale: https://azure.microsoft.com/en-us/blog/drive-higher-utilization-of-azure-hdinsight-clusters-with-autoscale/?WT.mc_id=dataexposed-c9-niner
- Automatically scale Azure HDInsight clusters: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-autoscale-clusters?WT.mc_id=dataexposed-c9-niner

[00:33] Introduction
[01:00] Customer challenge
[01:55] Static clusters
[03:40] Solution is HDInsightAutoscale
[06:00] Demo of deployment
[09:05] Demo of load-balanced scaling
[10:00] Demo of scheduled scaling
[11:20] Validating cluster size

Follow Jeroen on Twitter - https://twitter.com/jeroenterheerdt

Drive higher utilization of Azure HDInsight clusters with Autoscale | Data Exposed

Using semi structured data like JSON with Hive on Azure HDInsight

Demo Azure HDInsight auf Linux

Likelihood to Recommend

Usability

Support Rating

Do more with less. At Microsoft we empower people and businesses throughout the world realize their full potential and achieve more. We make this simple mission come to life every day through our passion to create technologies and develop products that touch just about every kind of customer. With Microsoft for Nonprofit, we offer industry leading products as standalone solutions, but they're even better when used together. Our modular and extensible cloud platform allows your organization to start with your needs and adapt as you grow. These solutions provide foundational systems ranging from security and business applications to modern work tools and data and AI integration. Support you donors, volunteers, and constituents with tools and applications that help improve fundraising, engagement, training, data intelligence and much more. With Microsoft for Nonprofit we're here to help your organization expand beyond the boundaries and do more with less.

Azure API Management

Apache Spark

Azure Cosmos DB

Azure Logic Apps

Azure App Service

Azure Blob Storage

Azure Functions

Azure HDInsight 2024-04-30 19:20:19

Microsoft Power BI

SharePoint Development Consultant

Azure HDInsight 2020-09-12 03:21:17

SAP Enterprise Portal

SAP Business Warehouse

Azure HDInsight 2020-11-03 11:08:31

ABB Ability Solution Suite

Microsoft 365

Honeywell Forge Enterprise Data Management discontinued

Microsoft Teams

Honeywell Connected Plant

Azure HDInsight 2020-10-02 00:27:48

Azure HDInsight 2020-09-11 15:49:32

TrustRadius is a technology and business research firm based in Austin, Texas. The company is known as a review platform for verified B2B technology and software reviews through a proprietary algorithm and human verification.

TrustRadius

Not user friendly

Volume of data

Data analytics

Data warehouse

Get an error

Integration with microsoft

Error message

Lack of integration

Cost structure

Easy to use

High availability

Big data

Power query

Cloud based

Cost effective

Data is available

Data to excel

Low cost

Unstructured data

Disaster recovery

Home

Hadoop-Related Software

Azure HDInsight that's the main ETL and Data Processing platform of our company. It hosts all processes that generated the data we provide for our costumers, managed by ADF pipelines.

Integration with Azure Datafactory
Integration with Azure Management API
Easy to deploy from powershell, API, ADFv2 and other Azure Resources
Cheap when creating and deleting dynamically on demand clusters
A high level of documentation
Some diagnostic tools

Instable for months, with freaky problems
By default generates huge logs that finally break the cluster
Difficult to control its resources escalation
Difficult to plan, monitor and limit its costs
On-Demand clusters are very unstable and untrustful
Cluster creation process fails often
Cost is huge and difficult to control / limit
Dead weight (and cost) of some products you will never use into the cluster (we just needed Spark and Hadoop)
Poor support team
Outdated software in the clusters (almost out of support Python versions)
Almost impossible to customize and adapt for our specific needs

When our business started, it was a great value for a company with no tech experts
When business grow and data volumes also, problems started to arise: lots of on-demand clusters creations failed, cluster internal cluster crashed due to logs size (no way to limit them)
When business got really big, after having months of outage, we have to start looking for a new platform. It became ineffective in ROI.

Azure Data Factory, Azure Blob Storage, Apache Spark, Azure App Service, Azure Functions, Azure Logic Apps, Azure API Management, Azure Cosmos DB

I had a trial, was cool, but I found pointless to pay for solving issues in your platform. It just makes no sense, if that's something wrong on your size, you must pay, not me.
Additionally, the "architectural consulting" that's not of great help. When you need consulting hours from a Partner, there is a long way of paperwork to do.

No, sadly not. Support was always poor and escalation was many times stopped or almost locked.

HDInsight is used to help the Sales Department with processing analytics and managing large data. It is utilized by the Advertising and Sales Team and it addresses the problems of overall cost spend in google analytics. We definitely use the powerful query to translate high volume data into Excel in our company. The best thing is the high availability of Microsoft. Azure HDInsight makes it very easy to work with large scale data workloads in Hadoop, and it gives good benefits working on the top of the Azure data lakes.

Promote things that needed to be on top.
Current analytics changes.
As it's from Microsoft, it has high availability and support from Microsoft.
Easy transformation of high volume data.

Performance issue with large volume data.
Cost

Meet business objectives.
Advertising events so save cost.
High availibility

Microsoft Power BI and Azure Blob Storage

Azure HDInsight is being used across the whole organization in 3 countries that work together. The solution is that the organization pay for what they use.

It's scalable.
It's from Microsoft so it's friendly to use.
Data is available when you need it.

The impact is so far positive, the organization pays for the whole company in 3 countries.

SAP Business Warehouse (SAP BW), formerly SAP NetWeaver Business Warehouse, Microsoft Power BI

Azure HDInsight is used for managing data processing at TechnipFMC. Being a big company managing the data of thousands of users and customers is always a challenge. We can now access the past data and present data without being dependent on a hard drive or on some other PC.

Data is presented without interfering others (IT or other dept).
Data is managed properly and is available for retrievable any time.
Legacy use of CD/DVD and Pendrive are not required.

Sometimes, lower bandwidth faces some issues (Slow speed)
Something can be done about lower bandwidth capability as higher bandwidth may not be available at all the places.
But improvement will be there in the above capability I am sure as the technology evolves.

ROI is of course there, as no legacy software for data presentation.
No manual intervention for data retrieval.
Data is available anywhere as requested.

Microsoft 365 (formerly Office 365), Microsoft Teams, Honeywell Connected Plant, Honeywell Production Control Center for Oil & Gas (PCC), ABB Ability Solution Suite

It was used to create and manage Hadoop instance. Extracting undiscovered information from big quantities of unstructured data was easy. The Hadoop cluster was built within minutes.

The Hadoop cluster was built within minutes.
It is cost-effective to collect and store structured or unstructured data.
The flat network storage system technology offers a high-speed connection between nodes and blob storage system.

Had issues while using Azure ARM Templates for deployments.
The cost structure suited for high end temporary data analytics, rather than a traditional frequently queried data warehouse.

Less implementation cost.
No hosting services cost.
Faster data retrieval.

Azure HDInsight

Overview

What is Azure HDInsight?