Azure Data Science Virtual Machines (DSVM) vs. Azure Databricks

Azure DSVM is useful in [a] Machine Learning environment where GPU-based processing is [required]. [The] most relevant [users] for the Azure DSVM is in ML/AI for model training and processing [high-end] CPU tasks with GPU compatibility. Azure DSVM is built for [a] startup to low medium IT environments where the ML/AI-based projects are [carried] out.

Centralised notebooks are out directly into production. This can lead to poorly engineered code. It is very good for fast queries and our data team are always able to provide what we ask for. It is a big cost to our business so it is important it runs efficiently and returns on our investment.

Incentivized

• Leveraging data.
• Computer vision.
• Data science.

Incentivized

• Data Processing and Transformations based on Spark
• Delta Lakehouse when clubbed with an external cloud storage
• Governance using Unity Catalog to unify IAM
• Delta Live Tables is a product, which although relatively newer, has a great potential with the visuals of a pipeline.

Incentivized

• Azure DSVM pricing must be reduced so that an AI-based start-up can use the Azure DSVM.
• Azure must create an environment to use Azure DSVM offline as well.
• Lack of frameworks

• Intuitive interface
• Ease of use
• Providing FAQ or QRGs

Incentivized

The developers are able to switch between Python and SQL in the Notebook which allows the collaboration of SQL analyst and Data scientist. The integration of Mosaic AI allows users to write complex codes in natural languages. Unity catalog has centralized the security and governance features and simplified the process of maintaining it

Incentivized

It's within the Azure environment and it's easy to manage.

Incentivized

I have found Azure Databricks to be much better than Snowflake for handling bigger, diverse data types. Snowflake is much simpler and better for smaller warehousing. The real time processing is much better in Azure Databricks and we have much more language options. Snowflake is more expensive but simpler to use. Both are great for different needs.

Incentivized

• Azure DSVM is little costly with long term support for ML based environments.
• Azure DSVM is very good for short tasking and costs us [a] little low than the on-prem server.
• [Scaling] option is very convenient.

• The support team is amazing, they help you at every stage of the projects, from sales to delivery.
• On a framework level, it has had an amazing impact and has reduced the clients overall data platform costs by a staggering 65%
• There has been a 40% Manual work requirement on average for the clients when they move to Azure Databricks Data Platform

Incentivized