Azure Databricks vs. Azure OpenAI Service

Centralised notebooks are out directly into production. This can lead to poorly engineered code. It is very good for fast queries and our data team are always able to provide what we ask for. It is a big cost to our business so it is important it runs efficiently and returns on our investment.

Incentivized

If you're looking for a managed OpenAI API service, then Azure OpenAI Service is a good choice.

It's fully compatible with OpenAI API, has lots of models to choose from, lots of parameters to configure to suite your needs.

The documents are well maintained, with examples to get started.

You can also setup firewall to restrict access to the API to certain IP addresses, like those of your VPCs.

Incentivized

• Data Processing and Transformations based on Spark
• Delta Lakehouse when clubbed with an external cloud storage
• Governance using Unity Catalog to unify IAM
• Delta Live Tables is a product, which although relatively newer, has a great potential with the visuals of a pipeline.

Incentivized

• Generating SQL
• Generating Images
• Sensible Response

Incentivized

• Intuitive interface
• Ease of use
• Providing FAQ or QRGs

Incentivized

• The user interface is similar to the Azure, so it's bit laggy, they should improve it.
• The chat models sometimes return nothing, I guess they are still testing them.
• The models we use have quota limitation on tokens and number of requests.

Incentivized

The developers are able to switch between Python and SQL in the Notebook which allows the collaboration of SQL analyst and Data scientist. The integration of Mosaic AI allows users to write complex codes in natural languages. Unity catalog has centralized the security and governance features and simplified the process of maintaining it

Incentivized

I think it's a good product and appreciate the addition secure guard rails that running it in Azure provide. However, I still struggle at times to get to the right resources for support and region-based capacity can also be a challenge.

Incentivized

I have found Azure Databricks to be much better than Snowflake for handling bigger, diverse data types. Snowflake is much simpler and better for smaller warehousing. The real time processing is much better in Azure Databricks and we have much more language options. Snowflake is more expensive but simpler to use. Both are great for different needs.

Incentivized

1. Open AI is best at giving accurate answers. 2. It is secure and more trustworthy 3. Most of our client using Azure cloud so it becomes go to choice for them. 4. Scalable as it handles 1000s of request per minute. 5. SDKs are easy to use and well documented.

Incentivized

• The support team is amazing, they help you at every stage of the projects, from sales to delivery.
• On a framework level, it has had an amazing impact and has reduced the clients overall data platform costs by a staggering 65%
• There has been a 40% Manual work requirement on average for the clients when they move to Azure Databricks Data Platform

Incentivized

• Our test group of 100 people created more than 200 conversations within the first day
• People were excited & asked to be included to the test group once words spread that we have an internal ChatGPT portal
• People started to create & share their own assistants (prompt engineering) for various purposes like code review, marketing, email, etc.

Incentivized