Azure OpenAI Service vs. Vertex AI

If you're looking for a managed OpenAI API service, then Azure OpenAI Service is a good choice.

It's fully compatible with OpenAI API, has lots of models to choose from, lots of parameters to configure to suite your needs.

The documents are well maintained, with examples to get started.

You can also setup firewall to restrict access to the API to certain IP addresses, like those of your VPCs.

Incentivized

Vertex AI seems to be a lot more accurate with image editing versus other competitors (including free one). We do a lot of image creation, especially of dogs in very certain scenarios. We use Adobe Stock to get us started, but many times we need some very specific edits done to the image. We've found Vertex can produce those with a lot more precision than other AI image generators.

Incentivized

• Generating SQL
• Generating Images
• Sensible Response

Incentivized

• Vertex AI comes with support for LOTs of LLMs out of the box
• MLOps tools are available that help to standardize operational aspects
• Document AI is an out of the box feature that works just perfectly for our use cases of automating lots to tedious data extraction tasks from images as well as papers

Incentivized

• The user interface is similar to the Azure, so it's bit laggy, they should improve it.
• The chat models sometimes return nothing, I guess they are still testing them.
• The models we use have quota limitation on tokens and number of requests.

Incentivized

• Customization of AutoML models - A must needed capability to be able to tweak hyperparameters and also working with different models
• Model Explainability -Providing more comprehensive explanations about how models are utilizing features could be very beneficial
• Model versioning and experiments tracking - Enhancing the versioning capability could be good for end users

Incentivized

I think it's a good product and appreciate the addition secure guard rails that running it in Azure provide. However, I still struggle at times to get to the right resources for support and region-based capacity can also be a challenge.

Incentivized

It's not always instant, but understandable when it's under heavy load. It's not impressive nor disappointing, just what is expected. But when calling this platform through API's for it to do the actions requested there is minimal delay and wait time. It feels very responsive and quick when integrating it with a call center chat platform for example.

Incentivized

1. Open AI is best at giving accurate answers. 2. It is secure and more trustworthy 3. Most of our client using Azure cloud so it becomes go to choice for them. 4. Scalable as it handles 1000s of request per minute. 5. SDKs are easy to use and well documented.

Incentivized

Vertex AI is much more accessible to non-developers than IBM's product. Moreover, Vertex AI integrates well with other Google products, enhancing its capabilities. A big plus is its integration with cloud storage, that allows for better management and access of data. In all honesty, it wasn't much of a difficult choice to choose Vertex AI.

Incentivized

• Our test group of 100 people created more than 200 conversations within the first day
• People were excited & asked to be included to the test group once words spread that we have an internal ChatGPT portal
• People started to create & share their own assistants (prompt engineering) for various purposes like code review, marketing, email, etc.

Incentivized

• It is pay as you go model so it'll save more cost of your org. In our case previously we used to incurred 1-2L/Month now we are reduced it to 80k-1L.
• It'll help you save your model training & model selection time as it provides pre-trained models in autoML.
• It'll help you in terms of Security wherein we can use row level security access to authorized persons.

Incentivized