Azure OpenAI Service vs. Vertex AI

The pricing doesn't seem fair to me if we compare the limitations and errors in the models. Also, they are currently working on new unified portal for all AI projects which is in beta preview. So, I guess we should wait until it matures, and fixes all the issues and should use once pricing and performance improves.

Incentivized

We needed to build some ML models and Vertex AI is one such place where all the functionalities are consolidated for model deployment, tweaking and monitoring. And although it is costly, it is compatible with google cloud services and is scalable which makes it the perfect tool for us.

Incentivized

• It's generative AI like ChatGPT but you get advanced models, so it's more powerful.
• You can use API to automate the process of Generative AI tasks.
• It also provides a sample script code on how we can use the API.

Incentivized

• Vertex AI comes with support for LOTs of LLMs out of the box
• MLOps tools are available that help to standardize operational aspects
• Document AI is an out of the box feature that works just perfectly for our use cases of automating lots to tedious data extraction tasks from images as well as papers

Incentivized

• The user interface is similar to the Azure, so it's bit laggy, they should improve it.
• The chat models sometimes return nothing, I guess they are still testing them.
• The models we use have quota limitation on tokens and number of requests.

Incentivized

• Customization of AutoML models - A must needed capability to be able to tweak hyperparameters and also working with different models
• Model Explainability -Providing more comprehensive explanations about how models are utilizing features could be very beneficial
• Model versioning and experiments tracking - Enhancing the versioning capability could be good for end users

Incentivized

Vertex AI is very user friendly and it is very fast. We can spin up instances pretty quickly and it allows to work with GPU instances without much planning. Pages load up very quickly and tasks are competed pretty much in time frame. It integrates with other systems also very well.

Incentivized

Overall, Azure OpenAI services are not worth using, but only reason I used it because I got it under Startup sponsorship from Microsoft. Pricing is very high.

Incentivized

Vertex AI is much more accessible to non-developers than IBM's product. Moreover, Vertex AI integrates well with other Google products, enhancing its capabilities. A big plus is its integration with cloud storage, that allows for better management and access of data. In all honesty, it wasn't much of a difficult choice to choose Vertex AI.

Incentivized

• Honestly, I just started using it a few months ago, and I haven't seen any major benefits.
• It has almost similar capabilities as free version of ChatGPT, so it's worth paying for chat models unless we need to use API.
• ROI has not been impacted at all, as I mostly use free version over this to avoid higher charges.

Incentivized

• It consolidated all the functionalities in one place for AI and ML development.
• Scalable and compatible with google cloud services.
• Though we can manually allocate resources, it is still very costly.

Incentivized