Azure OpenAI Service - Your Private Managed OpenAI API
October 30, 2024

Azure OpenAI Service - Your Private Managed OpenAI API

Anonymous | TrustRadius Reviewer
Score 9 out of 10
Vetted Review
Verified User

Overall Satisfaction with Azure OpenAI Service

We realized that our employees are using ChatGPT to accelerate their daily work. That's a good thing as it shows they're embracing new technologies to improve productivity. However, ChatGPT being 3rd party, that usage carries the risk of leaking customer sensitive data.

That's why we decided to setup & operate an internal ChatGPT portal so our people can leverage AI power while keeping our data private.

Pros

  • Well documented API
  • Multiple models to choose from
  • Advanced networking options

Cons

  • More examples would be helpful, especially when it come to token counting & summarizing
  • Pricing is not really straightforward to estimate as it's based on token count
  • Complete privacy requires special agreement with Microsoft
  • Our test group of 100 people created more than 200 conversations within the first day
  • People were excited & asked to be included to the test group once words spread that we have an internal ChatGPT portal
  • People started to create & share their own assistants (prompt engineering) for various purposes like code review, marketing, email, etc.
It's a managed service, so you don't need any operational experience with LLMs. You don't even need to setup or provision anything, just start using it.

The API is backed by Azure high availability, so it's likely the most robust part of your LLM solution.

The API is well documented so you can get started easily with some code snippets before implementing the full solution.

Do you think Azure OpenAI Service delivers good value for the price?

Yes

Are you happy with Azure OpenAI Service's feature set?

Yes

Did Azure OpenAI Service live up to sales and marketing promises?

Yes

Did implementation of Azure OpenAI Service go as expected?

Yes

Would you buy Azure OpenAI Service again?

Yes

AWS Secrets Manager, Amazon Elastic Container Service (Amazon ECS), MongoDB Atlas
If you're looking for a managed OpenAI API service, then Azure OpenAI Service is a good choice.

It's fully compatible with OpenAI API, has lots of models to choose from, lots of parameters to configure to suite your needs.

The documents are well maintained, with examples to get started.

You can also setup firewall to restrict access to the API to certain IP addresses, like those of your VPCs.

Comments

More Reviews of Azure OpenAI Service

  1. Home
  2. Machine Learning Tools
  3. Azure OpenAI Service Reviews
  4. User Review of Azure OpenAI Service