Databricks Data Intelligence Platform vs. Vertex AI

Medium to Large data throughput shops will benefit the most from Databricks Spark processing. Smaller use cases may find the barrier to entry a bit too high for casual use cases. Some of the overhead to kicking off a Spark compute job can actually lead to your workloads taking longer, but past a certain point the performance returns cannot be beat.

Incentivized

we used Vertex AI on our automation process the model very useful and working as expected we have implemented in our monitoring phase this very helpful our analysis part. real time response is very effective and actively provide detailed overview about our products.this phase is well suited in our org. this model could not applicable for small level projects why because this model not needed for small level projects and without related resource of ML this model not useful. strictly on non cloud org not suitable means on pram not suitable

Incentivized

• Process raw data in One Lake (S3) env to relational tables and views
• Share notebooks with our business analysts so that they can use the queries and generate value out of the data
• Try out PySpark and Spark SQL queries on raw data before using them in our Spark jobs
• Modern day ETL operations made easy using Databricks. Provide access mechanism for different set of customers

Incentivized

• Vertex AI comes with support for LOTs of LLMs out of the box
• MLOps tools are available that help to standardize operational aspects
• Document AI is an out of the box feature that works just perfectly for our use cases of automating lots to tedious data extraction tasks from images as well as papers

Incentivized

• Sometimes, when multiple jobs depend on each other in different environments, it is not always easy to see the full workflow in one place.
• It is sometimes difficult to determine which job or cluster contributes more to the overall cost.
• For beginners, cluster configuration may be a little difficult. So more recommendation in the platform can help.

Incentivized

• Customization of AutoML models - A must needed capability to be able to tweak hyperparameters and also working with different models
• Model Explainability -Providing more comprehensive explanations about how models are utilizing features could be very beneficial
• Model versioning and experiments tracking - Enhancing the versioning capability could be good for end users

Incentivized

Because it is an amazing platform for designing experiments and delivering a deep dive analysis that requires execution of highly complex queries, as well as it allows to share the information and insights across the company with their shared workspaces, while keeping it secured.

in terms of graph generation and interaction it could improve their UI and UX

Incentivized

Google is always top notch with their security and user interface performance. We use Google's entire suite in our business anyways, so using Vertex became second nature very quickly. I will say, though, that Google does need to come down on the price somewhat with their token allocation. Also, their UI is very robust, so it does require some time for training to really master it.

Incentivized

One of the best customer and technology support that I have ever experienced in my career. You pay for what you get and you get the Rolls Royce. It reminds me of the customer support of SAS in the 2000s when the tools were reaching some limits and their engineer wanted to know more about what we were doing, long before "data science" was even a name. Databricks truly embraces the partnership with their customer and help them on any given challenge.

The most important differentiating factor for Databricks Lakehouse Platform from these other platforms is support for ACID transactions and the time travel feature. Also, native integration with managed MLflow is a plus. EMR, Cloudera, and Hortonworks are not as optimized when it comes to Spark Job Execution. Other platforms need to be self-managed, which is another huge hassle.

Incentivized

We tend to adapt and use the platform that suits the customers needs the best. We return to Vertex AI because it is the most in-depth option out there so we can configure it any which way they want. However, it is not quick to market and constantly changing or updating it's feature-set. This makes it suitable for bigger customers that have the capital and time to spend on a bigger project that is well researched and not quick to market like some of the other options that feel like a light-version of this.

Incentivized

• The ability to spin up a BIG Data platform with little infrastructure overhead allows us to focus on business value not admin
• DB has the ability to terminate/time out instances which helps manage cost.
• The ability to quickly access typical hard to build data scenarios easily is a strength.

Incentivized

• It is pay as you go model so it'll save more cost of your org. In our case previously we used to incurred 1-2L/Month now we are reduced it to 80k-1L.
• It'll help you save your model training & model selection time as it provides pre-trained models in autoML.
• It'll help you in terms of Security wherein we can use row level security access to authorized persons.

Incentivized