Azure Databricks vs. IBM ILOG CPLEX Optimization Studio

Centralised notebooks are out directly into production. This can lead to poorly engineered code. It is very good for fast queries and our data team are always able to provide what we ask for. It is a big cost to our business so it is important it runs efficiently and returns on our investment.

Incentivized

It is well suited for solving large-sized, mixed-integer, and integer programming problems. Now, the new version supports for Multi-Objective optimization along with some new algorithms such as Benders Decomposition. It is less appropriate for quadratic programming problems where the objective function is the product of multiple variables. However, it's very easy to code any problem.

• Data Processing and Transformations based on Spark
• Delta Lakehouse when clubbed with an external cloud storage
• Governance using Unity Catalog to unify IAM
• Delta Live Tables is a product, which although relatively newer, has a great potential with the visuals of a pipeline.

Incentivized

• Linear Programming
• Mixed-Integer Linear Programming
• Non-Linear Convex-Optimization
• Visualization
• Shadow Price Analysis
• Parameter Tuning

• Intuitive interface
• Ease of use
• Providing FAQ or QRGs

Incentivized

• Data handling from different sources like Note Pad, etc.
• Large size of MILP problems.
• Various parameters to set.

The developers are able to switch between Python and SQL in the Notebook which allows the collaboration of SQL analyst and Data scientist. The integration of Mosaic AI allows users to write complex codes in natural languages. Unity catalog has centralized the security and governance features and simplified the process of maintaining it

Incentivized

It's nice to use and with good optimization.

Honestly, to say, I never contacted CPLEX but used its forum to know/clarify any issues I faced.

I have found Azure Databricks to be much better than Snowflake for handling bigger, diverse data types. Snowflake is much simpler and better for smaller warehousing. The real time processing is much better in Azure Databricks and we have much more language options. Snowflake is more expensive but simpler to use. Both are great for different needs.

Incentivized

IBM CPLEX Optimization Studio covers wide range of problems in comparison to Gurobi and also offers a number of visualization tools for results analysis. It has better customization and parameter tuning options in comparison to Gurobi. It offers various API integrations such as Python, Java and C++ which is not the case with Gurobi.

• The support team is amazing, they help you at every stage of the projects, from sales to delivery.
• On a framework level, it has had an amazing impact and has reduced the clients overall data platform costs by a staggering 65%
• There has been a 40% Manual work requirement on average for the clients when they move to Azure Databricks Data Platform

Incentivized

• Faster computation leading to better internal customer relations
• Able to solve high variable problems with ease
• Anomaly detection became easier within business