Azure Databricks vs. IBM InfoSphere Information Server

Centralised notebooks are out directly into production. This can lead to poorly engineered code. It is very good for fast queries and our data team are always able to provide what we ask for. It is a big cost to our business so it is important it runs efficiently and returns on our investment.

Incentivized

Information Server is extremely useful to replace manual developments that require a lot of coding effort. It significantly increases the productivity of the initial development and the future maintenance of the processes since it has a visual development environment with self-documentation.

• Data Processing and Transformations based on Spark
• Delta Lakehouse when clubbed with an external cloud storage
• Governance using Unity Catalog to unify IAM
• Delta Live Tables is a product, which although relatively newer, has a great potential with the visuals of a pipeline.

Incentivized

• IIS best for ETL ,not ELT , and many and diffrent source systems.
• It also can process big data , unstuctured data
• It is not only DWH , you can use infosphere for analys and see the bigger architecture of your OLTP systems

Incentivized

• Intuitive interface
• Ease of use
• Providing FAQ or QRGs

Incentivized

• I would be nice to have a new web development environment for DataStage.
• Connectivity Packs such as Pack for SAP Application are a little pricey.
• It is confusing for new developers the possibility of developing jobs using different execution engines such as Parallel or Server.

Incentivized

• Scale of implementation
• IBM techsupport

Incentivized

The developers are able to switch between Python and SQL in the Notebook which allows the collaboration of SQL analyst and Data scientist. The integration of Mosaic AI allows users to write complex codes in natural languages. Unity catalog has centralized the security and governance features and simplified the process of maintaining it

Incentivized

I have found Azure Databricks to be much better than Snowflake for handling bigger, diverse data types. Snowflake is much simpler and better for smaller warehousing. The real time processing is much better in Azure Databricks and we have much more language options. Snowflake is more expensive but simpler to use. Both are great for different needs.

Incentivized

DataStage is more robust and stable than ODI The ability to perform complex transformations or implement business rules is much more developed in DS

• The support team is amazing, they help you at every stage of the projects, from sales to delivery.
• On a framework level, it has had an amazing impact and has reduced the clients overall data platform costs by a staggering 65%
• There has been a 40% Manual work requirement on average for the clients when they move to Azure Databricks Data Platform

Incentivized

• Productivity of the development of integration processes.
• Better documentation and governance.
• Reduce training costs of various technologies.