Azure Databricks vs. PostgreSQL

Suppose you have multiple data sources and you want to bring the data into one place, transform it and make it into a data model. Azure Databricks is a perfectly suited solution for this. Leverage spark JDBC or any external cloud based tool (ADG, AWS Glue) to bring the data into a cloud storage. From there, Azure Databricks can handle everything. The data can be ingested by Azure Databricks into a 3 Layer architecture based on the delta lake tables. The first layer, raw layer, has the raw as is data from source. The enrich layer, acts as the cleaning and filtering layer to clean the data at an individual table level. The gold layer, is the final layer responsible for a data model. This acts as the serving layer for BI For BI needs, if you need simple dashboards, you can leverage Azure Databricks BI to create them with a simple click! For complex dashboards, just like any sql db, you can hook it with a simple JDBC string to any external BI tool.

Incentivized

PostgreSQL is best used for structured data, and best when following relational database design principles. I would not use PostgreSQL for large unstructured data such as video, images, sound files, xml documents, web-pages, especially if these files have their own highly variable, internal structure.

Incentivized

• SQL
• Data management
• Data access

Incentivized

• It works well with external data sources and runs on platforms with stable performance.
• Clients can rest assured that their personal information will be safe and secure.
• Many forums discuss setup and usage, and most are free.
• Adding tooling applications to a computer is unlimited.
• PostgreSQL runs on many OS platforms and supports ANSI SQL, stored procedures, and triggers.

• Their pipeline workflow orchestration is pretty primitive. Lacks some common features
• Workspace UI and navigation requires steep learning curve
• Personally, I am not fond of their autosave feature. Its dangerous for production level notebooks scripts

Incentivized

• Clearer indications on what is the query plan, to optimize the query
• More out of the box, Postgres specific, SQL functions
• It would be nice to have a more visual aid of the relationship between all tables, but possibly this depend more on the UI used

Incentivized

As a needed software for day to day development activities

Incentivized

Based on my extensive use of Azure Databricks for the past 3.5 years, it has evolved into a beautiful amalgamation of all the data domains and needs. From a data analyst, to a data engineer, to a data scientist, it jas got them all! Being language agnostic and focused on easy to use UI based control, it is a dream to use for every Data related personnel across all experience levels!

Incentivized

Postgresql is the best tool out there for relational data so I have to give it a high rating when it comes to analytics, data availability and consistency, so on and so forth. SQL is also a relatively consistent language so when it comes to building new tables and loading data in from the OLTP database, there are enough tools where we can perform ETL on a scalable basis.

Incentivized

PostgreSQL's availability is top notch. Apart from connection time-out for an idle user, the database is super reliable.

Incentivized

The data queries are relatively quick for a small to medium sized table. With complex joins, and a wide and deep table however, the performance of the query has room for improvement.

Incentivized

There are several companies that you can contract for technical support, like EnterpriseDB or Percona, both first level in expertise and commitment to the software.

But we do not have contracts with them, we have done all the way from googling to forums, and never have a problem that we cannot resolve or pass around. And for dozens of projects and more than 15 years now.

Incentivized

The online training is request based. Had there been recorded videos available online for potential users to benefit from, I could have rated it higher. The online documentation however is very helpful. The online documentation PDF is downloadable and allows users to pace their own learning. With examples and code snippets, the documentation is great starting point.

Incentivized

The online documentation of the PostgreSQL product is elaborate and takes users step by step.

Incentivized

Against all the tools I have used, Azure Databricks is by far the most superior of them all! Why, you ask? The UI is modern, the features are never ending and they keep adding new features. And to quote Apple, "It just works!" Far ahead of the competition, the delta lakehouse platform also fares better than it counterparts of Iceberg implementation or a loosely bound Delta Lake implementation of Synapse

Incentivized

Although the competition between the different databases is increasingly aggressive in the sense that they provide many improvements, new functionalities, compatibility with complementary components or environments, in some cases it requires that it be followed within the same family of applications that performs the company that develops it and that is not all bad, but being able to adapt or configure different programs, applications or other environments developed by third parties apart is what gives PostgreSQL a certain advantage and this diversification in the components that can be joined with it, is the reason why it is a great option to choose.

Incentivized

The DB is reliable, scalable, easy to use and resolves most DB needs

Incentivized

• Helped reduce time for collecting data
• Reduced cost in maintaining multiple data sources
• Access for multiple users and management of users/data in a single platform

Incentivized

• Easy to administer so our DevOps team has only ever used minimal time to setup, tune, and maintain.
• Easy to interface with so our Engineering team has only ever used minimal time to query or modify the database. Getting the data is straightforward, what we do with it is the bigger concern.
• It's free. You can't beat that.

Incentivized