Google Cloud Dataflow vs. PostgreSQL

It is best in cases where you have batch as well as streaming data. Also in some cases where you have batch data right now and in future you will get streaming data. In those cases Dataflow is very good. Also in cases where most of your infra is on GCP. It might not be good when you already are on AWS or Azure. And also you want in-depth control over security and management. Then you can directly use Apache beam over Dataflow.

Incentivized

PostgreSQL is best used for structured data, and best when following relational database design principles. I would not use PostgreSQL for large unstructured data such as video, images, sound files, xml documents, web-pages, especially if these files have their own highly variable, internal structure.

Incentivized

• Streaming, Real time work load
• Batch processing
• Auto scaling
• flexible pricing

• It works well with external data sources and runs on platforms with stable performance.
• Clients can rest assured that their personal information will be safe and secure.
• Many forums discuss setup and usage, and most are free.
• Adding tooling applications to a computer is unlimited.
• PostgreSQL runs on many OS platforms and supports ANSI SQL, stored procedures, and triggers.

• More templates for Bigquery and App Engine. There is only limited options for templates so the things we use can limit.
• I would like native connectors for Excel (XLSX) to reduce the need for custom wrappers in financial pipelines.
• Debugging Google Cloud Dataflow using only logs in Cloud Logging can be overwhelming sometimes, and it’s not always obvious which specific element in the flow caused a failure. IT uses a lot of time.

Incentivized

• Clearer indications on what is the query plan, to optimize the query
• More out of the box, Postgres specific, SQL functions
• It would be nice to have a more visual aid of the relationship between all tables, but possibly this depend more on the UI used

Incentivized

As a needed software for day to day development activities

Incentivized

It really saved a lot of time and it's flexibility really can give you infra which is future-proof for most of the use cases may it be streaming or batch data. And with this you can avoid use of resource-heavy big data offerings.

Incentivized

Postgresql is the best tool out there for relational data so I have to give it a high rating when it comes to analytics, data availability and consistency, so on and so forth. SQL is also a relatively consistent language so when it comes to building new tables and loading data in from the OLTP database, there are enough tools where we can perform ETL on a scalable basis.

Incentivized

PostgreSQL's availability is top notch. Apart from connection time-out for an idle user, the database is super reliable.

Incentivized

The data queries are relatively quick for a small to medium sized table. With complex joins, and a wide and deep table however, the performance of the query has room for improvement.

Incentivized

There are several companies that you can contract for technical support, like EnterpriseDB or Percona, both first level in expertise and commitment to the software.

But we do not have contracts with them, we have done all the way from googling to forums, and never have a problem that we cannot resolve or pass around. And for dozens of projects and more than 15 years now.

Incentivized

The online training is request based. Had there been recorded videos available online for potential users to benefit from, I could have rated it higher. The online documentation however is very helpful. The online documentation PDF is downloadable and allows users to pace their own learning. With examples and code snippets, the documentation is great starting point.

Incentivized

The online documentation of the PostgreSQL product is elaborate and takes users step by step.

Incentivized

Google Cloud Dataproc Cloud Datafusion

Although the competition between the different databases is increasingly aggressive in the sense that they provide many improvements, new functionalities, compatibility with complementary components or environments, in some cases it requires that it be followed within the same family of applications that performs the company that develops it and that is not all bad, but being able to adapt or configure different programs, applications or other environments developed by third parties apart is what gives PostgreSQL a certain advantage and this diversification in the components that can be joined with it, is the reason why it is a great option to choose.

Incentivized

The DB is reliable, scalable, easy to use and resolves most DB needs

Incentivized

• cost saving from managing our own data center for ETL servers
• consumption based pricing
• with auto scaling feature, we were able to expand components to support work load

• Easy to administer so our DevOps team has only ever used minimal time to setup, tune, and maintain.
• Easy to interface with so our Engineering team has only ever used minimal time to query or modify the database. Getting the data is straightforward, what we do with it is the bigger concern.
• It's free. You can't beat that.

Incentivized