Google Cloud Dataflow vs. Skyvia

It is best in cases where you have batch as well as streaming data. Also in some cases where you have batch data right now and in future you will get streaming data. In those cases Dataflow is very good. Also in cases where most of your infra is on GCP. It might not be good when you already are on AWS or Azure. And also you want in-depth control over security and management. Then you can directly use Apache beam over Dataflow.

Incentivized

1. It can be connected to slack for companies that uses that system. 2. Also can be connected to Google Drive to share information from spreadsheets and csv data. 3. It works efficiently with WordPress websites which are the most used platform for web development. 4. It connects ORACLE's databases with different systems online and that's very useful.

• Streaming, Real time work load
• Batch processing
• Auto scaling
• flexible pricing

• Skyvia is good at scheduled bidirectional data integration to/from multiple sources
• The mapping is done automatically which saves a lot of time
• I like that all connectors are included in the price, so I don't have to pay for using some new ones additionally

Incentivized

• More templates for Bigquery and App Engine. There is only limited options for templates so the things we use can limit.
• I would like native connectors for Excel (XLSX) to reduce the need for custom wrappers in financial pipelines.
• Debugging Google Cloud Dataflow using only logs in Cloud Logging can be overwhelming sometimes, and it’s not always obvious which specific element in the flow caused a failure. IT uses a lot of time.

Incentivized

• Increased ability for asymmetric process window changes.
• Continue to integrate into new applications with the same quality.
• Add some automation options in the tree.

Incentivized

It really saved a lot of time and it's flexibility really can give you infra which is future-proof for most of the use cases may it be streaming or batch data. And with this you can avoid use of resource-heavy big data offerings.

Incentivized

Because as a developer and programmer is very easy to work with and provides many options to very complex problems. It provides guides for integration that are very useful and makes us save a lot of money and time on integrations. Also Skyvia is constantly adding more data systems on their lists for us to provide as web managers.

I think guys have a really good support team, and even from different time zones we managed to get worthy support.

Google Cloud Dataproc Cloud Datafusion

Compared to similar user-friendly data integration systems like Integrate.io, Stitch, or Azure, Skyvia still wins in the number of connectors and pricing policy. Skyvia is a tool for companies like ours, starving for simple but, at the same time, robust and cost-effective data transfer solutions. It doesn't require additional knowledge for implementation and usage because it's no code. We'd recommend Skyvia as the best solution for non-technical staff.

Incentivized

• cost saving from managing our own data center for ETL servers
• consumption based pricing
• with auto scaling feature, we were able to expand components to support work load

• The core of our business lies in analyzing data from various sources, and while ETL itself is not our primary focus, it is a necessary process to achieve our goals. Thanks to Skyvia, we are able to streamline the ETL process at a reasonable price, allowing us to dedicate our efforts to data analysis without the burden of ETL complexities.

Incentivized