Confluent vs. Google Cloud Dataflow vs. Skyvia

If you have a need to stream data, real time or segmented structured data then Confluent is a great platform to do so with. You won't run into packet transfer size limitations that other platforms have. Flexibility in on-prem, cloud, and managed cloud offerings makes it very flexible no matter how you choose to implement.

Incentivized

It is best in cases where you have batch as well as streaming data. Also in some cases where you have batch data right now and in future you will get streaming data. In those cases Dataflow is very good. Also in cases where most of your infra is on GCP. It might not be good when you already are on AWS or Azure. And also you want in-depth control over security and management. Then you can directly use Apache beam over Dataflow.

Incentivized

1. It can be connected to slack for companies that uses that system. 2. Also can be connected to Google Drive to share information from spreadsheets and csv data. 3. It works efficiently with WordPress websites which are the most used platform for web development. 4. It connects ORACLE's databases with different systems online and that's very useful.

• Products work great.
• Training is available.
• Customer support is good.

Incentivized

• Streaming, Real time work load
• Batch processing
• Auto scaling
• flexible pricing

• Skyvia is good at scheduled bidirectional data integration to/from multiple sources
• The mapping is done automatically which saves a lot of time
• I like that all connectors are included in the price, so I don't have to pay for using some new ones additionally

Incentivized

• Cloud based Azure platform features for Confluent lacks behind AWS And GCP

Incentivized

• More templates for Bigquery and App Engine. There is only limited options for templates so the things we use can limit.
• I would like native connectors for Excel (XLSX) to reduce the need for custom wrappers in financial pipelines.
• Debugging Google Cloud Dataflow using only logs in Cloud Logging can be overwhelming sometimes, and it’s not always obvious which specific element in the flow caused a failure. IT uses a lot of time.

Incentivized

• Increased ability for asymmetric process window changes.
• Continue to integrate into new applications with the same quality.
• Add some automation options in the tree.

Incentivized

It really saved a lot of time and it's flexibility really can give you infra which is future-proof for most of the use cases may it be streaming or batch data. And with this you can avoid use of resource-heavy big data offerings.

Incentivized

Because as a developer and programmer is very easy to work with and provides many options to very complex problems. It provides guides for integration that are very useful and makes us save a lot of money and time on integrations. Also Skyvia is constantly adding more data systems on their lists for us to provide as web managers.

The support from the Confluent platform is great and satisfying. We have been working with Confluent for more than a year now. They sent out resident architects to help us set up Confluent cluster on our cloud and help us troubleshoot problems we have encountered. Overall, it has been a great experience working with the Confluent Platform.

Incentivized

I think guys have a really good support team, and even from different time zones we managed to get worthy support.

For our use case it was very important that the technology we were working with fit into our Azure architecture, and met our data processing size requirements to stream data within certain SLAs. Confluent more than met our performance requirements and compared to the others scale options and cost to run it was more than financially viable as a platform solution to our global operations.

Incentivized

Google Cloud Dataproc Cloud Datafusion

Compared to similar user-friendly data integration systems like Integrate.io, Stitch, or Azure, Skyvia still wins in the number of connectors and pricing policy. Skyvia is a tool for companies like ours, starving for simple but, at the same time, robust and cost-effective data transfer solutions. It doesn't require additional knowledge for implementation and usage because it's no code. We'd recommend Skyvia as the best solution for non-technical staff.

Incentivized

• It enables us to develop event driven application.
• It increases our ability to handle streaming data.
• It reduces latency of communication.

Incentivized

• cost saving from managing our own data center for ETL servers
• consumption based pricing
• with auto scaling feature, we were able to expand components to support work load

• The core of our business lies in analyzing data from various sources, and while ETL itself is not our primary focus, it is a necessary process to achieve our goals. Thanks to Skyvia, we are able to streamline the ETL process at a reasonable price, allowing us to dedicate our efforts to data analysis without the burden of ETL complexities.

Incentivized