Google Cloud Dataflow vs. jKool

Based on my experience, streaming / real time / machine learning / AI type of processing and batch processing which needs less transformation are very well suited. Work load that needs complex transformation / multiple hops gets very complicated to implement. New feature like Dataflow SQL option will come in handy for sql heavy users.

JKool is a decent tool for retrieving information regarding user engagement and customer feedback for your software products. With these information it's very valuable stepping stone for us to make future updates or produce new products. However, there are some downsides with jKool, two of which are there are too much clutter in the GUI and it takes sometimes to turn how things work.

Incentivized

• Streaming, Real time work load
• Batch processing
• Auto scaling
• flexible pricing

• inbuild template options can be expanded
• more data connector options
• easy of use

Google Cloud Dataproc Cloud Datafusion

No other product that I used is similar to jKool, it's unique product that have good amount of features that I would be opened to invest more in the future if time permit. It still has a long way to go and the first thing it can do is clean up it user interface to make it better.

Incentivized

• cost saving from managing our own data center for ETL servers
• consumption based pricing
• with auto scaling feature, we were able to expand components to support work load