Name: Google Cloud Dataflow
Rating: 7.9 (33 reviews)
Author: Google

Help Desk

Web and Video Conferencing

Customer Support

AI Chatbot

Changelog

Functional Testing

Innovation Management

Kubernetes Monitoring

No-Code Development

Development

Admissions and Enrollment

Attendance Tracking

Education

Barcode

Business Intelligence (BI)

Collaboration

Data Extraction

Office Suites

Privacy Policy Generators

Statistical Analysis

Workspace Planning

Enterprise

Accounting

Accounts Payable

Online Trading

Finance and Accounting

401(k)

Applicant Tracking

Background Check

Benefits Administration

Corporate Learning Management

Diversity, Equity, and Inclusion (DEI)

HR Management

Payroll

Talent Intelligence

Talent Management

Workforce Analytics

Workforce Management

Human Resources

Application Virtualization

Business Internet Service Providers (ISPs)

Cloud Storage

Enterprise Flash Array Storage

Fraud Detection

Incident Response

Integration Platform as a Service (iPaaS)

IoT Device Management

Managed Private Cloud

Network Performance Monitoring

Routers

SIP Trunking

SOA Application Gateways

Threat Hunting

Web Portal

WiFi Hotspot

Information Technology

A/B Testing

Ad Serving & Retargeting

All-in-One Marketing

Content Management

Customer Reference Management

Domain Registration Services

Email Deliverability

Email Marketing

Marketing Automation

Retail Media Advertising

SMS Marketing

Social Media Management

Survey & Forms Building

Web Analytics

Marketing

Email Signature

Project Management

Professional Services

Customer Relationship Management (CRM)

Sales

Secure Access Service Edge (SASE)

Security

Building Information Modeling (BIM)

Catering

Fleet Maintenance

Law Practice Management

PCB Design

Restaurant POS

Retail Management

Vertical-Specific

Top Rated 2024

large

medium

small

Google's BigQuery is part of the Google Cloud Platform, a database-as-a-service (DBaaS) supporting the querying and rapid analysis of enterprise data.

Standard edition

Enterprise edition

Enterprise Plus edition

Google BigQuery

Database-as-a-Service (DBaaS)

Database-as-a-Service

Automatic software patching

Database scalability

Automated backups

Database security provisions

Monitoring and metrics

Automatic host deployment

Google

Microsoft's Azure Data Factory is a service built for all data integration needs and skill levels. It is designed to allow the user to easily construct ETL and ELT processes code-free within the intuitive visual environment, or write one's own code. Visually integrate data sources using more than 80 natively built and maintenance-free connectors at no added cost. Focus on data—the serverless integration service does the rest.

Azure Data Factory

Data Integration

Data Source Connection

Data Transformations

Data Modeling

Data Governance

Connect to traditional data sources

Connecto to Big Data and NoSQL

Simple transformations

Complex transformations

Data model creation

Metadata management

Business rules and workflow

Testing and debugging

Integration with data quality tools

Integration with MDM tools

Microsoft

Amazon Kinesis is a streaming analytics suite for data intake from video or other disparate sources and applying analytics for machine learning (ML) and business intelligence.

Amazon Kinesis Data Streams

Amazon Kinesis Data Firehose

Amazon Kinesis Data Analytics

Amazon Kinesis Video Streams

Amazon Kinesis

Streaming Analytics

Real-Time Data Analysis

Data Ingestion from Multiple Data Sources

Low Latency

Integrated Development Tools

Data wrangling and preparation

Linear Scale-Out

Data Enrichment

Amazon AWS

Starter

Standard

Fivetran

Confluent Cloud is a cloud-native service for Apache Kafka used to connect and process data in real time with a fully managed data streaming platform. Confluent Platform is the self-managed version.

Confluent

Visualization Dashboards

Striim is an enterprise-grade platform that offers continuous real-time data ingestion, high-speed in-flight stream processing, and sub-second delivery of data to cloud and on-premises endpoints.

Striim Platform

Striim Cloud Enterprise Platform

Striim

Microsoft's SQL Server Integration Services (SSIS) is a data integration solution.

SQL Server Integration Services

Google offers Cloud Pub/Sub, a managed message oriented middleware supporting many-to-many asynchronous messaging between applications.

Google Cloud Pub/Sub

Message Oriented Middleware

Spotfire Streaming

Spotfire Streaming StreamBase / TIBCO Streaming Streambase TIBCO Stream

Spotfire

Amazon Athena is an interactive query service that makes it easy to analyze data directly in Amazon S3 using standard SQL. With a few clicks in the AWS Management Console, customers can point Athena at their data stored in S3 and begin using standard SQL to run ad-hoc queries and get results in seconds. Athena is serverless, so there is no infrastructure to setup or manage, and customers pay only for the queries they run. You can use Athena to process logs, perform ad-hoc analysis, and run interactive queries. Athena scales automatically – executing queries in parallel – so results are fast, even with large datasets and complex queries.

Price per Query

Amazon Athena

Tech Cares 2022

Google offers Cloud Dataflow, a managed streaming analytics platform for real-time data insights, fraud detection, and other purposes.

Microsoft offers Azure Stream Analytics for IoT and connected devices,  supporting real-time analytics and reporting.

Dedicated

Azure Stream Analytics

Azure Stream Analytics Microsoft Azure Stream Analytics

per seat license

floating license

Elecard StreamEye Studio

Elecard

Google Cloud Dataflow

Streaming Analytics is performing analytic computations on data streaming from devices, sensors, websites, social media, applications, infrastructure systems, and more. This category of tools is an evolution of Complex Event Processing (CEP) software, designed specifically for the big data era.

Likelihood to Recommend

Machine Learning Automation

Google’s mission is to organize the world‘s information and make it universally accessible and useful. 

Since its founding in 1998, Google has grown by leaps and bounds. From offering search in a single language the company now offers dozens of products and services—including various forms of advertising and web applications for all kinds of tasks—in scores of languages. And starting from two computer science students in a university dorm room, the company now has thousands of employees and offices around the world.

Streaming Analytics is performing analytic computations on streaming data. Data streams can come from devices, sensors, websites, social media, applications, infrastructure systems, and more.

Easy-to-understand pictorial illustration of data with graphs charts and dashboards

Ability to ingest data from many sources including Internet of Things (IoT) endpoint data, stock trading data etc, as well as static data

How many milli-seconds or seconds it takes to ingest, analyze and respond to an incoming event or
data-point

Tools to allow developers to rapidly create streaming applications via a graphical user interface and selection of predefined
functions and operators

Tools to rapidly prepare data for analysis by normalization, data cleansing, etc.

Easy to scale out or scale down by visually changing the resource allocation. This allows changes in load or traffic to be handled without interruptions

Machine learning helps automate predictive scoring on streaming data

Ability to enrich the data stream with static reference data

Reviews

TrustRadius is a technology and business research firm based in Austin, Texas. The company is known as a review platform for verified B2B technology and software reviews through a proprietary algorithm and human verification.

TrustRadius

Home

Streaming Analytics Software

erwin Data Modeler

Microsoft Teams

In our company we are using Google Cloud Dataflow to create data pipe lines for data transformation and ingestion use cases before loading data into database. Flexibility to create our own flex templates for any special case handling. Capability to fit streaming and batch data loads are some benefits. We have some real time loads, which Dataflow helps alot.

Product Usage

Pros and Cons

Streaming, Real time work load
Batch processing
Auto scaling
flexible pricing

Things done well

inbuild template options can be expanded
more data connector options
easy of use

Things done poorly

Based on my experience, streaming / real time / machine learning / AI type of processing and batch processing which needs less transformation are very well suited. Work load that needs complex transformation / multiple hops gets very complicated to implement. New feature like Dataflow SQL option will come in handy for sql heavy users.

Feature Ratings

cost saving from managing our own data center for ETL servers
consumption based pricing
with auto scaling feature, we were able to expand components to support work load

Return on Investment

Alternatives

Google Cloud Dataflow 2022-01-08 09:49:06

Operating Systems	Unspecified
Mobile Application	No

Google Cloud Dataflow

Overview

What is Google Cloud Dataflow?

Google Managed data processing service

Awards

Pricing

Google Cloud Dataflow

What is Google Cloud Dataflow?

Entry-level set up fee?

Offerings

Would you like us to let the vendor know that you want pricing?

Alternatives Pricing

Azure Stream Analytics

What is Azure Stream Analytics?

Elecard StreamEye Studio

What is Elecard StreamEye Studio?

Product Details

What is Google Cloud Dataflow?

Google Cloud Dataflow Technical Details

Comparisons

Compare with

Google BigQuery

Azure Data Factory

Amazon Kinesis

Fivetran

Confluent

Striim

SSIS

Google Cloud Pub/Sub

Spotfire Streaming

Amazon Athena

Reviews and Ratings

Reviews

No reviews found