Apache Beam vs. AWS Data Pipeline vs. Informatica Intelligent Data Management Cloud

AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals. With AWS Data Pipeline, you can regularly access your data where it’s stored, transform and process it at scale, and efficiently transfer the results to AWS services such as Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR.

Incentivized

Informatica Cloud is a great tool for use when data must be formatted consistently. Once configured, it is very robust and reliable. It is also well-suited for an organization without a robust IT staff to maintain a full server infrastructure. It offers a cost-effective approach to high-quality data integration for even the largest organizations. Organizations without staff experienced in data analytics may find it challenging to take advantage of the more complex results of this tool.

Incentivized

• Helps you easily create complex data processing workloads
• Fault tolerant
• Highly available

Incentivized

• Once the secure connection is established it’s quite easy to operate and create new jobs. The controls are simple, and we appreciate the fact there are not a lot of complex fine-tunings required. Navigation is also easy, and we enjoy the ability to open multiple tabs in the browser to work on multiple projects.
• The monitoring functionality works well to help track the progress of the jobs, again, without too much complication. In a fast dev environment, speed is essential and we quickly seeing the status/progress of jobs as well as any errors if the jobs fail helps us maintain speed.
• The web interface is a lot easier to interact with than the client/on-prem version. Putting much of the heavy lifting of interacting with the tool onto the shoulders of the browser makes it easier to keep multiple sessions open and get in/out quickly without having to VPN into the office.

Incentivized

• Pipeline Stuck in Pending Status
• Pipeline Component Stuck in Waiting for Runner Status
• EMR Cluster Fails With Error

Incentivized

• The User Interface can be a bit difficult to get in initial stages.
• Error messages are hard to understand which sometimes takes a lot of time for the resolution
• Cannot Implement complex SQL queries which should be fixed in future release.

Incentivized

I've never had trouble getting into contact with Informatica's support for technical help. I give it a nine because it does pretty well for mid to enterprise-scale workflows.

Incentivized

AWS data pipelines are easy to use over data factory for data engineers

Incentivized

First, the wizard is easy to use making the learning curve for simple ETL tasks nice. Second, since Informatica is mature there are a good variety of connectors available. Finally, we have driven some fairly complex ETL solutions using only the cloud.

Incentivized

• Easy to use
• Data engineers are able to create the data pipelines quickly and effectively
• Scalable and Fault tolerant

Incentivized

• Cut costs on the number of staff we need for data import.
• Cut costs for automation that can be done for data that no longer has to be manually imported.
• We've saved countless dollars by eliminating duplicates in our system with this tool.

Incentivized