AWS Glue vs. Informatica Intelligent Data Management Cloud

When the data which requires ETL has different formats, schema, and volume, this service suits them best. So, when the volume is not consistent (typical use-case of healthcare and online shopping), AWS Glue can be the prime choice. When the data is available in both batch and streaming mode, the developer needs to generate a separate codebase. This increases the source code management efforts. So, prefer to go with Glue when the nature of the data is the same (either batched or streamed).

Incentivized

Informatica Cloud is an excellent tool for freeing up trapped data in your internal systems and exporting it into a cloud data warehouse or SQL container. Especially if you have any internal SQL query generators that allow you to copy and paste into the Source setup. For example, we use Business Objects internally, and you can build out the query you need inside the firewall with that, then paste it into the query within Informatica Cloud while establishing the Source connection. This way you are not writing all your source parameters by hand, cutting new jobs setup time by 50%. Where Cloud will not suit you well is if you need significant visibility to the health of the system from a tracking, monitoring or error handling standpoint. Cloud will tell you it failed, maybe give you an example error, but has no further troubleshooting or diagnostic assistance to offer.

Incentivized

• After data cleansing, the team also implemented the best practices for using AWS platform services as a Data Lake, such as job bookmarking for AWS Glue jobs, proper delimiter for the AWS Glue crawlers, partitioning in AWS S3, and transformation to parquet file for compression and faster querying time in Amazon Athena.
• Data modernization through combining data from multiple sources into a functioning datasets, rebuilding DW, and resctructuring data sources.
• Aims to lessen customer complaints, eliminate manual data extraction requests via SR from different data sources, and Increase accuracy, consistency and speed up reconciliation process.

Incentivized

• Informatica Cloud is a great tool for automating data imports. Raw data files can be scheduled to run at designated times, and using pre-built mappings ensures that the data goes into the system accurately each time.
• It is also a great tool for converting raw data into specific formatting. For example, configuring the mapping so that the first letter of a first, middle or last name is always capitalized.
• Additionally, Informatica Cloud has a built-in field-matching tool so that records that already exist are updated rather than having duplicates created.

Incentivized

• It’s integration with other cloud vendors is bit difficult
• If it can support non SQL based databases as well, it would be powerful.
• Real time data synchronisation in data source is missing

Incentivized

• The User Interface can be a bit difficult to get in initial stages.
• Error messages are hard to understand which sometimes takes a lot of time for the resolution
• Cannot Implement complex SQL queries which should be fixed in future release.

Incentivized

I personally found it very usable for a data engineer's day job, particularly for performing ETL and managing the data pipelines.

Incentivized

Amazon responds in good time once the ticket has been generated but needs to generate tickets frequent because very few sample codes are available, and it's not cover all the scenarios.

Incentivized

I've never had trouble getting into contact with Informatica's support for technical help. I give it a nine because it does pretty well for mid to enterprise-scale workflows.

Incentivized

The cataloging of data objects is the best in the case of AWS Glue. We use AWS Glue in all of our data pipelines to sync external and internal data sources and to automatically produce SQL-based ETL based on AWS Glue catalog objects. Integration with Amazon products is the other advantage.

Incentivized

Having used SQL Server Integration Services (SSIS) in the past, Informatica Cloud was a huge-step up in functionality, usability and performance. Hands-down, Informatica Cloud is a much more robust product overall. While SSIS is well-suited for specific instances (i.e. SQL Server-specific implementations), Informatica Cloud is a much better product as an overall integration/transformation tool.

Incentivized

• Positive Impact :- after ETL we can able to do some kind of automation
• Negative :- At some point of time it can hamper the cost but not really

Incentivized

• A positive impact is bringing more projects.
• Getting data out of various systems such as Salesforce.com or FTP and consolidating it into tables in one central database.
• Having the ability to run data transformation tasks (the equivalent of batch jobs in SF or stored procedures in SQL) on a schedule without consuming those resources on the target or source systems.

Incentivized