AWS Glue vs. Matillion

One of AWS Glue's most notable features that aid in the creation and transformation of data is its data catalog. Support, scheduling, and the automation of the data schema recognition make it superior to its competitors aside from that. It also integrates perfectly with other AWS tools. The main restriction may be integrated with systems outside of the AWS environment. It functions flawlessly with the current AWS services but not with other goods. Another potential restriction that comes to mind is that glue operates on a spark, which means the engineer needs to be conversant in the language.

Incentivized

Matillion is great any time ETL or ELT is needed. I've now used Matillion in 2 different companies and would have no problem recommending others to use it as well. The ease of setting up schedules to just take care of data imports and manipulation is incredible. IT has also been an incredible tool at bringing disparate databases together on a schedule so that I never have to think about it.

Incentivized

• It is extremely fast, easy, and self-intuitive. Though it is a suite of services, it requires pretty less time to get control over it.
• As it is a managed service, one need not take care of a lot of underlying details. The identification of data schema, code generation, customization, and orchestration of the different job components allows the developers to focus on the core business problem without worrying about infrastructure issues.
• It is a pay-as-you-go service. So, there is no need to provide any capacity in advance. So, it makes scheduling much easier.

Incentivized

• Excellent tool to do ELT data pipeline using Snowflake
• Easy graphical orchestration to enable complex dependencies
• Easy manage users and group permissions
• Easy to schedule jobs using time dependency and job dependency
• Provides many API's to fetch data from multiple vendors

Incentivized

• In-Stream schema registries feature people can not use this more efficiently
• in Connections feature they can add more connectors as well
• The crucial problem with AWS Glue is that it only works with AWS.

Incentivized

• I think a non-CLI approach to installing and uninstalling python libraries would be nice. I mean, it isn't difficult to install a python library via Linux or CLI, but I imagine most companies don't feel comfortable allowing Matillion users to go on a virtual server and installing it themselves. Requirement.txt file for installing libraries would be simple, and maybe that could also be used to uninstall libraries as well......or maybe the library gets automatically downloaded if it is imported into a python script but the library doesn't exist.
• Python Component is lacking very much in terms of UI. It would be unrealistic for me to suggest Matillion build its own EDI, but it would be nice if a python component could connect to a local IDE. Right now, if you want to write any decent length python code, you are going to be stuck copying and pasting your code from your local IDE.
• It is also very difficult to debug in Matillion because you can't set breakpoints. Local IDE integration can resolve that.
• I would like to have more templates to copy from for certain simplistic scenarios. For instance, a template for a job that fails which sends an AWS SNS with the Job name, component it failed on, and the error message. It wasn't as simple as I thought it would be to figure out and having to use a shared job for such circumstances can be painful because you have to export a bunch of variables.
• There should be a drop down list for Global Matillion variables as it is difficult to remember at times.

Incentivized

With the current experience of Matillion, we are likely to renew with the current feature option but will also look for improvement in various areas including scalability and dependability. 1. Connectors: It offers various connectors option but isn't full proof which we will be looking forward as we grow. 2. Scalability: As usage increase, we want Matillion system to be more stable.

Incentivized

Easy to follow steps in building a data pipeline. We have brought in people with minimal SQL experience and they have been able to quickly and successfully being able to pick up the skill set and contributing in reducing the time to market with various data assets. Matillion does provide a long array of components to select from to perform data transformation. But like any other tool, there are more than one way of doing the same thing. Some are more performant than the others, but easy to follow and easy to tweak to improve.

Incentivized

Amazon responds in good time once the ticket has been generated but needs to generate tickets frequent because very few sample codes are available, and it's not cover all the scenarios.

Incentivized

Overall, I've found Matillion to be responsive and considerate. I feel like they value us as a customer even when I know they have customers who spend more on the product than we do. That speaks to a motive higher than money. They want to make a good product and a good experience for their customers. If I have any complaint, it's that support sometimes feels community-oriented. It isn't always immediately clear to me that my support requests are going to a support engineer and not to the community at large. Usually, though, after a bit of conversation, it's clear that Matillion is watching and responding. And responses are generally quick in coming.

Incentivized

We were able to control on access and built various enviroment for implementation

Incentivized

AWS Glue is a fully managed ETL service that automates many ETL tasks, making it easier to set AWS Glue simplifies ETL through a visual interface and automated code generation.

Overall, Matillion is an excellent choice for businesses that need a powerful and easy-to-use data integration and transformation platform that can handle large volumes of data. While it may be a bit pricey for some organizations, the platform's reliability, scalability, and customer support make it a worthwhile investment for many businesses.

Incentivized

Matillion has a nice scalability capacity, and once it has been stored in our AWS cloud it makes it much easier to scale it on demand. The reason I'm not rating it as 10 is that there is no way to migrate or move it to another cloud in an easy way.

Incentivized

• It had a positive impact on the way we build our data lake.
• It is the single source of truth for data structure (schemas/tables/views).

Incentivized

• Saving us time reduces our need for headcount
• Allows us to collaborate on data-eng pipelines in a transparent way with non-technical stakeholders, ensuring accuracy and continuity
• Allows us a single platform to log and manage all of our pipelines to pin-point where something failed and why
• Always has a solution to very common data engineering tasks, i.e., real-time data, connectors, pre-built workflows, etc.