A cool and cost-effective ETL/ELT cloud platform for data integration
August 26, 2020
A cool and cost-effective ETL/ELT cloud platform for data integration
Score 9 out of 10
Vetted Review
Verified User
Overall Satisfaction with Matillion
Matillion is used as the primary ETL/ELT for data integrations in AWS cloud. We needed a tool that has diverse integration capabilities, rich features, is simple to use and manage, costs less, is easy to learn, and requires minimal maintenance. With a small IT team, we cannot afford to compromise in any of the aspects, as the company’s entire dataload depends on it.
- Matillion connection to AWS S3 and Snowflake are the vital parts for our architecture and Matillion is extremely simple to configure and robust in handling the connections. The interface is very intuitive to configure.
- Python and Jython interface provides an extremely useful capability to implement our design outside of available components.
- The scheduler is a nice feature and very helpful to schedule workloads. It has all the major capabilities of good scheduler software, except for event triggers.
- Has the interface to do query connections to Salesforce and similar software, but does not have a solid OAUTH interface, or it may be solid, but misses help documentation.
- Help and support are really awesome. But materials do not cover a few petty things that can support beginners to get it going.
- Examples in documentation and workflows could be better.
- A component to write direct SQL processing code in orchestration jobs will be a great way to do a few trivial steps.
- Shared jobs are a great way to create a framework for processing. But once embedded, if a rollback change is done on a shared job, say remove a job variable, it breaks the orchestration jobs using it. There should be an easy way to update the job, similar to when shared jobs are enhanced and orchestration jobs inherit seamlessly.
- Reduced development time and uptime costs
- Simple and seamless integration to AWS and Snowflake has reduced cost overhead.
- Capability to schedule jobs has avoided the need to buy a scheduling software.
We were able to develop the components in Matillion in a span of two months. We had a newly formed team of 3 people with almost no experience with Matillion. Once we are out of initial challenges in understanding the interface, it was almost nonstop for us with no interruptions and we were able to share jobs and schedule to build a lot of required features.
Matillion is very initutive and easy to learn, when compared to other tools. GUI is simple, not crowded, support is awesome