Excellent ELT product that helps deliver rapid value and clear, easy to maintain transformations
May 15, 2019
Excellent ELT product that helps deliver rapid value and clear, easy to maintain transformations
Score 6 out of 10
Vetted Review
Verified User
Overall Satisfaction with Matillion
Used to re-platform on-prem SQL servers to Snowflake. Also used to create data warehouse transformations, marts, and reporting tables. We also used it to remap several Excel-based calculations into an automated pipeline with backup and recovery on S3 and Snowflake. As consultants, we recommended the product, provided initial implementation and ran training workshops tailored to the client's tasks and workflows.
- Excellent visual layout of transformation jobs.
- Easy debugging while building SQL transformation by allowing you to sample the data at any point along with the job.
- Good connection to many different sources.
- Good auditing of jobs, steps, and operations.
- Poor SQL query generation for performance. It only does subquery composition, so becomes very inefficient on large tables.
- Limit scheduling and triggering capabilities without creating separate apps to call via API.
- Lack of on-prem file support, such as moving a file once processed, checking last modified date, etc.
- More visibility of data flows and where business rules are applied.
- Rapid development and improvements for quick returns.
- Somewhat fragile ingestion pipeline (single EC2 failure or corruption if updating) means some monitoring and the manual backup is required.
We were able to successfully deploy everything into production in less than 4 weeks. This includes setting up the Matillion (and Snowflake) environments, connecting to on-prem databases, pulling stage data, building the data warehouse transformations in Matillion, and exporting the results into reporting tables. We also had enough time to implement integration straight back to Excel, S3 and full production monitoring with SNS.
Generally, Matillion is much easier to get up and running, quicker to deliver value and returns on your ELT process, and simpler to maintain. The speed to get data connections and start pulling data is so quick that you can focus on the transformations and business rules required. However, once in a larger pipeline, with many different triggering requirements or similar, it lacks some of the flexibility and scalability.