Simple and Powerful
October 05, 2020
Simple and Powerful
Score 7 out of 10
Overall Satisfaction with Matillion
Matillion is being used only by data engineering team, which is part of Data Science department. It's our ETL tool to populate our data warehouse on Snowflake. Orchestration jobs are running on a daily basis and are basis of BI reports, which are used across the whole organization. Except that, it's used to generate new feature sets for data scientist for modelling.
- Super easy to use. Anyone can start using it with very little previous experience.
- Lots of connections available to fetch data from most popular sources available.
- Great UI.
- Not very much scalable. Sometimes there are server shutdowns when it goes out of memory.
- Speed of processing can be improved, but not bad.
- SQL compilation errors are very vague and there is no way to understand what the actual error is. It steals extra time to debug.
- Modifying code and deploying to production is very simple and takes very little time.
- Easy UI and simple flow creation enabled us to create pipelines in a very short time, rather than spending lot of man-power to get to the same level with other tools.
- In the long run, requirements and complexity grow a lot, it might not be the best solution. Perfect for small-medium sized companies.
User experience is very intuitive and takes no time to get hands on it. There are lots of documentation which go pretty much into deep details.
Within 2-3 weeks from starting Matillion, we had our first simple pipeline in production: extracting data from our operational database and putting it into data warehouse.
For the first year, scalability for pretty good. We didn't have any issues with number of transformations or overall speed of jobs. However, after we got more experienced with it and started to create more complicated jobs, scalability suffered a lot. Our jobs exhausted memory many times and we couldn't find any way to solve it. Only way was to get to the highest subscription level, which required more money investment and we didn't go with it.