Item: Matillion
Rating: 9
Author: Verified User

Use Cases and Deployment Scope

We use Matillion ETL (extract, transform, and load) with Bigquery to transform customer data to a standard format. There are 100+ sources and file formats are different. We use Matillion to transform these files and apply business logic to create and store it in a standard format which can be used by downstream and we deal with terra bytes of data on a daily basis.

Pros and Cons

The jobs logging UI is very unique and helps in easy debugging
It has a proper hierarchical structure. One can easily organise projects and related pipelines
Access control and sharing necessary access is easy and quick
I have seen good performance even with complex pipelines

More features should be available with Git integration such as passing environment variables, schedules from git
Need improvement in parallelism of job runs
Sometimes cancelling a job gets stuck which can be improved

Return on Investment

We have seen 50 GB of complex data being processed in an hour which is an improvement for us
Minimal time in creating pipelines in less than 4 hours
Can handle large files, we had a scenario of 1000 files in a run

Usability

We have created Matillion code builder which helped us in building pipelines even by the Business analyst just by passing a config file. It helps in less development time and early visualization on the transformed data

Time to Value

I have installed Matillion from the start. To deploy it in Google platform it took me 2 weeks of time as I was very new to the tool. Once the instance is available, to create project, GCP credentials and GIT setup, it may take a day. Finally creating a sample pipeline and to test it will be a matter of minutes

Scalability

Matillion works with cloud and it distributes the tasks among the instance nodes

Alternatives Considered

Pentaho and Microsoft SQL Server

Better UI, logging, minimal configurations, easy previews and faster

Key Insights

Do you think Matillion delivers good value for the price?

Yes

Are you happy with Matillion's feature set?

Yes

Did Matillion live up to sales and marketing promises?

Yes

Did implementation of Matillion go as expected?

Yes

Would you buy Matillion again?

Yes

Other Software Used

Redash, Datadog, Looker

Likelihood to Recommend

Matillion is well suited for building simple and complex pipelines. If you are a developer, it is a really great choice to look at sample data previews and detailed logs. It can understand the tasks with minimal configurations. One can easily import or export tasks and can code independently without affecting others work with 'manage version' option. Git configuration and Matillion APIs also available

Experience the ETL with Matillion

Overall Satisfaction with Matillion