Turned a Scrappy Startup into a Polished Engine
April 18, 2019
Turned a Scrappy Startup into a Polished Engine
Score 6 out of 10
Vetted Review
Verified User
Overall Satisfaction with Matillion
We are using Matillion as a way to automate our manual ETL processes for getting a wide variety of data loaded into Snowflake on AWS. It is a core piece of our Data Engineering and works for us as it generates SQL (no lock-in) and works great for a startup given the low-cost profile (pay-as-you-go).
Pros
- Transformation Jobs as a way to build up complicated SQL
- Variety of data source connectors - we didn't think we'd need them but turns out we did
- The ability to call out to bash or python as needed
Cons
- Security (Auth/Azn) - auditing is really good
- Difficult to structure job flow sometimes (unconditional vs failure-to-exit - which takes place first)
- Management of Job variables and environments
- Very quickly lets us move from manual scripts to a more automated event-driven architecture
- Ability to support multiple clients more easily
- Integration to data sources that would take us a long time on our own
Able to get it up and running very quickly. I did have to do a bit of reading to understand the big picture, but some of the online videos got me up and running instantly. We completely evaluated what it could and could not do in about 2-3 weeks.
Comments
Please log in to join the conversation