Astro by Astronomer vs. SQL Server Integration Services

Astronomer is well suited for workflow and dependency management for enterprise-level data lakes. It is not a product for data processing though. Different source systems can be integrated, it also provides powerful interfaces for alerting and monitoring. Easy to build DAGs, graphical UI, API support makes the product more user-friendly as well. Astronomer also does a great job on user training.

Incentivized

Ideal for daily standard ETL use cases whether the data is sourced from / transferred to the native connectors (like SQL Server) or FTP. Best if the company uses MS suite of tools. There are better options in the market for chaining tasks where you want a custom flow of executions depending on the outcome of each process or if you want advanced functionality like API connections, etc.

Incentivized

• Workflow management
• Wide availability of plugins
• Dependency management on upstream

Incentivized

• Ease of use - can be used with no prior experience in a relatively short amount of time.
• Flexibility - provides multiple means of accomplishing tasks to be able to support virtually any scenario.
• Performance - performs well with default configurations but allows the user to choose a multitude of options that can enhance performance.
• Resilient - supports the configuration of error handling to prevent and identify breakages.
• Complete suite of configurable tools.

Incentivized

• More language agnostic
• Flexible fork and join capabilities
• Near real time UI updates in case of deployment of enhanced DAGs

Incentivized

• SSIS has been a bit neglected by Microsoft and new features are slow in coming.
• When importing data from flat files and Excel workbooks, changes in the data structure will cause the extracts to fail. Workarounds do exist but are not easily implemented. If your source data structure does not change or rarely changes, this negative is relatively insignificant.
• While add-on third-party SSIS tools exist, there are only a small number of vendors actively supporting SSIS and license fees for production server use can be significant especially in highly-scaled environments.

Incentivized

Some features should be revised or improved, some tools (using it with Visual Studio) of the toolbox should be less schematic and somewhat more flexible. Using for example, the CSV data import is still very old-fashioned and if the data format changes it requires a bit of manual labor to accept the new data structure

Incentivized

SQL Server Integration Services is a relatively nice tool but is simply not the ETL for a global, large-scale organization. With developing requirements such as NoSQL data, cloud-based tools, and extraordinarily large databases, SSIS is no longer our tool of choice.

Incentivized

Raw performance is great. At times, depending on the machine you are using for development, the IDE can have issues. Deploying projects is very easy and the tool set they give you to monitor jobs out of the box is decent. If you do very much with it you will have to write into your projects performance tracking though.

Incentivized

The support, when necessary, is excellent. But beyond that, it is very rarely necessary because the user community is so large, vibrant and knowledgable, a simple Google query or forum question can answer almost everything you want to know. You can also get prewritten script tasks with a variety of functionality that saves a lot of time.

Incentivized

The implementation may be different in each case, it is important to properly analyze all the existing infrastructure to understand the kind of work needed, the type of software used and the compatibility between these, the features that you want to exploit, to understand what is possible and which ones require integration with third-party tools

Incentivized

Astronomer is a fast, secure, scalable workload management solution. It provides world-class user training along with easy to interact support.

Incentivized

I had nothing to do with the choice or install. I assume it was made because it's easy to integrate with our SQL Server environment and free. I'm not sure of any other enterprise level solution that would solve this problem, but I would likely have approached it with traditional scripting. Comparably free, but my own familiarity with trad scripts would be my final deciding factor. Perhaps with some further training on SSIS I would have a different answer.

Incentivized

• It helps to build scalable, available and low maintenance workloads
• Integrated Alerts and notifications helps to detect load issues in the early stages
• Ensures meeting data SLAs

Incentivized

• Data integrity across various products allows unify certain processes inside the organization and save funds by reducing human labour factor.
• Automated data unification allows us plan our inputs better and reduce over-warehousing by overbuying
• The employee number, responsible for data management was reduced from 4 to 1 person

Incentivized