Azure Synapse Analytics (Azure SQL Data Warehouse) vs. Talend Enterprise Service Bus

It's well suited for large, fastly growing, and frequently changing data warehouses (e.g., in startups). It's also suited for companies that want a single, relatively easy-to-use, centralized cloud service for all their data needs. Larger, more structured organizations could still benefit from this service by using Synapse Dedicated SQL Pools, knowing that costs will be much higher than other solutions. I think this product is not suited for smaller, simpler workloads (where an Azure SQL Database and a Data Factory could be enough) or very large scenarios, where it may be better to build custom infrastructure.

Recommended for:

1. Multiple systems to interface for a task in the company (example: to sell an item your POS must communicate with the inventory software, then to accounting, then to service, etc).
2. When a task must bring information from several external services.
3. When you have to deal with multiple APIs.

Not recommended for:

1. Data transformation (although Talend has a software for that that works with Talend ESB)

• Create data pipelines to connect with multiple data workspace(s) and external data
• Ability to connect with Azure Data Lake (sequentially) for data warehousing
• Being able to manage connections and create integration runtimes (for onPrem data capture)

• Up to 900 connectors included in the license with no extra cost
• Graphical UI to develop the Web Services
• You can begin with the community version to evaluate or start implementing a very uncomplicated ESB
• The Talend ESB Admin Control is very powerful with dashboards and reports to keep your IF working smoothly

• It takes some time to setup a proper SQL Datawarehouse architecture. Without proper SSIS/automation scripts, this can be a very daunting task.
• It takes a lot of foresight when designing a Data Warehouse. If not properly designed, it can be very troublesome to use and/or modify later on.
• It takes a lot of effort to maintain. Businesses are continually changing. With that, a full time staff member or more will be required to maintain the SQL Data Warehouse.

• You have to log in to each module separately
• 900 connectors is a lot, but if you have a custom app to interface, you have to develop your connector

The data warehouse portion is very much like old style on-prem SQL server, so most SQL skills one has mastered carry over easily. Azure Data Factory has an easy drag and drop system which allows quick building of pipelines with minimal coding. The Spark portion is the only really complex portion, but if there's an in-house python expert, then the Spark portion is also quiet useable.

Microsoft does its best to support Synapse. More and more articles are being added to the documentation, providing more useful information on best utilizing its features. The examples provided work well for basic knowledge, but more complex examples should be added to further assist in discovering the vast abilities that the system has.

When client is already having or using Azure then it’s wise to go with Synapse rather than using Snowflake. We got a lot of help from Microsoft consultants and Microsoft partners while implementing our EDW via Synapse and support is easily available via Microsoft resources and blogs. I don’t see that with Snowflake

• First, it is a lot of cheaper than the closest competitor.
• Second, Talend ESB is in the same league as other stronger brands.
• Third, the functions and modules are a 360 solution to implement an ESB.

Talend has a different approach to license since it is based on programmers and run times, not to users of cores.

Basically, the billing is predictable, and this all about it.

• We have had an improvement in our overall processing time
• Cost was much lower than most of its competitors
• Our reporting needs have grown and housing the data here has been great

• Considerably cheaper than oracle service bus
• As I said before, you can run a POC using the community version of Talend Studio.
• Built from Open Source/ well-proven technologies, and a big community to support those technologies.