Apache Kafka vs Talend Data Integration

Likelihood to Recommend

Despite the disadvantages I list, I really believe that Kafka is the right choice whenever you need a queueing or message broker system. Kafka is way too battle-tested and scales too well to ever not consider it. The only exception is if your use case requires many, many small topics. Also, Kafka doesn't support delay queues out of the box and so you will need to "hack" it through special code on the consumer side.

Read full review

Verified User

Engineer in Engineering

Internet Company, 201-500 employees

View all 6 answers on this topic

Talend Data Integration is easy to use and learn. Talend Data Integration can perform bulk data migrations of up to a few million records without any issues. We have not tried it or had use case which required more than a few million records at a time. It works particularly well with databases and CRM software.

Read full review

Verified User

Employee in Corporate

Chemicals Company, 10,001+ employees

View all 7 answers on this topic

Feature Rating Comparison

Apache Kafka

Talend Data Integration

Connect to traditional data sources

Connecto to Big Data and NoSQL

Apache Kafka

Talend Data Integration

Simple transformations

Complex transformations

Apache Kafka

Talend Data Integration

Data model creation

Metadata management

Business rules and workflow

Collaboration

Testing and debugging

Apache Kafka

Talend Data Integration

Integration with data quality tools

Integration with MDM tools

Pros

Apache Kafka is able to handle a large number of I/Os (writes) using 3-4 cheap servers.
It scales very well over large workloads and can handle extreme-scale deployments (eg. Linkedin with 300 billion user events each day).
The same Kafka setup can be used as a messaging bus, storage system or a log aggregator making it easy to maintain as one system feeding multiple applications.

Read full review

Verified User

Analyst in Information Technology

Airlines/Aviation Company, 51-200 employees

View all 6 answers on this topic

JSON parsing, if you are into highly nested JSON object parsing Talend has the ability to display the structure of JSON and allows you to define the extraction logic in the metadata. Same with XML source.
Customization, For mostly all ETL work you will have a component in Talend. And in case you have a very specific requirement you can end up easily designing a custom component that you can code and reuse and share with others.
Talend has a connectivity option to almost all the databases (relational or NOSQ)L and sources available. It also has generic JDBC/ ODBC drivers in case you need it.
I like the ease of deployment across environment (DEV and PROD) with the use of context variables.

Read full review

Verified User

Consultant in Information Technology

Computer Software Company, 11-50 employees

View all 7 answers on this topic

Cons

Still a bit inmature, some clients have required recoding in the last few versions
New feaures coming very fast, several upgrades a year may be required
Not many commercial companies provide support

Read full review

Juan Francisco Tavira

Global Technology Centre - Middleware

ProdubanFinancial Services, 10,001+ employees

View all 6 answers on this topic

Syncing with Git should be made easier
Can face issues with certain big data spaces
Support find it difficult to resolve complex issues

Read full review

Verified User

Engineer in Information Technology

Health, Wellness and Fitness Company, 5001-10,000 employees

View all 7 answers on this topic

Likelihood to Renew

Apache Kafka 9.0

Based on 1 answer

Kafka is quickly becoming core product of the organization, indeed it is replacing older messaging systems. No better alternatives found yet

Read full review

Juan Francisco Tavira

Global Technology Centre - Middleware

ProdubanFinancial Services, 10,001+ employees

View all 1 answers on this topic

No score

No answers yet

No answers on this topic

Usability

No score

No answers yet

No answers on this topic

Talend Data Integration 9.0

Based on 1 answer

We use Talend Data Integration day in and day out. It is the best and easiest tool to jump on to and use. We can build a basic integration super-fast. We could build basic integrations as fast as within the hour. It is also easy to build transformations and use Java to perform some operations.

Read full review

Verified User

Employee in Corporate

Chemicals Company, 10,001+ employees

View all 1 answers on this topic

Support Rating

Apache Kafka 9.0

Based on 4 answers

We are using the Apache open source version of Kafka. The community is a good place to ask questions. and we can get most of our problems resolved there.

Read full review

Verified User

Strategist in Information Technology

Package/Freight Delivery Company, 10,001+ employees

View all 4 answers on this topic

Talend Data Integration 6.0

Based on 3 answers

Good support, specially when it relates to PROD environment. The support team has access to the product development team. Things are internally escalated to development team if there is a bug encountered. This helps the customer to get quick fix or patch designed for problem exceptions. I have also seen support showing their willingness to help develop custom connector for a newly available cloud based big data solution

Read full review

Verified User

Consultant in Information Technology

Computer Software Company, 11-50 employees

View all 3 answers on this topic

Alternatives Considered

I would only use RabbitMQ over Kafka when you need to have delay queues or tons of small topics/queues around.I don't know too much about Pulsar - currently evaluating it - but it's supposed to have the same or better throughput while allowing for tons of queues. Stay tuned - I might update this review after we finish evaluating Pulsar. It's much less battle-tested though.

Read full review

Verified User

Engineer in Engineering

Internet Company, 201-500 employees

View all 6 answers on this topic

Talend is much versatile in assimilating various different business use cases. It covers more functionality and is packed with tons of features to explore. It has the ability to fine tune to each project, and not be a one-fits all solution. Problems with Excel, is that it is not suited for large projects, collaboration work. Alteryx is a very costly alternative.

Read full review

Sanket Bharaswadkar

Process Analyst

HoneywellWarehousing, 10,001+ employees

View all 7 answers on this topic

Return on Investment

Positive impact on ROI since now we can use one large deployment of Apache Kafka that can be used for multiple scenarios ( storage systems, log aggregate, messaging queue ).
It is open-source so there are no licenses or subscription fees reducing the cost of deployment.
Data can now be ingested and analyzed in real-time making it easy to fine-tune the customer experience and decision making for internal IT.

Read full review

Verified User

Analyst in Information Technology

Airlines/Aviation Company, 51-200 employees

View all 6 answers on this topic

Easy to build complex data transformations.
Licensing model isn't that flexible.
Memory mangement for huge volumes of information. You have to modify ETL designs to handle it properly.

Read full review

Josep Coves Barreiro

Freelance computer engineer

Relational ConsultingComputer Software, 201-500 employees

View all 7 answers on this topic

Pricing Details

General

Free Trial

—

Free/Freemium Version

—

Premium Consulting/Integration Services

—

Entry-level set up fee?

No

General

Free Trial

—

Free/Freemium Version

—

Premium Consulting/Integration Services

—

Entry-level set up fee?

No

Rating Summary

Apache Kafka

Talend Data Integration

Apache Kafka

Talend Data Integration

Apache Kafka

Talend Data Integration

Apache Kafka

Talend Data Integration

Likelihood to Recommend

Apache Kafka

Talend Data Integration

Feature Rating Comparison

Connect to traditional data sources

Connecto to Big Data and NoSQL

Simple transformations

Complex transformations

Data model creation

Metadata management

Business rules and workflow

Collaboration

Testing and debugging

Integration with data quality tools

Integration with MDM tools

Pros

Apache Kafka

Talend Data Integration

Cons

Apache Kafka

Talend Data Integration

Likelihood to Renew

Apache Kafka

Talend Data Integration

Usability

Apache Kafka

Talend Data Integration

Support Rating

Apache Kafka

Talend Data Integration

Alternatives Considered

Apache Kafka

Talend Data Integration

Return on Investment

Apache Kafka

Talend Data Integration

Pricing Details

General

Free Trial

Free/Freemium Version

Premium Consulting/Integration Services

Entry-level set up fee?

General

Free Trial

Free/Freemium Version

Premium Consulting/Integration Services

Entry-level set up fee?

Rating Summary

Add comparison