Apache Pig vs. VMware Tanzu Data Services (Greenplum, GemFire, RabbitMQ, Tanzu SQL)

Apache Pig is best suited for ETL-based data processes. It is good in performance in handling and analyzing a large amount of data. it gives faster results than any other similar tool. It is easy to implement and any user with some initial training or some prior SQL knowledge can work on it. Apache Pig is proud to have a large community base globally.

Incentivized

If you need to execute ml algorithms, learning techniques, or mathematical calculations on large amounts of heterogeneous data, VMware Tanzu Data Services will be ideal. It will be really simple to set up, particularly if you choose AWS as your integrated cloud provider. However, if you're working with lower data amounts, such as gigabytes, it can be superfluous.

Incentivized

• Its performance, ease of use, and simplicity in learning and deployment.
• Using this tool, we can quickly analyze large amounts of data.
• It's adequate for map-reducing large datasets and fully abstracted MapReduce.

Incentivized

• Apache MADlib provides popular machine learning functionality.
• Allows you to query terabytes of data databases.
• Interoperability for AWS S3 is effortless.

Incentivized

• UDFS Python errors are not interpretable. Developer struggles for a very very long time if he/she gets these errors.
• Being in early stage, it still has a small community for help in related matters.
• It needs a lot of improvements yet. Only recently they added datetime module for time series, which is a very basic requirement.

Incentivized

• Running on Azure is a little more difficult.
• Synchronization with Kafka may be a little easier.

Incentivized

It is quick, fast and easy to implement Apache Pig which makes is quite popular to be used.

Incentivized

The documentation is adequate. I'm not sure how large of an external community there is for support.

Incentivized

They were very helpful. We needed support for initial implementation.

Incentivized

Apache Pig might help to start things faster at first and it was one of the best tool years back but it lacks important features that are needed in the data engineering world right now. Pig also has a steeper learning curve since it uses a proprietary language compared to Spark which can be coded with Python, Java.

Incentivized

• Higher learning curve than other similar technologies so on-boarding new engineers or change ownership of Apache Pig code tends to be a bit of a headache
• Once the language is learned and understood it can be relatively straightforward to write simple Pig scripts so development can go relatively quickly with a skilled team
• As distributed technologies grow and improve, overall Apache Pig feels left in the dust and is more legacy code to support than something to actively develop with.

Incentivized

• There was a noticeable reduction in system reliability.
• Saw a reduction in unsuccessful analytics operations.

Incentivized