Apache Pig vs. IBM Analytics Engine vs. Tencent Cloud Elastic MapReduce

Apache Pig is best suited for ETL-based data processes. It is good in performance in handling and analyzing a large amount of data. it gives faster results than any other similar tool. It is easy to implement and any user with some initial training or some prior SQL knowledge can work on it. Apache Pig is proud to have a large community base globally.

Incentivized

• Well suited for my big data related project or a static data set analysis especially for uploading huge dataset to the cluster.
• But had some issues with connecting IoT real-time data and feeding to Power BI. It might be my understanding please take it as a mere comment rather than a suggestion.

Incentivized

• Its performance, ease of use, and simplicity in learning and deployment.
• Using this tool, we can quickly analyze large amounts of data.
• It's adequate for map-reducing large datasets and fully abstracted MapReduce.

Incentivized

• Jobs with Spark, Hadoop, or Hive queries are rapidly attained
• Can collect, organize and analyze your data accurately
• You can customize, for example, Spark or Hadoop configuration settings, or Python, R, Scala, or Java libraries.

Incentivized

• UDFS Python errors are not interpretable. Developer struggles for a very very long time if he/she gets these errors.
• Being in early stage, it still has a small community for help in related matters.
• It needs a lot of improvements yet. Only recently they added datetime module for time series, which is a very basic requirement.

Incentivized

• Easier pricing and plug-and-play like you see with AWS and Azure, it would be nice from a budgeting and billing standpoint, as well as better support for the administration.
• Bundling of the Cloud Object Storage should be included with the Analytics Engine.
• The inability to add your own Hadoop stack components has made some transfers a little more complex.

Incentivized

It is quick, fast and easy to implement Apache Pig which makes is quite popular to be used.

Incentivized

The documentation is adequate. I'm not sure how large of an external community there is for support.

Incentivized

Apache Pig might help to start things faster at first and it was one of the best tool years back but it lacks important features that are needed in the data engineering world right now. Pig also has a steeper learning curve since it uses a proprietary language compared to Spark which can be coded with Python, Java.

Incentivized

We initially wanted to go with Google BigQuery, mainly for the name recognition. However, the pricing and support structure led us to seek alternatives, which pointed us to IBM. Apache Spark was also in the running, but here IBM's domination in the industry made the choice a no-brainer. As previously stated, the support received was not quite what we expected, but was adequate.

Incentivized

• Higher learning curve than other similar technologies so on-boarding new engineers or change ownership of Apache Pig code tends to be a bit of a headache
• Once the language is learned and understood it can be relatively straightforward to write simple Pig scripts so development can go relatively quickly with a skilled team
• As distributed technologies grow and improve, overall Apache Pig feels left in the dust and is more legacy code to support than something to actively develop with.

Incentivized

• This product has allowed us to gather analytics data across multiple platforms so we can view and analyze the data from different workflows, all in one place.
• IBM Analytics has allowed us to scale on demand which allows us to capture more and more data, thus increasing our ROI.
• The convenience of the ability to access and administer the product via multiple interfaces has allowed our administrators to ensure that the application is making a positive ROI for our business users and partners.

Incentivized