Apache Pig vs. Oracle Exadata vs. Tanzu Data Services (Greenplum, GemFire, RabbitMQ, Tanzu SQL)

Apache Pig is best suited for ETL-based data processes. It is good in performance in handling and analyzing a large amount of data. it gives faster results than any other similar tool. It is easy to implement and any user with some initial training or some prior SQL knowledge can work on it. Apache Pig is proud to have a large community base globally.

Incentivized

Oracle Exadata is well-suited for environments where massive performance for Oracle databases is required. Storage indexes reduce the unnecessary I/O. Smart Flash
Cache accelerates random reads/writes.

Our OLTP application demands very high concurrency. Multi-node Exadata provides high availability and zero downtime during DB patching. It comes with lots of built-in automations, so it reduces many routine tasks for sysadmins, like network, storage, and VM configuration, and it also reduces many Oracle DBA tasks, like Oracle software installation, patching, and upgrades.

Incentivized

If you need to execute ml algorithms, learning techniques, or mathematical calculations on large amounts of heterogeneous data, VMware Tanzu Data Services will be ideal. It will be really simple to set up, particularly if you choose AWS as your integrated cloud provider. However, if you're working with lower data amounts, such as gigabytes, it can be superfluous.

Incentivized

• Its performance, ease of use, and simplicity in learning and deployment.
• Using this tool, we can quickly analyze large amounts of data.
• It's adequate for map-reducing large datasets and fully abstracted MapReduce.

Incentivized

• Oracle Database : Deliver industry-leading security, high availability and scalability with Oracle Database, which has been significantly enhanced to take advantage of the Oracle Exadata Storage Servers.
• Exadata Smart Scan : Improve query performance by offloading intensive query processing and data mining scoring to scalable intelligent storage servers.
• Smart Flash Cache : Transparently cache 'hot' read and write data to fast solid-state storage, improving query response times and throughput. Exadata systems use the latest PCI flash technology rather than flash disks. PCI flash delivers ultra-high performance by placing flash directly on the high speed PCI bus rather than behind slow disk controllers.
• Hybrid Columnar Compression : Reduce the size of data warehousing tables by 10x, and archive tables by 50x, to improve performance and lower storage costs for primary, standby, and backup databases. Query high, query low, archive high and archive low.
• Infiniband Network : Connect multiple Oracle Exadata Database Machines using the InfiniBand fabric to form a larger single system image configuration. Each InfiniBand link provides 40 Gigabits of bandwidth–many times higher than traditional storage or server networks.
• Petabyte Scalability : Easily scale data warehouse to support enterprise data growth.

Incentivized

• Apache MADlib provides popular machine learning functionality.
• Allows you to query terabytes of data databases.
• Interoperability for AWS S3 is effortless.

Incentivized

• UDFS Python errors are not interpretable. Developer struggles for a very very long time if he/she gets these errors.
• Being in early stage, it still has a small community for help in related matters.
• It needs a lot of improvements yet. Only recently they added datetime module for time series, which is a very basic requirement.

Incentivized

• The process of patching and upgrade of Exadata server components could be improved with a goal to minimize the overall effort, make it fully automated and transparent.
• Improved guidelines and possibly more sophisticated tools for sizing of new Exadata servers for migration from old legacy hardware.

Incentivized

• Running on Azure is a little more difficult.
• Synchronization with Kafka may be a little easier.

Incentivized

It is quick, fast and easy to implement Apache Pig which makes is quite popular to be used.

Incentivized

I am comparing Exadata with the Oracle RAC database experience. In addition to Oracle RAC features, Exadata provides automatic performance optimization through Smart Scan and storage indexes. Deep integration with the Oracle ecosystem and tight coupling with Oracle Enterprise Manager
for monitoring and management. Some downsides of Exadata are: a steep learning curve, concepts like cell offloading, IORM, and flash cache behavior aren’t intuitive initially. Operating
Exadata requires specialized DBA skills.

Incentivized

The documentation is adequate. I'm not sure how large of an external community there is for support.

Incentivized

They were very helpful. We needed support for initial implementation.

Incentivized

Apache Pig might help to start things faster at first and it was one of the best tool years back but it lacks important features that are needed in the data engineering world right now. Pig also has a steeper learning curve since it uses a proprietary language compared to Spark which can be coded with Python, Java.

Incentivized

Oracle Exadata Database Machine had the best performance overall hands down. It clearly beat the competition and we were seeing 1000X improvement on SAP HANA. Oracle Exadata Database Machine beat that without us refactoring our code. To achieve that in HANA, we had to refactor the code somewhat. Now this was for our limited POC of 5 use cases. Given the large number of stored procedures we had in Sybase, we need to capture more production metrics but we are seeing incredible performance.

Incentivized

• Higher learning curve than other similar technologies so on-boarding new engineers or change ownership of Apache Pig code tends to be a bit of a headache
• Once the language is learned and understood it can be relatively straightforward to write simple Pig scripts so development can go relatively quickly with a skilled team
• As distributed technologies grow and improve, overall Apache Pig feels left in the dust and is more legacy code to support than something to actively develop with.

Incentivized

• Single support from a single vendor with both machine and database from Oracle, which is costing us less.
• With Exadata, we need less technical manpower and less technical support. A business transaction with the integrated and centralized database helps us focus on other business needs.
• We don't need to buy additional licenses and Hardware for the next 3 to 5 years.

Incentivized

• There was a noticeable reduction in system reliability.
• Saw a reduction in unsuccessful analytics operations.

Incentivized