TrustRadius: an HG Insights company

Apache Hadoop vs. Apache Spark vs. SAP Business Warehouse

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Hadoop

    Score7.5 out of 10
    N/AHadoop is an open source software from Apache, supporting distributed processing and data storage. Hadoop is popular for its scalability, reliability, and functionality available across commoditized hardware.N/A

    Apache Spark

    Score8.8 out of 10
    N/AApache Spark is an open-source, distributed cluster-computing framework designed for large-scale data processing, batch transformations, real-time Streaming Analytics, and machine learning workloads. The platform executes distributed memory-centric computations across heterogeneous storage layers using unified APIs in Python, Scala, Java, SQL, and R.N/A

    SAP BW

    Score8.8 out of 10
    N/ASAP Business Warehouse, or SAP BW (formerly SAP NetWeaver Business Warehouse) is SAP's legacy data warehouse solution, now superseded by SAP BW/4HANA, and the SAP Data Warehouse Cloud which was launched in 2019. SAP BW versions up to 7.4 have reached end of maintenance. SAP BW 7.5 support is extended to align with SAP Business Suite with NetWeaver components. For existing customers maintenance is scheduled to continue through 2027, with extended support available through 2030.N/A
    Pricing
    HadoopApache SparkSAP BW
    Editions & Modules
    No answers on this topic
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    HadoopApache SparkSAP BW
    Free Trial
    NoNoNo
    Free/Freemium Version
    YesNoNo
    Premium Consulting/Integration Services
    NoNoNo
    Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
    Additional Details———
    More Pricing Information
    Community Pulse
    HadoopApache SparkSAP BW
    Considered Multiple Products
    Apache
    Chose Hadoop
    Apache Spark can be considered as an alternative because of its similar capabilities around processing and storing big data. The reason we went with Hadoop was the literature available online and integration capability with platforms like R Studio. The popularity of Hadoop has …
    Incentivized
    Chose Hadoop
    Apache Spark has an in memory processing model, making it powerful for lightning fast data processing. Apache Spark also exposes Scala and Python in APIs which is one of the most commonly used programming languages in data analytic and data processing domains.
    Incentivized
    Chose Hadoop
    Spark is a good alternative to Hadoop that can have faster querying and processing performance and can offer more flexibility in terms of applications that it can support.

    Google BigQuery has also been a great alternative and is especially great in terms of ease of use. The …
    Incentivized
    Chose Hadoop
    Hands down, Hadoop is less expensive than the other platforms we considered. Cloudera was easier to set up but the expense ruled it out. MS-SQL didn't have the performance we saw with the Hadoop clusters and was more expensive. We considered MS-SQL mainly for its ability …
    Incentivized
    Chose Hadoop
    • For real-time streaming, use Spark; can provide a stark contrast to the way MR works
    • Hadoop offers a scalable, cost-effective and highly available solution for big data storage and processing.
    • Amazon Redshift is somewhat closer to Hadoop. But to analyze Petabytes of data Hadoop …
    Incentivized
    Chose Hadoop
    • For real-time streaming, use Spark; can provide a stark contrast to the way MR works
    • Use Hive for querying purposes
    Incentivized
    Chose Hadoop
    Hadoop provides storage for large data sets and a powerful processing model to crunch and transform huge amounts of data. It does not assume the underlying hardware or infrastructure and enables the users to build data processing infrastructure from commodity hardware. All the …
    Incentivized
    Apache
    Chose Apache Spark
    Apache Spark is a fast-processing in-memory computing framework. It is 10 times faster than Apache Hadoop. Earlier we were using Apache Hadoop for processing data on the disk but now we are shifted to Apache Spark because of its in-memory computation capability. Also in SAP …
    Incentivized
    Chose Apache Spark
    • Apache Spark works in distributed mode using cluster
    • Informatica and Datastage cannot scale horizontally
    • We can write custom code in spark, whereas in Datastage and Informatica we can only choose the different features proivided already.
    Incentivized
    Chose Apache Spark
    Spark is simply awesome to work on with any data sets and also has an in-memory database which makes it very flexible.
    Incentivized
    Chose Apache Spark
    1. Apache Spark is almost 100 % faster than Hadoop.
    2. Apache Spark is more stable than Amazon EMR.
    3. The end to end distributed machine library is more robust in Apache Spark.
    Incentivized
    Chose Apache Spark
    Databricks uses Spark as a foundation, and is also a great platform. It does bring several add-ons, which we did not feel needed by the time we evaluated - and haven't needed since then. One interesting plus in our opinion was the engineering support, which is great depending …
    Incentivized
    Chose Apache Spark
    I prefer Apache Spark compared to Hadoop, since in my experience Spark has more usability and comes equipped with simple APIs for Scala, Python, Java and Spark SQL, as well as provides feedback in REPL format on the commands. At the same time, Apache Spark seems to have the …
    Incentivized
    Chose Apache Spark
    All the above systems work quite well on big data transformations whereas Spark really shines with its bigger API support and its ability to read from and write to multiple data sources. Using Spark one can easily switch between declarative versus imperative versus functional …
    Incentivized
    Chose Apache Spark
    Spark in comparison to similar technologies ends up being a one stop shop. You can achieve so much with this one framework instead of having to stitch and weave multiple technologies from the Hadoop stack, all while getting incredibility performance, minimal boilerplate, and …
    Incentivized
    Chose Apache Spark
    Apache Pig and Apache Hive provide most of the things spark provide but apache spark has more features like actions and transformations which are easy to code. Spark uses optimization technique as we can select driver program and manipulate DAG (Directed Acyclic Graph)
    Python …
    Incentivized
    Chose Apache Spark
    Spark has primarily replaced my use of writing pure Hadoop MapReduce or Apache Pig jobs for processing data. I like the fact that I can alternate between the main programming languages that I know - Java and Python - and use those to learn the Scala API. Spark also can be …
    Incentivized
    SAP
    No answer on this topic
    Key User Insights
    Would buy again
    100%
    Would buy again
    7 Answers
    100%
    Would buy again
    11 Answers
    100%
    Would buy again
    8 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    7 Answers
    100%
    Delivers good value for the price
    11 Answers
    100%
    Delivers good value for the price
    7 Answers
    Happy with the feature set
    100%
    Happy with the feature set
    7 Answers
    100%
    Happy with the feature set
    11 Answers
    100%
    Happy with the feature set
    8 Answers
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    6 Answers
    100%
    Lived up to sales and marketing promises
    8 Answers
    No answers on this topic
    Implementation went as expected
    80%
    Implementation went as expected
    4 Answers
    100%
    Implementation went as expected
    11 Answers
    100%
    Implementation went as expected
    8 Answers
    Features
    HadoopApache SparkSAP BW
    Access Control and Security
    Comparison of Access Control and Security features of Apache Hadoop and Apache Spark and SAP Business Warehouse
    Feature
    Apache Hadoop
    -
    Ratings
    Apache Spark
    -
    Ratings
    SAP Business Warehouse
    9.5
    7 Ratings
    6% above category average
    Multi-User Support (named login)00 Ratings00 Ratings9.47 Ratings
    Multiple Access Permission Levels (Create, Read, Delete)00 Ratings00 Ratings9.77 Ratings
    Single Sign-On (SSO)00 Ratings00 Ratings9.37 Ratings
    Location-Based Data Governance00 Ratings00 Ratings9.87 Ratings
    Data Modeling
    Comparison of Data Modeling features of Apache Hadoop and Apache Spark and SAP Business Warehouse
    Feature
    Apache Hadoop
    -
    Ratings
    Apache Spark
    -
    Ratings
    SAP Business Warehouse
    9.3
    6 Ratings
    4% below category average
    Data model creation00 Ratings00 Ratings9.36 Ratings
    Data Exploration
    Comparison of Data Exploration features of Apache Hadoop and Apache Spark and SAP Business Warehouse
    Feature
    Apache Hadoop
    -
    Ratings
    Apache Spark
    -
    Ratings
    SAP Business Warehouse
    7.7
    7 Ratings
    2% below category average
    Visualization00 Ratings00 Ratings7.77 Ratings
    Data Warehouse
    Comparison of Data Warehouse features of Apache Hadoop and Apache Spark and SAP Business Warehouse
    Feature
    Apache Hadoop
    -
    Ratings
    Apache Spark
    -
    Ratings
    SAP Business Warehouse
    8.0
    7 Ratings
    7% below category average
    High-Volume Data Processing00 Ratings00 Ratings8.57 Ratings
    Data Warehouse Management00 Ratings00 Ratings9.07 Ratings
    Administrative Automation00 Ratings00 Ratings7.27 Ratings
    Self-Optimization00 Ratings00 Ratings7.27 Ratings
    Best Alternatives
    HadoopApache SparkSAP BW
    Small Businesses
    No answers on this topic
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    Cloudera Manager (no longer available standalone)
    Score9.9 out of 10
    No answers on this topic
    Cloudera Enterprise Data Hub
    Score9 out of 10
    Enterprises
    Amazon EMR
    Score9.1 out of 10
    No answers on this topic
    Oracle Exadata
    Score9.8 out of 10
    All AlternativesView all alternativesView all alternativesView all alternatives
    User Ratings
    HadoopApache SparkSAP BW
    Likelihood to Recommend
    8.0
    (37 ratings)
    9.0
    (24 ratings)
    8.3
    (18 ratings)
    Likelihood to Renew
    9.6
    (8 ratings)
    10.0
    (1 ratings)
    -
    (0 ratings)
    Usability
    8.0
    (6 ratings)
    8.0
    (4 ratings)
    9.0
    (4 ratings)
    Performance
    8.0
    (1 ratings)
    -
    (0 ratings)
    -
    (0 ratings)
    Support Rating
    7.5
    (3 ratings)
    8.7
    (4 ratings)
    -
    (0 ratings)
    Online Training
    6.1
    (2 ratings)
    -
    (0 ratings)
    -
    (0 ratings)
    Data Sharing and Collaboration
    7.7
    (10 ratings)
    -
    (0 ratings)
    -
    (0 ratings)
    Data Sources
    8.7
    (10 ratings)
    -
    (0 ratings)
    -
    (0 ratings)
    User Testimonials
    HadoopApache SparkSAP BW
    Likelihood to Recommend
    Apache
    Altogether, I want to say that Apache Hadoop is well-suited to a larger and unstructured data flow like an aggregation of web traffic or even advertising. I think Apache Hadoop is great when you literally have petabytes of data that need to be stored and processed on an ongoing basis. Also, I would recommend that the software should be supplemented with a faster and interactive database for a better querying service. Lastly, it's very cost-effective so it is good to give it a shot before coming to any conclusion.
    Incentivized
    Read full review
    Apache
    Well suited: To most of the local run of datasets and non-prod systems - scalability is not a problem at all. Including data from multiple types of data sources is an added advantage. MLlib is a decently nice built-in library that can be used for most of the ML tasks. Less appropriate: We had to work on a RecSys where the music dataset that we used was around 300+Gb in size. We faced memory-based issues. Few times we also got memory errors. Also the MLlib library does not have support for advanced analytics and deep-learning frameworks support. Understanding the internals of the working of Apache Spark for beginners is highly not possible.
    Incentivized
    Read full review
    SAP
    SAP BW is best for: 1. Large enterprises 2. Enterprises with 3+ legacy systems with entrenched users (politically difficult to merge) 3. Enterprises with employees who can understand both the technical capabilities of SAP BW and the needs of the business users - ability to speak both languages, otherwise the program could be unwieldy and potentially underutilized (it's not particularly inexpensive) SAP BW is less appropriate for: 1. Small enterprises 2. Enterprises who have well established, same location, CRM and UFS - the integration of data analysis will be easier and less expensive with other solutions 3. HANA
    Incentivized
    Read full review
    Pros
    Apache
    • Handles large amounts of unstructured data well, for business level purposes
    • Is a good catchall because of this design, i.e. what does not fit into our vertical tables fits here.
    • Decent for large ETL pipelines and logging free-for-alls because of this, also.
    Incentivized
    Read full review
    Apache
    • Rich APIs for data transformation making for very each to transform and prepare data in a distributed environment without worrying about memory issues
    • Faster in execution times compare to Hadoop and PIG Latin
    • Easy SQL interface to the same data set for people who are comfortable to explore data in a declarative manner
    • Interoperability between SQL and Scala / Python style of munging data
    Incentivized
    Read full review
    SAP
    • It tracks bin locations for parts which can be really helpful.
    • SAP Business Warehouse tells you who has a part checked out so you can find it.
    • It shows current parts shortages so buyers are flagged to get parts on order based on current demand.
    Incentivized
    Read full review
    Cons
    Apache
    • Less organizational support system. Bugs need to be fixed and outside help take a long time to push updates
    • Not for small data sets
    • Data security needs to be ramped up
    • Failure in NameNode has no replication which takes a lot of time to recover
    Incentivized
    Read full review
    Apache
    • Memory management. Very weak on that.
    • PySpark not as robust as scala with spark.
    • spark master HA is needed. Not as HA as it should be.
    • Locality should not be a necessity, but does help improvement. But would prefer no locality
    Incentivized
    Read full review
    SAP
    • Age of software is showing as it struggles with very large data modules, which were not as prevalent in its early years
    • Querying performance at times can be very slow
    • Support and development for BEx has been discontinued or hard to find.
    Incentivized
    Read full review
    Likelihood to Renew
    Apache
    Hadoop is organization-independent and can be used for various purposes ranging from archiving to reporting and can make use of economic, commodity hardware. There is also a lot of saving in terms of licensing costs - since most of the Hadoop ecosystem is available as open-source and is free
    Read full review
    Apache
    Capacity of computing data in cluster and fast speed.
    Read full review
    SAP
    No answers on this topic
    Usability
    Apache
    As Hadoop enterprise licensed version is quite fine tuned and easy to use makes it good choice for Hadoop administrators. It’s scalability and integration with Kerberos is good option for authentication and authorisation. installation can be improved. logging can be improved so that it become easier for debugging purposes. parallel processing of data is achieved easily.
    Incentivized
    Read full review
    Apache
    If the team looking to use Apache Spark is not used to debug and tweak settings for jobs to ensure maximum optimizations, it can be frustrating. However, the documentation and the support of the community on the internet can help resolve most issues. Moreover, it is highly configurable and it integrates with different tools (eg: it can be used by dbt core), which increase the scenarios where it can be used
    Incentivized
    Read full review
    SAP
    The overall usability is robust. The tool offers lot of native feature to achieve all the data warehousing functions. Starting from data modelling to reporting and authorisation, the tool provided native features for almost all the areas of analytics. Integration of hybrid modelling with hana studio opened the usage of sql functions with the sap analytics
    Incentivized
    Read full review
    Support Rating
    Apache
    It's a great value for what you pay, and most Data Base Administrators (DBAs) can walk in and use it without substantial training. I tend to dabble on the analyst side, so querying the data I need feels like it can take forever, especially on higher traffic days like Monday.
    Incentivized
    Read full review
    Apache
    1. It integrates very well with scala or python. 2. It's very easy to understand SQL interoperability. 3. Apache is way faster than the other competitive technologies. 4. The support from the Apache community is very huge for Spark. 5. Execution times are faster as compared to others. 6. There are a large number of forums available for Apache Spark. 7. The code availability for Apache Spark is simpler and easy to gain access to. 8. Many organizations use Apache Spark, so many solutions are available for existing applications.
    Read full review
    SAP
    No answers on this topic
    Online Training
    Apache
    Hadoop is a complex topic and best suited for classrom training. Online training are a waste of time and money.
    Read full review
    Apache
    No answers on this topic
    SAP
    No answers on this topic
    Alternatives Considered
    Apache
    Not used any other product than Hadoop and I don't think our company will switch to any other product, as Hadoop is providing excellent results. Our company is growing rapidly, Hadoop helps to keep up our performance and meet customer expectations. We also use HDFS which provides very high bandwidth to support MapReduce workloads.
    Incentivized
    Read full review
    Apache
    Spark in comparison to similar technologies ends up being a one stop shop. You can achieve so much with this one framework instead of having to stitch and weave multiple technologies from the Hadoop stack, all while getting incredibility performance, minimal boilerplate, and getting the ability to write your application in the language of your choosing.
    Incentivized
    Read full review
    SAP
    SAP Business Warehouse scores higher in data warehouse functionalities for integration to SAP ERP and other SAP solutions such as SAP CRM, SAP APO, and SAP SRM. Standard SAP data source extractors which are available in SAP ERP can be used immediately for full or delta replication into SAP Business Warehouse. System governance in SAP Business Warehouse is top-notch with change management support for migration between system landscape from the development system to production system.
    Incentivized
    Read full review
    Return on Investment
    Apache
    • There are many advantages of Hadoop as first it has made the management and processing of extremely colossal data very easy and has simplified the lives of so many people including me.
    • Hadoop is quite interesting due to its new and improved features plus innovative functions.
    Incentivized
    Read full review
    Apache
    • Business leaders are able to take data driven decisions
    • Business users are able access to data in near real time now . Before using spark, they had to wait for at least 24 hours for data to be available
    • Business is able come up with new product ideas
    Incentivized
    Read full review
    SAP
    • Positive - This tool report output is in Excel so it's a good tool if your users are familiar with Excel.
    • Positive: this tool has rich BI content so developing extractors for standard processes from SAP ECC can be done in minutes.
    • Negative: It lacks lot of features which are available in other newer tools today. For ex. - rich charts, rich filtering, exporting capabilities, user interface.
    • Negative: Its not a plug and play tool like Qlikview, Lumira, or Tableau. Even a single report development in this tool takes a lot of time compared to others.
    Incentivized
    Read full review
    ScreenShots