Apache JMeter vs. BrowserStack

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
JMeter
Score 8.2 out of 10
N/A
JMeter, from Apache, is a load and performance testing tool.
$0
BrowserStack
Score 8.5 out of 10
N/A
BrowserStack is a test platform built for developers and QAs to expand test coverage, scale and optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability. BrowserStack states it currently powers over a billion tests a year for customers who include Amazon, Paypal, Well Fargo Bank, Nvidia, MongoDB, Pfizer, GE, Discovery, React JS, Apache, JQuery and several others rely on BrowserStack to test their web and mobile apps.
$0
per month Unlimited users and 5000 free screenshots
Pricing
Apache JMeterBrowserStack
Editions & Modules
No answers on this topic
Percy - Free
$0
per month Unlimited users and 5000 free screenshots
App Percy - Free
$0
per month 5000 free screenshots and 100 minutes of infrastructure
Test Observability - Unlimited Free
$0
Accessibility Testing - Free
$0
Test Observability - Observability Pro
$0.01
per month per test execution
Percy - Desktop
$0.02
per month per screenshot
App Percy - Visual Core
$0.02
per month per screenshot
Percy - Desktop & Mobile
$0.02
per month per screenshot
App Percy - Visual Cloud
$0.03
per month per screenshot
Live - Desktop
$39
per month per user
Live - Desktop & Mobile
$49
per month per user
App Live - Individual
$49
per month per user
Automate - Desktop
$129
per month 1 parallel test
Live - Team
$175
per month 5 users
App Live - Team
$175
per month 5 users
Accessibility Testing - Team
$199
per month 5 users
Automate - Desktop & Mobile
$225
per month 1 parallel test
App Automate - Device Cloud
$249
per month 1 parallel test
App Live - Team Pro
$289
per month 5 users
App Automate - Device Cloud Pro
$299
per month 1 parallel test
Automate - Enterprise
Contact sales team
Percy - Enterprise
Contact Sales
App Automate - Enterprise
Contact Sales
App Live - Enterprise
Contact sales team
Live - Enterprise
Contact sales team
App Automate - Device Cloud Pro + Visual Cloud
Contact Sales
App Percy - Enterprise
Contact Sales
Test Observability - Enterprise
Contact Sales
Accessibility Testing - Enterprise
Contact Sales
Offerings
Pricing Offerings
JMeterBrowserStack
Free Trial
NoYes
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Apache JMeterBrowserStack
Considered Both Products
JMeter

No answer on this topic

BrowserStack
Chose BrowserStack
We chose BrowserStack as our solution as it provides a comprehensive, all-in-one package. This integrated approach ensures that all your needs are met in one place, eliminating the need for multiple tools or services. It streamlines processes, improves efficiency, and …
Chose BrowserStack
It is one of the product which each software organisation should include in their end to end product development journey. I have explored other products in this category and I can proudly say that BrowserStack is a clear winner in terms of its Features, Performance and Product …
Chose BrowserStack
Price looks little high for browserstack , they need to introduce more flexible plans to stack their customers, support team must be more quick, sometimes they take more than 2-3 days to resolve the issue. other tools are available in less cost with same features. so later on …
Chose BrowserStack
Due to better Mobile App testing feature, we choose browserstack
Features
Apache JMeterBrowserStack
Load Testing
Comparison of Load Testing features of Product A and Product B
Apache JMeter
7.2
24 Ratings
17% below category average
BrowserStack
-
Ratings
End to end performance management9.021 Ratings00 Ratings
Integrated performance data8.522 Ratings00 Ratings
Deployment model flexibility7.521 Ratings00 Ratings
Real time monitoring6.521 Ratings00 Ratings
Automated anomaly detection4.417 Ratings00 Ratings
Best Alternatives
Apache JMeterBrowserStack
Small Businesses

No answers on this topic

TestComplete
TestComplete
Score 7.9 out of 10
Medium-sized Companies
ReadyAPI
ReadyAPI
Score 6.4 out of 10
ReadyAPI
ReadyAPI
Score 6.4 out of 10
Enterprises
ReadyAPI
ReadyAPI
Score 6.4 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Apache JMeterBrowserStack
Likelihood to Recommend
8.5
(39 ratings)
8.9
(244 ratings)
Likelihood to Renew
8.6
(12 ratings)
9.1
(19 ratings)
Usability
6.5
(3 ratings)
7.7
(23 ratings)
Availability
1.0
(1 ratings)
9.6
(5 ratings)
Performance
8.0
(1 ratings)
5.4
(78 ratings)
Support Rating
10.0
(1 ratings)
7.6
(24 ratings)
In-Person Training
-
(0 ratings)
7.3
(1 ratings)
Online Training
1.0
(1 ratings)
4.3
(3 ratings)
Implementation Rating
-
(0 ratings)
8.8
(8 ratings)
Configurability
-
(0 ratings)
8.3
(6 ratings)
Contract Terms and Pricing Model
-
(0 ratings)
8.9
(4 ratings)
Ease of integration
-
(0 ratings)
8.4
(3 ratings)
Product Scalability
-
(0 ratings)
9.8
(6 ratings)
Professional Services
-
(0 ratings)
8.9
(4 ratings)
Vendor post-sale
-
(0 ratings)
9.0
(4 ratings)
Vendor pre-sale
-
(0 ratings)
8.4
(4 ratings)
User Testimonials
Apache JMeterBrowserStack
Likelihood to Recommend
Apache
JMeter is well suited for Java applications where the user can script the scenario once and make changes to accommodate for as many numbers of users for load test execution. The image and selection of any files or exporting files scenario is handled well.
It is less appropriate to test Ajax applications where it is required to script click per use.
Read full review
BrowserStack
Browserstack is great if you have a need for cross-browser or cross-device testing. You can even load in native apps/websites that might not be live on the public internet but are hosted on a secure network, which makes it easier to test against QA and STG environments as well. There might be better tools out there if you don't really have a need for that cross browser and device testing though and are just looking to set up some type of automation or only have a few devices or OSes that you need to test with. The value of the product will vary wildly depending on what you want to do with it.
Read full review
Pros
Apache
  • Easy of use - in generate load like HTTP requests, and processing/analyzing the responses. No coding is necessary at the basic level, just need to understand load testing and the infrastructure being tested.
  • Automatic management of things like cookies to help with session state support - so you don't specifically have to worry about it or handle it
  • Lots of testing/configuration options to suit your needs in making the right load generation (sampling requests), and analyzing the results, including any pre and post processing of the results first. Things like the Beanshell/BSF pre/post processors, response assertion, regular expression extractor, XPath extractor, CSV data set config
  • There is a JMeter cloud service called BlazeMeter that I think would be useful for those that need to scale up high load without provisioning their own systems. I've not personally tried it though, but I recently attended a meetup presentation that highlighted nice useful features that BlazeMeter provides. One should evaluate the service if they are considering JMeter and need to expand beyond existing hardware resources.
Read full review
BrowserStack
  • Test client website on 5x more platform.
  • Provide a real device with features like media injection and Physical SIM testing for manual testing of a specific feature.
  • Automate regression suite to execute parallel on multiple device.
  • Provide an accessibility report for the website through automated scanning of the site using site.xml.
Read full review
Cons
Apache
  • Jmeter requires many tweaks with respect to its configuration file and thread properties. users need to edit theses files themselves. There could be some interface where we can edit this fields.
  • Jmeter cannot handle more threads and hangs up when we increase the number of threads. This causes lot of inconvenience. In these situations, user can be notified that such change would be lead to slow performance so that user can do as required. The same appears when we try to view huge files on graph listener.
  • Jmeter should optimize the read and write access to output csv since it acts as overhead to the I/O performance. This affects our test results for the application which we are testing.
Read full review
BrowserStack
  • I wish it didn't time out so quickly. I often move back and forth between my native Mac OS system and browsers to BrowserStack for Windows browsers and it often times out so I have to start over.
  • I am not sure why, but when I've been testing in BrowserStack for a long period of time - maybe over a couple of hours, it sometimes gets buggy and unresponsive or slow to respond. It makes it hard to tell if I'm experiencing an issue with the site I'm testing or if it's an issue with BrowserStack.
  • If I'm wishing for the moon and stars, I'd ask for the ability to use BrowserStack to also test with JAWS screen reader. But I'm happy having NVDA.
Read full review
Likelihood to Renew
Apache
Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence
Read full review
BrowserStack
It's almost the 3rd year for us and it's renewal time for us. So yes, we are already discussing how many licenses we need to increase as users are increasing internally. So it's 100% sure that we are already planning renewal this year as well BrowserStack with live and app automate.
Read full review
Usability
Apache
The purpose related to performance and load testing through Apache JMeter works fine but the usability of the tool should be improved quite a lot. If someone starts with the Jmeter fresh without prior experience, they need to put more efforts in understanding the tool. The UI is not that great which is the main reason not to give high rating on usability.
Read full review
BrowserStack
So many options that it can be a little overwhelming, but the core functions are easy to find and use and it's usually not too hard to figure things out for the more complex tasks. Very easy to boot up a device and a specific browser from the dashboard to begin a manual website test.
Read full review
Reliability and Availability
Apache
No answers on this topic
BrowserStack
I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all
Read full review
Performance
Apache
No answers on this topic
BrowserStack
The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.
Read full review
Support Rating
Apache
I have been using JMeter for the last year. By using this tool, you can make sure the system will work under varied loads. It helps us to simulate real time scenarios by creating required virtual users and make sure the application will work under load. Perform load, stress, and stability testing using JMeter.
Read full review
BrowserStack
I've not had much direct interaction with the BrowserStack support team. The help and community are great and we've not run into any issue that has really required us to reach out. I guess having a stable and easy to use system means you may never need to contact support.
Read full review
In-Person Training
Apache
No answers on this topic
BrowserStack
Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.
Read full review
Online Training
Apache
No answers on this topic
BrowserStack
It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.
Read full review
Implementation Rating
Apache
No answers on this topic
BrowserStack
I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.
Read full review
Alternatives Considered
Apache
I have used LoadRunner and Silkperformer, and so far Jmeter turns out be the easiest to use of all these. While each of them have their own ROI, Jmeter can be picked by anyone in hours and start testing within a day. While with other tools, we need to get license, install them (takes a while) and setup tests and firewalls, etc.
Read full review
BrowserStack
BrowserStack products has been found better for low code automations and visual regression techniques. We have been struggling to maintain the API endpoint sanity tests and writing a lot of code for them while releasing the builds, while we chose BrowserStack accessibility solutions, we found it a way easier than we thought and worked it up.
Read full review
Contract Terms and Pricing Model
Apache
No answers on this topic
BrowserStack
No Vendors were involved, directly dealt with Browserstack
Read full review
Scalability
Apache
No answers on this topic
BrowserStack
I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose
Read full review
Professional Services
Apache
No answers on this topic
BrowserStack
Not used
Read full review
Return on Investment
Apache
  • Good ROI on improving the performance of the application.
  • Finding issues in the performance.
  • Benchmark the performance results.
  • CON: Need skillset to create and maintain the scripts in Java.
  • Scripts are reusable and it is executed by any user.
  • Need Client and Server setup to execute the scripts.
Read full review
BrowserStack
  • It reduced the cost of buying multiple devices as we have multiple devices access in it
  • Easily accessible from anywhere due to it cloud availability
  • Introducing this to our client also helped us in building trust as well as winning their confidence during deliverables
Read full review
ScreenShots

BrowserStack Screenshots

Screenshot of Screenshot of Screenshot of Screenshot of Screenshot of Screenshot of