BrowserStack vs. Jenkins

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
BrowserStack
Score 8.5 out of 10
N/A
BrowserStack is a test platform built for developers and QAs to expand test coverage, scale and optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability. BrowserStack states it currently powers over a billion tests a year for customers who include Amazon, Paypal, Well Fargo Bank, Nvidia, MongoDB, Pfizer, GE, Discovery, React JS, Apache, JQuery and several others rely on BrowserStack to test their web and mobile apps.
$0
per month Unlimited users and 5000 free screenshots
Jenkins
Score 8.4 out of 10
N/A
Jenkins is an open source automation server. Jenkins provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server or turned into a continuous delivery hub for any project.N/A
Pricing
BrowserStackJenkins
Editions & Modules
Percy - Free
$0
per month Unlimited users and 5000 free screenshots
App Percy - Free
$0
per month 5000 free screenshots and 100 minutes of infrastructure
Test Observability - Unlimited Free
$0
Accessibility Testing - Free
$0
Test Observability - Observability Pro
$0.01
per month per test execution
Percy - Desktop
$0.02
per month per screenshot
App Percy - Visual Core
$0.02
per month per screenshot
Percy - Desktop & Mobile
$0.02
per month per screenshot
App Percy - Visual Cloud
$0.03
per month per screenshot
Live - Desktop
$39
per month per user
Live - Desktop & Mobile
$49
per month per user
App Live - Individual
$49
per month per user
Automate - Desktop
$129
per month 1 parallel test
Live - Team
$175
per month 5 users
App Live - Team
$175
per month 5 users
Accessibility Testing - Team
$199
per month 5 users
Automate - Desktop & Mobile
$225
per month 1 parallel test
App Automate - Device Cloud
$249
per month 1 parallel test
App Live - Team Pro
$289
per month 5 users
App Automate - Device Cloud Pro
$299
per month 1 parallel test
Automate - Enterprise
Contact sales team
Percy - Enterprise
Contact Sales
App Automate - Enterprise
Contact Sales
App Live - Enterprise
Contact sales team
Live - Enterprise
Contact sales team
App Automate - Device Cloud Pro + Visual Cloud
Contact Sales
App Percy - Enterprise
Contact Sales
Test Observability - Enterprise
Contact Sales
Accessibility Testing - Enterprise
Contact Sales
No answers on this topic
Offerings
Pricing Offerings
BrowserStackJenkins
Free Trial
YesNo
Free/Freemium Version
NoYes
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
BrowserStackJenkins
Considered Both Products
BrowserStack
Chose BrowserStack
I'm using the app automate feature for Automation of mobile application. So, we are add Jenkins for CI process to use on BrowserStack. For mobile application testing, We are using Appium with java client in our framework and also integrate with BrowserStack capabilities.
Chose BrowserStack
I have used Saucelabs with Jenkins and would say both of them are really comprehensive. Yet I suggested BrowserStack to our customers and team since I have used it recently and felt it easy to use and implement Tests on it. BrowserStack support team is another reason behind why …
Chose BrowserStack
When we are comparing BrowserStack have faster session start times compared to Sauce Labs. And also simpler, user friendly setup and UI. This help to our team members to navigate and use. Browser stacks have reliable parallel execution with stable performance. We can get better …
Chose BrowserStack
It's easy to use, Cost effective and Reliable.
Chose BrowserStack
We chose BrowserStack as our solution as it provides a comprehensive, all-in-one package. This integrated approach ensures that all your needs are met in one place, eliminating the need for multiple tools or services. It streamlines processes, improves efficiency, and …
Chose BrowserStack
I haven't participated in selecting BrowserStack as tool, wide-company decisions done by QA team
Chose BrowserStack
easier to integrate, less effort from QAs

Selenium grid is another option which is free.
Chose BrowserStack
The tests on SauceLabs were less stable, the live devices took more time to load. We were unable to easily access the devtools when running on mobile devices and the support team took more time to answer us.
Jenkins

No answer on this topic

Best Alternatives
BrowserStackJenkins
Small Businesses
TestComplete
TestComplete
Score 7.9 out of 10
GitLab
GitLab
Score 8.7 out of 10
Medium-sized Companies
ReadyAPI
ReadyAPI
Score 6.3 out of 10
GitLab
GitLab
Score 8.7 out of 10
Enterprises
ignio AIOps
ignio AIOps
Score 8.1 out of 10
GitLab
GitLab
Score 8.7 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
BrowserStackJenkins
Likelihood to Recommend
8.9
(244 ratings)
7.0
(74 ratings)
Likelihood to Renew
9.1
(19 ratings)
-
(0 ratings)
Usability
7.8
(23 ratings)
6.7
(8 ratings)
Availability
9.7
(5 ratings)
-
(0 ratings)
Performance
5.4
(78 ratings)
8.9
(6 ratings)
Support Rating
7.7
(24 ratings)
6.6
(6 ratings)
In-Person Training
7.3
(1 ratings)
-
(0 ratings)
Online Training
4.2
(3 ratings)
-
(0 ratings)
Implementation Rating
8.8
(8 ratings)
6.0
(1 ratings)
Configurability
8.3
(6 ratings)
-
(0 ratings)
Contract Terms and Pricing Model
8.9
(4 ratings)
-
(0 ratings)
Ease of integration
8.3
(3 ratings)
-
(0 ratings)
Product Scalability
9.8
(6 ratings)
-
(0 ratings)
Professional Services
8.9
(4 ratings)
-
(0 ratings)
Vendor post-sale
9.0
(4 ratings)
-
(0 ratings)
Vendor pre-sale
8.3
(4 ratings)
-
(0 ratings)
User Testimonials
BrowserStackJenkins
Likelihood to Recommend
BrowserStack
Browserstack is great if you have a need for cross-browser or cross-device testing. You can even load in native apps/websites that might not be live on the public internet but are hosted on a secure network, which makes it easier to test against QA and STG environments as well. There might be better tools out there if you don't really have a need for that cross browser and device testing though and are just looking to set up some type of automation or only have a few devices or OSes that you need to test with. The value of the product will vary wildly depending on what you want to do with it.
Read full review
Open Source
Jenkins is a highly customizable CI/CD tool with excellent community support. One can use Jenkins to build and deploy monolith services to microservices with ease. It can handle multiple "builds" per agent simultaneously, but the process can be resource hungry, and you need some impressive specs server for that. With Jenkins, you can automate almost any task. Also, as it is an open source, we can save a load of money by not spending on enterprise CI/CD tools.
Read full review
Pros
BrowserStack
  • Test client website on 5x more platform.
  • Provide a real device with features like media injection and Physical SIM testing for manual testing of a specific feature.
  • Automate regression suite to execute parallel on multiple device.
  • Provide an accessibility report for the website through automated scanning of the site using site.xml.
Read full review
Open Source
  • Automated Builds: Jenkins is configured to monitor the version control system for new pull requests. Once a pull request is created, Jenkins automatically triggers a build process. It checks out the code, compiles it, and performs any necessary build steps specified in the configuration.
  • Unit Testing: Jenkins runs the suite of unit tests defined for the project. These tests verify the functionality of individual components and catch any regressions or errors. If any unit tests fail, Jenkins marks the build as unsuccessful, and the developer is notified to fix the issues.
  • Code Analysis: Jenkins integrates with code analysis tools like SonarQube or Checkstyle. It analyzes the code for quality, adherence to coding standards, and potential bugs or vulnerabilities. The results are reported back to the developer and the product review team for further inspection.
Read full review
Cons
BrowserStack
  • I wish it didn't time out so quickly. I often move back and forth between my native Mac OS system and browsers to BrowserStack for Windows browsers and it often times out so I have to start over.
  • I am not sure why, but when I've been testing in BrowserStack for a long period of time - maybe over a couple of hours, it sometimes gets buggy and unresponsive or slow to respond. It makes it hard to tell if I'm experiencing an issue with the site I'm testing or if it's an issue with BrowserStack.
  • If I'm wishing for the moon and stars, I'd ask for the ability to use BrowserStack to also test with JAWS screen reader. But I'm happy having NVDA.
Read full review
Open Source
  • The UI could be slightly better, it feels kind of like the 90s, but it works well.
  • An easier way to filter jobs other than views on the dashboard.
  • An easier way to read the console logs when tests do fail.
Read full review
Likelihood to Renew
BrowserStack
It's almost the 3rd year for us and it's renewal time for us. So yes, we are already discussing how many licenses we need to increase as users are increasing internally. So it's 100% sure that we are already planning renewal this year as well BrowserStack with live and app automate.
Read full review
Open Source
We have a certain buy-in as we have made a lot of integrations and useful tools around jenkins, so it would cost us quite some time to change to another tool. Besides that, it is very versatile, and once you have things set up, it feels unnecessary to change tool. It is also a plus that it is open source.
Read full review
Usability
BrowserStack
So many options that it can be a little overwhelming, but the core functions are easy to find and use and it's usually not too hard to figure things out for the more complex tasks. Very easy to boot up a device and a specific browser from the dashboard to begin a manual website test.
Read full review
Open Source
Jenkins streamlines development and provides end to end automated integration and deployment. It even supports Docker and Kubernetes using which container instances can be managed effectively. It is easy to add documentation and apply role based access to files and services using Jenkins giving full control to the users. Any deviation can be easily tracked using the audit logs.
Read full review
Reliability and Availability
BrowserStack
I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all
Read full review
Open Source
No answers on this topic
Performance
BrowserStack
The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.
Read full review
Open Source
No, when we integrated this with GitHub, it becomes more easy and smart to manage and control our workforce. Our distributed workforce is now streamlined to a single bucket. All of our codes and production outputs are now automatically synced with all the workers. There are many cases when our in-house team makes changes in the release, our remote workers make another release with other environment variables. So it is better to get all of the work in control.
Read full review
Support Rating
BrowserStack
I've not had much direct interaction with the BrowserStack support team. The help and community are great and we've not run into any issue that has really required us to reach out. I guess having a stable and easy to use system means you may never need to contact support.
Read full review
Open Source
As with all open source solutions, the support can be minimal and the information that you can find online can at times be misleading. Support may be one of the only real downsides to the overall software package. The user community can be helpful and is needed as the product is not the most user-friendly thing we have used.
Read full review
In-Person Training
BrowserStack
Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.
Read full review
Open Source
No answers on this topic
Online Training
BrowserStack
It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.
Read full review
Open Source
No answers on this topic
Implementation Rating
BrowserStack
I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.
Read full review
Open Source
It is worth well the time to setup Jenkins in a docker container. It is also well worth to take the time to move any "Jenkins configuration" into Jenkinsfiles and not take shortcuts.
Read full review
Alternatives Considered
BrowserStack
BrowserStack products has been found better for low code automations and visual regression techniques. We have been struggling to maintain the API endpoint sanity tests and writing a lot of code for them while releasing the builds, while we chose BrowserStack accessibility solutions, we found it a way easier than we thought and worked it up.
Read full review
Open Source
Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/GitLab/Azure) provide other options but can obfuscate the process due to the lack of straightforward simplicity. In other areas (capability, power, customization), Jenkins keeps up with the competition and, in some areas, like customization, exceeds others.
Read full review
Contract Terms and Pricing Model
BrowserStack
No Vendors were involved, directly dealt with Browserstack
Read full review
Open Source
No answers on this topic
Scalability
BrowserStack
I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose
Read full review
Open Source
No answers on this topic
Professional Services
BrowserStack
Not used
Read full review
Open Source
No answers on this topic
Return on Investment
BrowserStack
  • It reduced the cost of buying multiple devices as we have multiple devices access in it
  • Easily accessible from anywhere due to it cloud availability
  • Introducing this to our client also helped us in building trust as well as winning their confidence during deliverables
Read full review
Open Source
  • Faster Time-to-Market: Jenkins automate the build, testing, and deployment process, enabling faster feedback and continuous improvement.
  • Improved Quality: Jenkins automatically run unit tests and integration tests, ensuring that code changes meet the necessary quality standards.
  • Cost Savings: Jenkins is an open-source tool that is free to use
Read full review
ScreenShots

BrowserStack Screenshots

Screenshot of Screenshot of Screenshot of Screenshot of Screenshot of Screenshot of