What users are saying about
Top Rated
254 Ratings
Top Rated
254 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 8.7 out of 100
5 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>
Score 4.7 out of 100

Attribute Ratings

  • Selenium is rated higher in 1 area: Likelihood to Recommend
  • CucumberStudio, from SmartBear is rated higher in 1 area: Support Rating

Likelihood to Recommend

9.3

Selenium

93%
56 Ratings
9.0

CucumberStudio

90%
1 Rating

Likelihood to Renew

9.2

Selenium

92%
6 Ratings

CucumberStudio

N/A
0 Ratings

Usability

8.8

Selenium

88%
6 Ratings

CucumberStudio

N/A
0 Ratings

Support Rating

8.2

Selenium

82%
19 Ratings
9.0

CucumberStudio

90%
2 Ratings

Implementation Rating

9.0

Selenium

90%
6 Ratings

CucumberStudio

N/A
0 Ratings

Likelihood to Recommend

Open Source

When you have to test the UI and how it behaves when certain actions are performed, you need something that can automate the browsers. This is where Selenium comes to the rescue. If you have to test APIs and not the frontend (UI), I would recommend going with other libraries that support HTTP Requests. Selenium is good only when you have no choice but to run the steps on a browser.
Read full review

SmartBear

HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.
Read full review

Pros

Open Source

  • For any web based UI automation, Selenium is the best tool out there to automate your tests.
  • It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from.
  • There is a huge community of users and can get many answers on StackOverFlow.
  • It has lot of other plugins to make your tests even more efficient.
Read full review

SmartBear

  • Good integration with Jira
  • Includes integration with different tools for different porpuses
  • You can build your own framework to automate scenarios and make it work with Hiptest
Read full review

Cons

Open Source

  • Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
  • Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
  • Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.
Read full review

SmartBear

  • UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
  • To get extra functionalities you have to pay for them separately.
Read full review

Pricing Details

Selenium

Starting Price

Editions & Modules

Selenium editions and modules pricing
EditionModules

Footnotes

    Offerings

    Free Trial
    Free/Freemium Version
    Premium Consulting/Integration Services

    Entry-level set up fee?

    No setup fee

    Additional Details

    CucumberStudio

    Starting Price

    Editions & Modules

    CucumberStudio editions and modules pricing
    EditionModules

    Footnotes

      Offerings

      Free Trial
      Free/Freemium Version
      Premium Consulting/Integration Services

      Entry-level set up fee?

      No setup fee

      Additional Details

      Likelihood to Renew

      Open Source

      We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
      Read full review

      SmartBear

      No answers on this topic

      Usability

      Open Source

      As I mentioned earlier, the reason I use Selenium is because there is a fairly widespread community of users, and user support services are at a good level. because the application is open source, it works on many platforms (Windows, Linux, IOS) without any problems. In addition, it gives us a lot of options for writing functional tests. For errors that we receive through the application, we can easily find the reasons for errors in the forums.
      Read full review

      SmartBear

      No answers on this topic

      Support Rating

      Open Source

      Selenium does not have technical support available easily. You have to go through forums to get the information you need. However, there are excellent forums out there that make it easy to troubleshoot. The open-source flexibility makes it difficult to have dedicated support.
      Read full review

      SmartBear

      The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.
      Read full review

      Implementation Rating

      Open Source

      We did everything we needed to use it. Now we can execute our tests on different operational systems and browsers running few tests simultaneously. We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets. We use SauceLabs for our test execution and Jenkins for continuous integration.
      Read full review

      SmartBear

      No answers on this topic

      Alternatives Considered

      Open Source

      At the time of adoption, there were not many other alternatives that were even close to being competitive when it comes to browser testing. As far as I know now to this day, there is still little competition to Selenium for what it does. Any other browser-based testing still utilises Selenium to interact with the browser.
      Read full review

      SmartBear

      No answers on this topic

      Return on Investment

      Open Source

      • There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change.
      • This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests.
      • We are able to screenshot and save entire sites before and after launch with a program the automation engineer created
      • We can compare large volumes of data against data in excel docs with a program created using Selenium
      Read full review

      SmartBear

      • It helps to have organization in our scenarios.
      • It helps to get regressions done faster than doing it manually
      • It helps to graphically see the progress and results of executions.
      Read full review

      Screenshots

      Add comparison