CucumberStudio, from SmartBear vs. TestRail

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
CucumberStudio
Score 4.9 out of 10
N/A
CucumberStudio, now a SmartBear product since the 2019 acquisition, is a continuous testing platform replacing the former HipTest, supporting agile development with manual and automated code testing, reusable steps, feature history with living documentation, among other features.N/A
TestRail
Score 7.5 out of 10
N/A
TestRail by Gurock, an IDERA company, is presented as a complete web-based test case management solution to manage, track, and organize your software testing efforts.
$35
per month billed annually
Pricing
CucumberStudio, from SmartBearTestRail
Editions & Modules
No answers on this topic
Professional Cloud
$35
per month billed annually per user
Professional Cloud
$38
per month per user
Enterprise Cloud
$71
per month billed annually per user
Offerings
Pricing Offerings
CucumberStudioTestRail
Free Trial
NoYes
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details——
More Pricing Information
Community Pulse
CucumberStudio, from SmartBearTestRail
Top Pros
Top Cons
Features
CucumberStudio, from SmartBearTestRail
Test Management
Comparison of Test Management features of Product A and Product B
CucumberStudio, from SmartBear
-
Ratings
TestRail
7.3
3 Ratings
10% below category average
Centralized test management00 Ratings7.03 Ratings
Manage test hosts and schedules00 Ratings7.02 Ratings
Map tests to user stories00 Ratings7.03 Ratings
Test execution reporting00 Ratings8.53 Ratings
Defect management00 Ratings7.02 Ratings
Best Alternatives
CucumberStudio, from SmartBearTestRail
Small Businesses
IBM Targetprocess
IBM Targetprocess
Score 8.9 out of 10
BrowserStack
BrowserStack
Score 8.7 out of 10
Medium-sized Companies
Planview AgilePlace
Planview AgilePlace
Score 9.4 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.2 out of 10
Enterprises
Planview AgilePlace
Planview AgilePlace
Score 9.4 out of 10
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 7.2 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
CucumberStudio, from SmartBearTestRail
Likelihood to Recommend
9.0
(1 ratings)
6.5
(3 ratings)
Usability
-
(0 ratings)
7.0
(1 ratings)
Support Rating
9.0
(1 ratings)
-
(0 ratings)
User Testimonials
CucumberStudio, from SmartBearTestRail
Likelihood to Recommend
SmartBear
HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.
Read full review
IDERA (an Idera, Inc. company)
The integration with other tools, and their user friendly layout and design. It's very comfortable to use and is way better than other tools with the Automation Testing tools, thanks to the great API that is included. Sometimes the integration with Jira is a little faulty, but the links to that tool usually work well. It could be cool if it had a better following for the bug items that were registered on other tools.
Read full review
Pros
SmartBear
  • Good integration with Jira
  • Includes integration with different tools for different porpuses
  • You can build your own framework to automate scenarios and make it work with Hiptest
Read full review
IDERA (an Idera, Inc. company)
  • Managing test plans and test cases
  • Generation of test results
  • Modularised way of storing tests
Read full review
Cons
SmartBear
  • UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
  • To get extra functionalities you have to pay for them separately.
Read full review
IDERA (an Idera, Inc. company)
  • Outstanding user bugs
  • UI is clunky
  • Things are not where you think they would be
Read full review
Usability
SmartBear
No answers on this topic
IDERA (an Idera, Inc. company)
As I am a tester, for me I found this tool to be new in terms of everything like the management of tests, plans, releases, reporting,etc. It is overall a good tool for test reporting and can be used for reference in the future. I liked several features of on the go placement of screenshots. Also I feel like the UI , the font, the color combination can be improved
Read full review
Support Rating
SmartBear
The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.
Read full review
IDERA (an Idera, Inc. company)
No answers on this topic
Alternatives Considered
SmartBear
No answers on this topic
IDERA (an Idera, Inc. company)
TestRail definitely saves times. I work in a company that consists of several development teams, all of which have different processes. Some of the teams leverage test cases, some do not. I've noticed that the turn around time it takes for me to pick up a ticket, QA it, and then pass/fail/send feedback is much faster when there is a test case created as I'm not reading through ticket description/comments to figure out what needs to be QA'd.
Read full review
Return on Investment
SmartBear
  • It helps to have organization in our scenarios.
  • It helps to get regressions done faster than doing it manually
  • It helps to graphically see the progress and results of executions.
Read full review
IDERA (an Idera, Inc. company)
  • We are able to easily pull reports any time management would like to see them
  • Jira integration makes it easy to attach to stories/defects and save time
  • A quick overview at the system's health as a whole is easy to see from TestRail
Read full review
ScreenShots

CucumberStudio Screenshots

Screenshot of CucumberStudio empowers the whole team to read and refine executable specifications without needing technical tools. Business and technology teams can collaborate on acceptance criteria and bridge their gap.