Jenkins vs. Tricentis qTest

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Jenkins
Score 8.4 out of 10
N/A
Jenkins is an open source automation server. Jenkins provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server or turned into a continuous delivery hub for any project.N/A
Tricentis qTest
Score 7.2 out of 10
N/A
Tricentis qTest (formerly QASymphony) provides enterprise-level agile testing tools giving businesses visibility and control needed to ensure application quality in fast-paced development environments. Tricentis and QASymphony merged in summer 2018.
$1,200
per year per user
Pricing
JenkinsTricentis qTest
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
JenkinsTricentis qTest
Free Trial
NoYes
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoYes
Entry-level Setup FeeNo setup feeOptional
Additional Details
More Pricing Information
Community Pulse
JenkinsTricentis qTest
Considered Both Products
Jenkins

No answer on this topic

Tricentis qTest
Chose Tricentis qTest
There are a lot similarities between Tricentis qTest and TestRail. I think both are very capable tools that perform their jobs incredibly well. But we ultimately went with Tricentis qTest because of its deep integration with software we already use. Another factor we took into …
Chose Tricentis qTest
All of them offer formidable solutions in the test management realm, but each one caters to different niche and need. qTest distinguishes itself with its deep integration capabilities, especially with Agile and DevOps tools, enabling streamlined CI/CD process. Its modern, …
Chose Tricentis qTest
TestRail is slow as compared to qTest. The color combinations used in TestRail are quite confusing and the UI looks scrunched. TestRail's navigation and search are also quite complicated as compared to qTest. TestRail's Analytics is undesirable as it is unable to generate …
Chose Tricentis qTest
Tricentis was better suited to our processes, tools integration and migration of data from our prior tool set.
Chose Tricentis qTest
The main tool we compared to Tricentis qTest Explorer was the "Steps Recorder" that comes with Windows. We selected Tricentis qTest Explorer because, at least at the time, Steps Recorder would sometimes skip recording arbitrary steps, which didn't meet our needs.
Top Pros
Top Cons
Features
JenkinsTricentis qTest
Test Management
Comparison of Test Management features of Product A and Product B
Jenkins
-
Ratings
Tricentis qTest
7.8
26 Ratings
2% below category average
Centralized test management00 Ratings8.725 Ratings
Manage test hosts and schedules00 Ratings7.522 Ratings
Map tests to user stories00 Ratings7.48 Ratings
Test execution reporting00 Ratings7.825 Ratings
Defect management00 Ratings7.421 Ratings
Best Alternatives
JenkinsTricentis qTest
Small Businesses
GitLab
GitLab
Score 8.9 out of 10
BrowserStack
BrowserStack
Score 8.2 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.9 out of 10
Micro Focus ALM / Quality Center
Micro Focus ALM / Quality Center
Score 8.1 out of 10
Enterprises
GitLab
GitLab
Score 8.9 out of 10
Micro Focus ALM / Quality Center
Micro Focus ALM / Quality Center
Score 8.1 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
JenkinsTricentis qTest
Likelihood to Recommend
8.2
(69 ratings)
6.8
(28 ratings)
Likelihood to Renew
-
(0 ratings)
5.3
(2 ratings)
Usability
5.0
(3 ratings)
8.0
(1 ratings)
Performance
8.9
(6 ratings)
-
(0 ratings)
Support Rating
6.6
(6 ratings)
1.0
(1 ratings)
Implementation Rating
-
(0 ratings)
5.0
(1 ratings)
User Testimonials
JenkinsTricentis qTest
Likelihood to Recommend
Open Source
Jenkins is a highly customizable CI/CD tool with excellent community support. One can use Jenkins to build and deploy monolith services to microservices with ease. It can handle multiple "builds" per agent simultaneously, but the process can be resource hungry, and you need some impressive specs server for that. With Jenkins, you can automate almost any task. Also, as it is an open source, we can save a load of money by not spending on enterprise CI/CD tools.
Read full review
Tricentis
From my years of experience using qTest, I'll say it does well handling high volumes test cases. Another area it does pretty well in is test automation. It's also great for collaborative testing. Tricentis qTest is complex tool with lots of customization options. So, it would be less suitable for use by less technical testers
Read full review
Pros
Open Source
  • Automated Builds: Jenkins is configured to monitor the version control system for new pull requests. Once a pull request is created, Jenkins automatically triggers a build process. It checks out the code, compiles it, and performs any necessary build steps specified in the configuration.
  • Unit Testing: Jenkins runs the suite of unit tests defined for the project. These tests verify the functionality of individual components and catch any regressions or errors. If any unit tests fail, Jenkins marks the build as unsuccessful, and the developer is notified to fix the issues.
  • Code Analysis: Jenkins integrates with code analysis tools like SonarQube or Checkstyle. It analyzes the code for quality, adherence to coding standards, and potential bugs or vulnerabilities. The results are reported back to the developer and the product review team for further inspection.
Read full review
Tricentis
  • Highly customizable: we were able to organize our test cases in unique ways that made our work easier.
  • Connectivity with Jira: being able to pull requirements information in from Jira was a big point for us.
  • Standalone tool: Being a standalone tool on a dedicated server, we were able to have access to our tests regardless of whether our Jira server was down.
Read full review
Cons
Open Source
  • The UI could be slightly better, it feels kind of like the 90s, but it works well.
  • An easier way to filter jobs other than views on the dashboard.
  • An easier way to read the console logs when tests do fail.
Read full review
Tricentis
  • In requirements , we can't add multiple test cases at once, or search multiple cases at once, need to do one by one. Here actually qtest needs to improve.
  • Linking cloud hosted qtest and on-premise TOSCA is very difficult especially when you are working with client system with security wall. It requires tunnelling software which is not recommended.
Read full review
Likelihood to Renew
Open Source
No answers on this topic
Tricentis
This has been a core QA management tool for our organization and integrates well with our other SDLC platforms (Azure DevOps/Jira/Katalon).
Read full review
Usability
Open Source
While the day to day use is very easy, the configuration and setting up of the system or new projects can be cumbersome.
Read full review
Tricentis
qTest is actually intuitive and user-friendly, despite my other scathing review aspects
Read full review
Performance
Open Source
No, when we integrated this with GitHub, it becomes more easy and smart to manage and control our workforce. Our distributed workforce is now streamlined to a single bucket. All of our codes and production outputs are now automatically synced with all the workers. There are many cases when our in-house team makes changes in the release, our remote workers make another release with other environment variables. So it is better to get all of the work in control.
Read full review
Tricentis
No answers on this topic
Support Rating
Open Source
There is a large development community - but it is shifting as people move towards other tools. A lot of companies still use Jenkins and will build propriety tools, which doesn't help any of the open-source community. Jenkins has a lot of help and support online, but other, more modern, alternatives will have better support for newer tech.
Read full review
Tricentis
The actual answer is 0. I have never experienced worse support, whether personal or professional
Read full review
Implementation Rating
Open Source
No answers on this topic
Tricentis
Again, supporting documentation could have been a lot better
Read full review
Alternatives Considered
Open Source
Overall, Jenkins is the easiest platform for someone who has no experience to come in and use effectively. We can get a junior engineer into Jenkins, give them access, and point them in the right direction with minimal hand-holding. The competing products I have used (TravisCI/GitLab/Azure) provide other options but can obfuscate the process due to the lack of straightforward simplicity. In other areas (capability, power, customization), Jenkins keeps up with the competition and, in some areas, like customization, exceeds others.
Read full review
Tricentis
All of them offer formidable solutions in the test management realm, but each one caters to different niche and need. qTest distinguishes itself with its deep integration capabilities, especially with Agile and DevOps tools, enabling streamlined CI/CD process. Its modern, user-centric interface contrasts with ALM's more dated appearance and complex setup. While TestRail provides a clean user experience and caters to a broad spectrum of business, qTest's scalability, from SMBs to large enterprises, stands out. PractiTest's cloud-based solution is geared towards mid-sized companies, but qTest's flexibility, advanced analytics, and robust reporting grant teams actionable insights. qTest' approach to a more holistic test management closely aligning with modern software development practices
Read full review
Return on Investment
Open Source
  • Faster Time-to-Market: Jenkins automate the build, testing, and deployment process, enabling faster feedback and continuous improvement.
  • Improved Quality: Jenkins automatically run unit tests and integration tests, ensuring that code changes meet the necessary quality standards.
  • Cost Savings: Jenkins is an open-source tool that is free to use
Read full review
Tricentis
  • As a reviewer, it has eased the process of test case auditing.
  • Test case navigation has been made much simpler as all the cases are now linked to the components in a structured tree format.
  • Test Cycles & Runs can be created within seconds and assigned to the testers.
  • It has definitely increased the testing team's visibility across the board.
Read full review
ScreenShots

Tricentis qTest Screenshots

Screenshot of Customizable analytics and reports can be shared across the organization - additional read license requiredScreenshot of Centrally manage automated testing and environments, as well as schedule and or kickoff automated testing with any open source or proprietary toolScreenshot of qTest allows for true test case sharing across teams and projects to help standardize and scale knowledge and best practicesScreenshot of qTest integrates in real-time with Jira for full traceability to requirements during Agile test and developmentScreenshot of Build custom, event-driven workflows with any third-party solution, including ChatOps tools like Slack and Microsoft Teams, to streamline testing and drive collaborationScreenshot of Tricentis qTest comes with over 60 out-of-the-box metrics, with drag-and-drop capabilities to build custom dashboards