Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Bugzilla
Score 8.5 out of 10
N/A
N/AN/A
GitLab
Score 8.7 out of 10
N/A
GitLab is an intelligent orchestration platform for DevSecOps, where software teams enable AI at every stage of the software lifecycle to ship faster. The platform enables teams to automate repetitive tasks across planning, building, securing, testing, deploying, and maintaining software.
$0
per month per user
ReadyAPI
Score 6.2 out of 10
N/A
ReadyAPI (formerly SoapUI Pro, LoadUI Pro, and ServiceV Pro) is a REST and SOAP API functional testing tool that enables software developers, QA engineers, and manual testers to work together to create, maintain, and execute complex end-to-end API tests in their CI/CD pipelines without needing to code.N/A
Pricing
BugzillaGitLabReadyAPI
Editions & Modules
No answers on this topic
GitLab Free (self-managed)
$0
GitLab Free
$0
GitLab Premium
$29
per month per user
GitLab Premium (self-managed)
$29
per month per user
GitLab Ultimate
Contact Sales
GitLab Ultimate (self-managed)
Contact Sales
No answers on this topic
Offerings
Pricing Offerings
BugzillaGitLabReadyAPI
Free Trial
NoYesYes
Free/Freemium Version
NoYesYes
Premium Consulting/Integration Services
NoYesNo
Entry-level Setup FeeNo setup feeOptionalNo setup fee
Additional DetailsGitLab Credits enable flexible, consumption-based access to agentic AI capabilities in the GitLab platform, allowing you to scale AI adoption at your own pace while maintaining cost predictability. Powered by Duo Agent Platform, GitLab’s agentic AI capabilities help software teams to collaborate at AI speed, without compromising quality and enterprise security. If usage exceeds monthly allocations and overage terms are accepted, automated on-demand billing activates without service interruption, so your developers never lose access to AI capabilities they need. Real-time dashboards provide transparency into AI consumption patterns. Software teams can see usage across users, projects, and groups with granular attribution for cost allocation. Automated threshold alerts facilitate proactive planning. Advanced analytics deliver trending, forecasting, and FinOps integration.
More Pricing Information
Community Pulse
BugzillaGitLabReadyAPI
Considered Multiple Products
Bugzilla

No answer on this topic

GitLab
Chose GitLab
We migrated from Gerrit to GitLab, and minus a few minor bumps during migration, GitLab has been hands down better. Our devs have faster time to code review with notifications, the UI is easy to navigate and, and our pipeline is integrated and automated, so once everything is …
ReadyAPI
Chose ReadyAPI
I have not used any other API tools, (new to QA) and the company already had ReadyAPI in place when I started.
Best Alternatives
BugzillaGitLabReadyAPI
Small Businesses
GitLab
GitLab
Score 8.7 out of 10
GitGuardian
GitGuardian
Score 9.0 out of 10
BrowserStack
BrowserStack
Score 8.4 out of 10
Medium-sized Companies
GitLab
GitLab
Score 8.7 out of 10
Veracode
Veracode
Score 8.7 out of 10
Oracle Application Testing Suite (legacy)
Oracle Application Testing Suite (legacy)
Score 8.0 out of 10
Enterprises
GitLab
GitLab
Score 8.7 out of 10
Veracode
Veracode
Score 8.7 out of 10
SoapUI Open Source
SoapUI Open Source
Score 8.4 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
BugzillaGitLabReadyAPI
Likelihood to Recommend
7.7
(18 ratings)
8.3
(152 ratings)
7.0
(65 ratings)
Likelihood to Renew
6.0
(10 ratings)
9.0
(5 ratings)
7.3
(18 ratings)
Usability
9.0
(3 ratings)
10.0
(6 ratings)
9.9
(3 ratings)
Availability
9.0
(3 ratings)
-
(0 ratings)
9.0
(1 ratings)
Performance
8.0
(2 ratings)
9.0
(1 ratings)
8.0
(1 ratings)
Support Rating
5.1
(3 ratings)
10.0
(12 ratings)
8.0
(6 ratings)
In-Person Training
9.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Implementation Rating
8.0
(2 ratings)
-
(0 ratings)
7.0
(1 ratings)
Configurability
9.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Ease of integration
9.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Product Scalability
9.0
(1 ratings)
10.0
(1 ratings)
7.0
(1 ratings)
Vendor post-sale
7.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
Vendor pre-sale
8.0
(1 ratings)
-
(0 ratings)
-
(0 ratings)
User Testimonials
BugzillaGitLabReadyAPI
Likelihood to Recommend
Open Source
Buzilla is easy to use and provides basic functionality to use as a bug tracking tool. If big size attachments are allowed it would have been great. Also with Bugzilla home->Test management area is improved by allowing multiple sections it would be awesome!
Read full review
GitLab
GitLab is good if you work a lot with code and do complex repository actions. It gives you a very good overview of what were the states of your branches and the files in them at different stages in time. It's also way easier and more efficient to write pipelines for CI\CD. It's easier to read and it's easier to write them. It takes fewer clicks to achieve the same things with GitLab than it does for competitor products.
Read full review
SmartBear
As stated, we do a LOT of API testing, the swaggerhub import makes it easy to add APIs. This is very well-suited, as well as easy management of the steps/cases/suites inside of ReadyAPI. The one thing I do wish ReadyAPI was better suited for is changes to data, we have a lot of test cases in ReadyAPI and if we make a change to how the backend data is structured, one-by-one adjustments need to be made to the steps. Less appropriate, UI testing.
Read full review
Pros
Open Source
  • Open source! No license fee involved, no limit to the number of licenses.
  • Easy to install and maintain. Installation is very easy and hardly needs any maintenance efforts, except when migrating from one version to other. Each project can have its own group of users.
  • Includes all the core features/fields that are needed to log a software bug/issue.
  • Multiple attachments are possible, supports various formats.
  • Good for reporting. Filtering mechanism lets you query bugs by various parameters.
Read full review
GitLab
  • GitLab excels in managing code versions, allowing easy tracking of changes, branch management, and merging contributions.
  • It helps maintain code stability and reliability, saving time and effort in the development or research workflow.
  • Powerful code review features, enabling collaboration and feedback among team members.
  • Robust project management features, including issue tracking, kanban boards, and milestones.
Read full review
SmartBear
  • Ease of use (ability to automatically import API definitions, Jenkins integration for running in the pipeline).
  • Detailed test reports (allow to easily identify weak spots during both functional and performance testing).
  • One platform for all tests (allows to closely couple and reuse existent tests).
Read full review
Cons
Open Source
  • Cloud Based. I'd like to see bugzilla be cloud based. The company I currently work with made a final decision to change db's for this specific reason. Due to the frequency of travel in this company, they need access to bugzilla from differing national / international locations.
  • Larger File Attachments. I believe the limit of a bugzilla content upload is 4 megabytes. For many of our video'd issues, this file size is simply impractical without the additional effort exertion on video compressor applications.
Read full review
GitLab
  • CI variables management is sometimes hard to use, for example, with File type variables. The scope of each variable is also hard to guess.
  • Access Token: there are too many types (Personal, Project, global..), and it is hard to identify the scope and where it comes from once created.
  • Runners: auto-scaled runners are for the moment hard to put in place, and monitoring is not easy.
Read full review
SmartBear
  • Needs good documentation
  • Need to improve the performance of the tool
  • Setup is very complex and for such [a] commercial tool, it should easy and straightforward
  • Tool says it supports security testing but in reality, it is not at an extensive level.
Read full review
Likelihood to Renew
Open Source
For future projects I will look at something that is hosted in the cloud that I don't have to manage. I would also like something that has a more modern feel to allow my customers to use it as well as my employees.
Read full review
GitLab
I really feel the platform has matured quite faster than others, and it is always at the top of its game compared to the different vendors like GitHub, Azure pipelines, CircleCI, Travis, Jenkins. Since it provides, agents, CI/CD, repository hosting, Secrets management, user management, and Single Sign on; among other features
Read full review
SmartBear
The only reason this isn't a '10' is because of the cost. This product is definitely meant for organizations who are serious about making sure they invest in the full ecosystem of API design, development, maintenance. But there is a significant cost associated with this investment. and because of this cost (and the non-tangible output for executives), it is a difficult line-item to justify in this post-pandemic environment.
Read full review
Usability
Open Source
This is a pretty straightforward system. You put in the bug details, a ticket is created, the team is notified. The user interface reflects this very simple and straightforward flow. It's certainly much easier than trying to track bugs with using Excel and email.
Read full review
GitLab
I find it easy to use, I haven't had to do the integration work, so that's why it is a 9/10, cause I can't speak to how easy that part was or the initial set up, but day to day use is great!
Read full review
SmartBear
SoapUI allows us to combine multiple tests and adhere
to the sequence that they need to run in order to complete successfully.
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing
Read full review
Reliability and Availability
Open Source
I used it.
Read full review
GitLab
I've never had experienced outages from GItlab itself, but regarding the code I have deployed to Gitlab, the history helps a lot to trace the cause of the issue or performing a rollback to go back to a working version
Read full review
SmartBear
Soap UI has managed to continuously build on it's solid foundation and keep improving by each release. It is by far the most dependable and accurate testing tool out there of its kind. Available via connecting to VM's created as SoapUI test machines give access to it anytime, anywhere practically.
Read full review
Performance
Open Source
I like this rating.
Read full review
GitLab
GItlab reponsiveness is amazing, has never left me IDLE. I've never had issues even with complex projects. I have not experienced any issues when integrating it with agents for example or SSO
Read full review
SmartBear
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing.
Read full review
Support Rating
Open Source
Since it is open source, it doesn't have customer service. However, the amount of information on forums is vast. If you can wade through it, you'll get what you need
Read full review
GitLab
At this point, I do not have much experience with Gitlab support as I have never had to engage them. They have documentation that is helpful, not quite as extensive as other documentation, but helpful nonetheless. They also seem to be relatively responsive on social media platforms (twitter) and really thrived when GitHub was acquired by Microsoft
Read full review
SmartBear
To be honest, we didnt had much issues with the support, as there is already plenty of online communities available for help. But if ever there were some minor issues with the membership or the certificates, the tech support was always quick and efficient enough to resolve the issue ASAP
Read full review
In-Person Training
Open Source
I know it.
Read full review
GitLab
No answers on this topic
SmartBear
No answers on this topic
Implementation Rating
Open Source
Implementation was pretty simple. Particularly because the product cannot be customized so there is not much to do apart from getting it up and running.
Read full review
GitLab
No answers on this topic
SmartBear
no very easy but lacks documentation
Read full review
Alternatives Considered
Open Source
We migrated away from the whole suite of Rational tools because of their massive complexity around administration and inflexibility regarding workflows. In addition, the suite was insanely expensive, and users hated the usability of the tools. We evaluated, and liked JIRA, but because the organization was looking for cost savings, we ended up going with Bugzilla and it's FOSS model so as to avoid ongoing costs.
Read full review
GitLab
Gitlab seems more cutting-edge than GitHub; however, its AI tools are not yet as mature as those of CoPilot. It feels like the next-generation product, so as we selected a tool for our startup, we decided to invest in the disruptor in the space. While there are fewer out-of-the-box templates for Gitlab, we have never discovered a lack of feature parity.
Read full review
SmartBear
ReadyAPI provides intuitive GUI capabilities compared to their own open source product. When compared to Postman, ReadyAPI also supports SOAP based services, which is a saver especially when integrating with legacy or other third party systems.
Read full review
Scalability
Open Source
I used it
Read full review
GitLab
I think is very well designed, and like any VCS it works as intended
Read full review
SmartBear
It has an excellent GUI design and the reporting mechanism is also very
good. It does consume a lot of memory though during concurrent testing. However, I have read that added monitoring tools have been added, which if so the 7 could possibly go to a 8 or 9.
Read full review
Return on Investment
Open Source
  • It has made the SDLC process more efficient. Bugs were logged and tracked in emails or in Excel sheets leading to slow communication and at time version issues with multiple files. Being an online tool, Bugzilla solved those issues, improved communication, instant status updates and improved efficiency.
  • We have used Bugzilla with a lot of federal goverment agencies (DHS, CMS, SAMHSA, CDC, HHS etc). Project Directors adn Principle Investigators were at times given access to Bugzilla which provided a snapshot of open vs closed issues.
  • Some groups would resist using Bugzilla with the email reminders being the main reason. Turning off or reminding them of features where we can 'control' email notification helped a lot.
Read full review
GitLab
  • GitLab cut down our spent on container, package and infrastructure registry
  • Best thing is we can now have everything in single platform which cost effective too
  • Quality of support is really good and they do have emergency support team as well which is great
Read full review
SmartBear
  • Very quick regression testing, hence having the testing results very soon, even the same day of deployment
  • for same above reason, it can save money for corporation (so no tedious, costly and erroneous manual testings)
  • The test reports are compatible with TestNG, so the corporation can integrate the reports in our Autamation frameworks such as Allure or Jira Zephyr
Read full review
ScreenShots

GitLab Screenshots

Screenshot of What is Intelligent Orchestration for DevSecOps?Screenshot of an overview of GitLab Duo Agent PlatformScreenshot of a new agent creation screen