IBM DevOps Test Performance vs. QAComplete

Go for IBM RPT if: 1. You're testing a Java-based Web application with HTTP protocol 2. You wanted to distribute the load across machines easily 3. Your team is in learning phase/not really introduced to a wide range of performance testing tools Do not go for IBM RPT if: 1. You wanted to test REST or any other advanced protocols 2. Your system under test demands a very high user load 3. Your application is written in .NET or any other platform except Java.

Incentivized

I think QAComplete is a great way to organize the literal hundreds of development bugs that are discovered throughout an agile-based project. Teams aren't always able to hotfix items on the fly and this tool provides a great repository and facility for storing and prioritizing those technical debt items that may get overlooked from sprint to sprint. It also let's everyone on the team get a clear understanding for project progress.

Incentivized

• Live Monitoring of Performance Testing Metrics
• Easier Test Data Parameterization
• Performance Tests Scheduler
• Server Resource Monitoring
• Great Reports that can be Exported as HTML Reports

• Allows us to create individual tests then group them into comprehensive test plans.
• Allows me to specify custom fields that match our product features to categorize both tests and defects.
• Allows me to create a series of requirements then match tests against them for validation.

Incentivized

• Memory utilization could have been improved.(Eats up system's RAM)! It may crash if a test is conducted with the heavy load if adequate RAM is not available in the VM/host machine.
• Licensing could have been made simpler. IBM's licensing method is difficult to follow.
• Support for protocols other than HTTP. Not really up to the current trend.

Incentivized

• The user interface can be somewhat perplexing and difficult to navigate at times.
• Naming conventions aren't always succinct and additional training is needed by those who have more experience using the program.
• A modern refresh of the UI would help keep the product from looking dated.

Incentivized

I gave QAComplete this rating because though I do feel that it is a powerful tool, it's definitely not designed for the everyday user. Obviously the target demographic is QA specialists who should be team members that are very technical and methodical in their approaches. However, for the rest of the team, it can often time prove difficult to navigate. Also, the UI is in need of a serious refresh.

Incentivized

I have not had to work with their customer service directly yet. Our client has been utilizing this tool for years, so I would assume that the support they have received would be good enough to keep them wanting to continue to use the product.

Incentivized

IBM Rational Performance Tester is better in many aspects when compared to Apache JMeter. For example, you have ready made scripts to assist you, You have better monitoring of different performance metrics and can generate better reports that can be exported as HTML. The only downside of IBM RPT is that it can be very costly at times while JMeter is for free which is a huge advantage. That's why we try using in our organization a combination of both as much as we can.

A comprehensive solution

Incentivized

• Accuracy in metrics, thus improving system's performance
• Costs less compared to competitor like HP LoadRunner
• Helped the team of beginners learn things quickly

Incentivized

• Helped us in increase the quality of our firmware releases.
• Helps us continuously improve our testing

Incentivized