IBM DevOps Test Performance vs. Tricentis Tosca

Go for IBM RPT if: 1. You're testing a Java-based Web application with HTTP protocol 2. You wanted to distribute the load across machines easily 3. Your team is in learning phase/not really introduced to a wide range of performance testing tools Do not go for IBM RPT if: 1. You wanted to test REST or any other advanced protocols 2. Your system under test demands a very high user load 3. Your application is written in .NET or any other platform except Java.

Incentivized

Tricentis Tosca is well suited for packaged applications like SAP, Salesforce, Workday, etc. It also works well with API testing and Web UI testing. Tosca is highly suited for Projects which require a high level of collaboration between team members across different locations. It's less suited for mobile automation, Reporting, and test scenarios with high input data.

Incentivized

• Live Monitoring of Performance Testing Metrics
• Easier Test Data Parameterization
• Performance Tests Scheduler
• Server Resource Monitoring
• Great Reports that can be Exported as HTML Reports

• It's one stop shop for all your test automation needs like - api layer, ui layer, load testing, mobile automation.
• It has excellent support for CI/CD and Devops environment which makes it very modern but much needed solution
• It can run in cross browser and cross devices with same test script and again saves a lot of time.
• Excellent results and dashboards gives nice view into results.

Incentivized

• Memory utilization could have been improved.(Eats up system's RAM)! It may crash if a test is conducted with the heavy load if adequate RAM is not available in the VM/host machine.
• Licensing could have been made simpler. IBM's licensing method is difficult to follow.
• Support for protocols other than HTTP. Not really up to the current trend.

Incentivized

• It does have a steep learning curve, A tool is often perceived capable of doing only what its user is able to achieve in accomplishing while using it. For this reason, its very necessary if for the team at Tricentis to continue doing the great work they are doing to train early adopters of this fantastic tool.

Incentivized

We aim to renew Tosca for our organization. What we lose in license cost is gained by having employee that do not need programming background. We also recoup a lot of the cost on the rapidity of automation. Only the support we might not use as much. I believe Tosca is here to stay at our organization

Incentivized

It can be a challenge for new users who have never used an automation tool. For example, it is hard to understand the layout of the screen and where to find how to update the data. The interface can be overwhelming at first.

Incentivized

Tricentis team was very supportive. Support is expensive but they helped us at many level. Setting up timeline, implementation, precise questions on automation challenges. We had an account manager and technical people we could as to talk to. Support was generally timely and helping. They often proposed to come on site to help us which would cost more but could be helpful

Incentivized

IBM Rational Performance Tester is better in many aspects when compared to Apache JMeter. For example, you have ready made scripts to assist you, You have better monitoring of different performance metrics and can generate better reports that can be exported as HTML. The only downside of IBM RPT is that it can be very costly at times while JMeter is for free which is a huge advantage. That's why we try using in our organization a combination of both as much as we can.

Tricentis Tosca is codeless and therefore easier to use. It's a great tool for people that would start doing automation and have no coding background. It seems like it has the same capabilities as other test automation suites but I felt it lacked a bit of capabilities on the test management suite such as defects test suites organizations etc

Incentivized

• Accuracy in metrics, thus improving system's performance
• Costs less compared to competitor like HP LoadRunner
• Helped the team of beginners learn things quickly

Incentivized

• After implementing Tosca we were able to reduce the cycle time that was spent on executing regression tests manually. I would say TOSCA was able to reduce close to 30% of the time that was spent for executing test cases manually.

Incentivized