blackfire.io vs. IBM DevOps Test Performance

Blackfire.io is super helpful in allowing proactive testing of applications before releasing on the production environment. Blackfire.io provides actionable insights to improve code proactively by integration with the development software. Also tracks the live production environment and is able to highlight any loading issues or unusual bounce rates. Blackfire.io also monitors HTTP requests and SQL queries which again help improve efficiency for developers and reduce development time.

Incentivized

Go for IBM RPT if: 1. You're testing a Java-based Web application with HTTP protocol 2. You wanted to distribute the load across machines easily 3. Your team is in learning phase/not really introduced to a wide range of performance testing tools Do not go for IBM RPT if: 1. You wanted to test REST or any other advanced protocols 2. Your system under test demands a very high user load 3. Your application is written in .NET or any other platform except Java.

Incentivized

• Provide details on processes eating up valuable server resources
• Alert against bottlenecks and find bottlenecks
• Performs load tests in code before moving to production environments

Incentivized

• Live Monitoring of Performance Testing Metrics
• Easier Test Data Parameterization
• Performance Tests Scheduler
• Server Resource Monitoring
• Great Reports that can be Exported as HTML Reports

• They count same API endpoint AND same method (e.g. POST, OPTIONS, GET etc) as different profiles
• Customer service needs a lot of improvement
• The documentation can be a bit more detailed to remove any scope of doubts

Incentivized

• Memory utilization could have been improved.(Eats up system's RAM)! It may crash if a test is conducted with the heavy load if adequate RAM is not available in the VM/host machine.
• Licensing could have been made simpler. IBM's licensing method is difficult to follow.
• Support for protocols other than HTTP. Not really up to the current trend.

Incentivized

blackfire.io definitely provides an edge over competing products such as Datadog due to the level of monitoring and analysis it provides. Datadog is a great tool however when evaluating and catching inefficiencies in lower non production environments, blackfire.io provides a level of reporting that were did not find any competing products.

Incentivized

IBM Rational Performance Tester is better in many aspects when compared to Apache JMeter. For example, you have ready made scripts to assist you, You have better monitoring of different performance metrics and can generate better reports that can be exported as HTML. The only downside of IBM RPT is that it can be very costly at times while JMeter is for free which is a huge advantage. That's why we try using in our organization a combination of both as much as we can.

• Reduce in bugs by 50%, more happy customers
• 2x decrease in load time for the website
• 100% performance validation before production release

Incentivized

• Accuracy in metrics, thus improving system's performance
• Costs less compared to competitor like HP LoadRunner
• Helped the team of beginners learn things quickly

Incentivized