blackfire.io vs. CA Application Test vs. New Relic

Blackfire.io is super helpful in allowing proactive testing of applications before releasing on the production environment. Blackfire.io provides actionable insights to improve code proactively by integration with the development software. Also tracks the live production environment and is able to highlight any loading issues or unusual bounce rates. Blackfire.io also monitors HTTP requests and SQL queries which again help improve efficiency for developers and reduce development time.

Incentivized

IF you are looking for api testing solution along with service virtualization, then look no further than this tool. This tool also forces you to move your testing lifecycle to much earlier phases of development which helps overall SDLC.

Incentivized

New Relic its an excellent tool for monitoring services used on the SAAS universe, like web servers, relational and nosql dbms, reverse proxies, text databases, etc. Its also a powerful tool to monitor resource usage on said servers. However, its not well fitted to monitor custom services - if you need to generate alerts based on logs or database information, for example

Incentivized

• Provide details on processes eating up valuable server resources
• Alert against bottlenecks and find bottlenecks
• Performs load tests in code before moving to production environments

Incentivized

• It immensely helps to change your entire testing lifecycle approach and to implement Shift Left approach with the extensive emphasis on testing the api's.
• This is a great tool to implement Service virtualization for your and/or third-party web services. This will ensure we have 100% environment availability and consistency for automation and performance test environments.
• This tool also helps you with test data setup and management which is a very crucial piece of test automation.
• It also helps us to implement performance testing for apis using the Blazemeter.

Incentivized

• It gives us insights of applications, infrastructure, clouds very well.
• The alerting system in New Relic helps us to easily identify the root cause which reduces the MTTR.
• It has new features related to AI which helps to troubleshoot any problem in a very short time it gives future predictions also.

Incentivized

• They count same API endpoint AND same method (e.g. POST, OPTIONS, GET etc) as different profiles
• Customer service needs a lot of improvement
• The documentation can be a bit more detailed to remove any scope of doubts

Incentivized

• This tool comes with a license cost and not free. Many open source tools offer free api testing solution and so making some functionality of this tool as open source would be good
• Load testing piece is not integrated with in the tool and rather uses Blaze meter which is free.
• Some integration with UI and api testing will make this tool even more attractive

Incentivized

• And while powerful, building tailored dashboards with organ-specific metrics (such as energy load variance across regions) can be difficult to navigate. The UI isn't as drag-and-drop easy, and query-based widgets typically involve some trial and error for non-devs.
• Alerts may be hypersensitive or over general. I We often get a spam of non-critical alerts while doing load testing, all overhauling to me alone and making it difficult to identify actual issues especially in energy systems where spikes are very common.
• With our expanding fleet of Iot devices, the per-host pricing model is becoming expensive, quickly. More detailed billing based on microservices, or that works at sensor level, would make it more adaptable for energy platforms.

Incentivized

The only issue that we have had with New Relic is that the price might be a little expensive for smaller companies. The amount of data you store in New Relic impacts the cost, and can get away from you if you don't work closely with the vendor. Overall though the application is top notch.

Incentivized

I have given this much rating as I am used New Relic in different sectors and for different use cases like its K8s monitoring, infra monitoring, full stack monitoring as compare to other tools New Relic gives data in a formatted and connected way, and also it is giving us value for money. It also launches new features day by day which helps users to track the issue very quickly. It also supports OTel integrations which is the latest trend of observability tools. thats why I had given this much rating to New Relic.

Incentivized

Never observed an outage

Incentivized

there are times where browser cache will cause issues that require you to clear your browser before continuing.

Incentivized

The support team has been really helpful and resolved most of the issues on time. However, for a couple of issues, several follow-ups were needed to elicit a reasonable response. The issue was deeply technical and could have been investigated only by their Architects, and bringing them into the ticket took longer than needed

Incentivized

It's better to start by implementing New Relic in one project and test everything. Try to follow best recommended practices and read all the official documentation. Everything seems well tested. Then, start by installing agents to the rest of your projects and keep a close look to all logs and metrics New Relic gives you.

blackfire.io definitely provides an edge over competing products such as Datadog due to the level of monitoring and analysis it provides. Datadog is a great tool however when evaluating and catching inefficiencies in lower non production environments, blackfire.io provides a level of reporting that were did not find any competing products.

Incentivized

It definitely is among the top leaders in API testing and virtualization along with the Parasoft SOA tool. Many open source API testing libraries such as Rest Assured, Karate and even Postman and SOAP UI are free which is a little bit against CA.

Incentivized

Data Dog has solutions that look more attractive, but not at their price point. We have also tried to build a solution straight from the Cloud, where our business is built, but some things are too hard to replicate. This shows that New Relic is useful and helps our efficiency.

Incentivized

Agent deployment is easily integrated into our workflow. Adding the agent to new servers is quick and painless

Incentivized

• Reduce in bugs by 50%, more happy customers
• 2x decrease in load time for the website
• 100% performance validation before production release

Incentivized

• This tool gave a very positive ROI in our group. Especially with service virtualization where we minimized the downtime in our test environments significantly.
• Also, service virtualization helps to minimize the costs of hitting third party services often in lower environments.

Incentivized

• We were able to quickly identify our most time consuming APIs. In some cases we were able to bring down times for some apis from 4s to 200ms.
• We were able to identify our slowest database queries and optimize them for quicker response times.

Incentivized