BlazeMeter vs. National Instruments SystemLink vs. VMware Cloud Foundation

It is well suited for applications that are mission-critical or applications that can receive high traffic/transactions at unscheduled time periods. Using the load testing feature of BlazeMeter, we can test and ascertain the capacity of the application without the drawbacks of the usual Apache JMeter load testing which depends heavily on the host system from where the load testing is performed.

Incentivized

There are definitely scenarios where NI SystemLink will be useful but just didn't work out well for us. I needed to be able to replace an EXE file on a computer with a new EXE to do the upgrades but I was not able to do that through SystemLink. You had to work with packages in order to perform this and I didn't want to revamp my distribution plan. We also didn't need to do any asset management or calibration documentation through SystemLink. I was excited about being able to view data from the test stations through a browser but our engineers need historical data available and everything resets to a live view when you click back to the UI.

Incentivized

It is best suited for an on-premise cloud solution where customer can shift their entire production environment. Also, the customer has a preference for a Homogenous Infrastructure Environment where budget is not a challenge. It is not at all suited for a Heterogenous Environment, e.g., a Public cloud where integration becomes a huge issue, also in SMB sections where budget is challenging.

Incentivized

• BlazeMeter takes the .jmx script that teams had written for JMeter. The transition from JMeter to BlazeMeter was seamless.
• BlazeMeter offers its own cloud and hence we did not have to set it up on-premise.
• BlazeMeter hits our application from various geographic locations that simulates real life users.

Incentivized

• Setup
• User Interface
• LabVIEW Integration

Incentivized

• Cloud enabled Solution.
• Support Container based Apps.
• Cost efficient.
• Supports both Public and Private Environments.

Incentivized

• Blazemeter reporting is very basic and shallow. There is no way to drill down or correlate. I can get better reports by using JMeter for free.
• Blazemeter is very costly. Testing with volumes of more than 1K cu is expensive, and can be done for much cheaper if a company/team is willing to invest a bit of time to figure out how to use cloud instances and jmeter slaves, and to write a basic script to collect resulting xml output.

Incentivized

• Licensing
• Not able to see data from all test stations on one UI
• Lack of data history

Incentivized

• The Deployment is complex.
• Recommended Number of Physical Nodes is three or more; with less than 3 Nodes, it becomes difficult to install V-SAN.
• Need for better integration. If we go on the public cloud, it is a huge challenge while integrate with an open source platform.
• Cost can be marginally reduced. SMB segments still prefer a separate license instead of VCF, or they postpone their purchase plans.

Incentivized

Easy to setup to do API Performance Testing. Dashboard to showcase results Capability to showcase runtime results

Incentivized

In comparison with Blazemeter the closes competitor is JMeter but it has disadvantages like it is not a tool that can be use as a collaborative tool and works locally in a computer, Blazemeter is in the web so different people can access and run tests or collaborate do add, edit or delete the existent scripts.

Incentivized

Although the public Cloud Model follows Opex Costing Model, it actually leads to very high costs also, the infra model in my organization is not suited for a Public Cloud Model. Hence We decided on an On-Premise Model, and the best suited was VMware Cloud Foundation, which is a complete Software-Defined Scale-Out Architecture. I also prefer a Homogenous environment; i.e, support and services from a Single OEM, so that I Can get faster resolutions to my tickets raised.

Incentivized

• It helped positively by helping to identify the maximum capacity needed for high traffic periods
• Saved revenue by eliminating unwanted duplication of systems

Incentivized

• Availability to monitor multiple test stations remotely
• Was quick to integrate into existing LabVIEW codebase
• Ultimately did not justify the licensing cost for the benefit

Incentivized

• My organization has a size of 1300+ employees, using multiple applications and an exchange mail server that is hosted on On-Premise Cloud, hence scalability has not been a challenge.
• Having hosted my Production environment and Mail exchange Server on VCF, there has been optimum resource utilization with very little scope downtime. Hence have been able to save a lot of funds on Hardware resources.
• Due to the size of my organization and due the data load, I have been able to save on Resource Utilization and Organization Funds

Incentivized