Close

June 6, 2017

How to run Apache JMeter tests with Visual Studio Team Services?

Apache JMeter tests with Visual Studio Team Services

How to run Apache JMeter tests with Visual Studio Team Services? Do you know that it is possible to run your Apache JMeter tests with Visual Studio Team Services for free? Keep reading this article to know about how to run Apache JMeter tests with Visual Studio Team Services. VSTS allows developers or testers to unit test, manual test, load test, exploratory test and continuous test. Also, VSTS has lots of features such as Git, TFVC, Agile Tools, CI, tools for Java, Release Management, Cloud based testing, testing tools and effective reporting utilities and many more.

Prerequisites

Before you begin the load test, all you need is to create a free VSTS account here. This will create a subdomain with visualstudio.com as shown below.

VSTS Account

VSTS Account

Click on New team project to create a new project. Once it is created, go to that project and then click on Test > Load Test as shown below.

Test > Load Test

How to run Apache JMeter tests with Visual Studio Team Services?

How to create Apache JMeter tests with VSTS?

To create and execute high-scale load test in JMeter and analyze the results, click on Create test button as shown below.

Create Test

Create Test

Upon clicking on Create test, you will need to fill below fields as shown below. Select the Load location to select the load generator location. Click on Run Test button to start the load test.

Upload JMeter script

Upload JMeter script

During the run time, you can view the performance statistics as shown below. You can abort the test by clicking on Abort button. You can learn about the performance metrics in this link.

Important Note: You should upload valid JMeter test plan to execute the test successfully. E.g. your test plan must not have any listeners enabled.

Acquiring resources

Acquiring resources

Once the execution is done, you can view the results. Below is the sample results of the load test.

Sample Load Test Results

Sample Load Test Results

Apart from JMeter test, it is possible to create URL based test, Visual Studio test, and HTTP Archive based test.

Types of Tests in VSTS

Types of Tests in VSTS

Cons of running Apache JMeter tests with Visual Studio Team Services

There are few disadvantages of running Apache JMeter tests in VSTS.

  • VSTS supports only Apache JMeter 2.13. JMeter 2.13 is pretty outdated. Lots of enhancements and bug fixes have been in JMeter 3.12.
  • It supports only HTTP samplers.
  • To pass the custom properties, you need to upload the *.properties in supporting files field.
  • You get 20000 virtual user minutes for free, but of your tests requires beyond that, you need to purchase the additional minutes. Maximum number of users you can inject is 100 crore.
  • Only 13 locations are available for load test

Also, it is possible to leverage VSTS APIs for load test. Using the APIs, you can start/stop the test, get the results, get exceptions, get all the test status, get application counters, get samplers details and get messages of the load tests. For more details, you can check this link.

Your turn: Have you executed any JMeter tests from VSTS? If yes, please share your experience.

Check out our brand new web app called PerfTractor – compare performance testing tools prices.

About NaveenKumar Namachivayam

Hi there! is a passionate and experienced Performance Test Analyst based in Chicago, USA with skill sets in Manual Testing, Test Automation, Performance Testing, and Test Estimation. He loves to learn and experiment new trends and models in Software Testing. Please stop by at his personal blogs: Excel Blog, DealsBrook, NaveenKumarN.in, and Affiliate Insights blog and Software Testing Memes.

Leave a Reply

Your email address will not be published. Required fields are marked *