Load Testing with JMeter: Part 2 - Headless Testing and Jenkins Integration
The following is an article on load testing by Brandon Konkle.
"If you read Part 1 of my JMeter series, you now know how to create a JMeter performance test with as much complexity as you need to hit every part of your application and push it to its limits. As mentioned at the end of the post, though, when running your test plan from your local machine you are often limited by bandwidth. The test plan may not be able to fully stress your application because it can’t transfer data fast enough for all of your concurrent connections. To really push your application hard, you need to run your load test from the same local network that your application runs within.
If you’re testing your staging or production infrastructure, you could run JMeter from a dev server within the same network. If you’re on a cloud platform, you could manually spin up an image with JMeter on-demand whenever you want to run a load test. Wherever you put it, you just want to make sure that you’re not running JMeter from one of the servers that you will be testing. The load imposed on the test machine will almost definitely skew your performance results.
On Debian-based distributions like Ubuntu, JMeter is very easy to install.
$ sudo apt-get install jmeter
Once installed, you can simply clone the repository containing your test plan right into the home directory of your user on the test machine. Then you can switch to the directory housing your plan, and run JMeter with the options below.
$ jmeter -n -p user.properties -t my_test_plan.jmx -l my_results.jtl
The ”-n” option tells JMeter to run in headless “nogui” mode. The ”-p” option explicitly instructs JMeter to use your user.properties file. The ”-t” options points JMeter to your test plan. The ”-l” option outputs the results of the run to a log file. This log file is important – it’s how you’ll view the results of your test run when it is complete.
Reviewing the Log
When your test plan is done, you’ll be returned to the command prompt. You can then copy your newly created .jtl file over to your local machine so that you can begin reviewing your results. Open your test plan on your local machine using JMeter’s GUI, and take a look at one of your listeners. You should see a section that says “Write results to file / Read from file”. Click on the “Browse” button there, and navigate to your .jtl file.
When you open your log file, your listener should be filled with data that you can now review just like you would if you had run the test locally.
Integrating with Jenkins
If you use Jenkins (the continuous integration tool formerly known as Hudson), then you can take advantage of the Performance Plugin to easily trigger JMeter runs from your Jenkins server and review graphical results illustrating performance trends.
To install the performance plugin, navigate to “Manage Jenkins → Manage Plugins → Available → Performance Plugin”. Select the plugin, click on the “Install” button at the bottom of the screen, and you’re ready to go.
There are many ways to configure the plugin, but one way that we’ve found effective is to simply create a separate job for the JMeter tests set it to run on a regular schedule, such as nightly at midnight. In the job configuration, add the source control information so that Jenkins will check out your test plan in the job workspace. Under “Build Triggers”, select “Build periodically” and add a cron-style schedule.
# midnight PST = 7am UTC
0 7 * * *
Next, you’ll want to create a simple script to run the performance test from the job workspace.
echo "### Running JMeter performance test ###"
# Clear out old results
# Run the tests
echo "## Running the tests"
jmeter -n -t test_plan.jmx -l $WORKSPACE/jmeter.jtl -p user.properties
Save this script in your test plan folder and then refer to it in the “Build” category of the job config using something like the line below in the “Command” text area.
In the “Post-build Actions”, enable the “Publish Performance test result report” action. In the “Report files” field, point the plugin to your log file.
At this point you can save the config, and you’re done! The performance test will run regularly on the schedule you entered, or you can run a test at any time using “Build Now”.
That’s it for today! You should now be able to sufficiently hammer your application, and hammer it on a regular schedule so that you can spot performance problems as they are introduced.
For the last post in my JMeter series, I’ll demonstrate how to use JMeter and Python to replay Apache logs and measure the results. This is very useful for recreating production load, so that you can see how your code reacts to traffic that is even closer to real life."
A well written article by Brandon Konkle.