The 1st International Workshop on Load Testing of Large Software Systems (LT2012)

The following is an article on load testing.

"Modern software systems ranging from e-commerce websites to telecommunication infrastructures must support concurrent access by hundreds or thousands of users. Many field problems are related to these systems not scaling to field workloads, rather than to feature bugs. To assure the quality of these systems, load testing is a required testing procedure in addition to conventional functional testing procedures like unit and integration testing.

Load testing examines the behavior of a system by simulating hundreds or thousands of users performing tasks at the same time. A load test can last from several hours to a few days. Unlike many other software testing mechanisms that focus on testing the system based on a small number (one or two) of users, load testing examines the system’s behavior based on concurrent access by a large number (thousands or millions) of users.

Load testing is a difficult task requiring a great understanding of the application under test. Yet, load testing has received relatively little attention in the software testing research community. Moreover, prior load testing research have been largely focused on telecommunication applications and web-based e-commerce systems. Industry has been focused primarily on creating tools to automatically drive specified load into the system under test (e.g., LoadRunner and Apache JMeter). Furthermore, load testing is gaining more importance, as an increasing number of services are being offered in the cloud to millions of users.

The goal of this workshop is to bring together software testing researchers, practitioners, and load testing tool developers to discuss the challenges and opportunities of conducting load testing research on large scale software systems. We expect that the presentations and discussions in this workshop will raise awareness of load testing in the software testing academic research community. Furthermore, we expect that the panels and working sessions would provide networking opportunities for world class load testing researchers. Finally, we hope this workshop would facilitate collaborations between the academic and industrial researchers by providing academics access to large real-life software systems and load testing infrastructures. Our ultimate goal is to establish and grow an active community around this important and practical research topic.

This workshop has not been held previously. We expect the workshop participants to be a mixture of academic and industrial researchers. The workshop will be one day long. It is preferred to be held before the main ICST conference.

A big emphasis of this workshop will be on making the workshop interactive with many discussion slot assigned throughout the schedule (including paper discussions, panels and working sessions). The panel would bring together industrial and academic researchers to discuss the opportunities and challenges in the afternoon. The working session is expected to provide hands-on experience on enabling participants to expose to the real load testing problems at the end of the day.

Papers should be at most 4 pages in IEEE format. The submitted papers can be research papers, position papers, case studies or experience reports to address the issues including but not limited to the following:
Leveraging the extensive software testing literature to solve load testing challenges;
Proposals on new approaches:
o Optimal planning of load tests to reduce the number of needed resources to conduct large scale load tests;
o Efficient analysis of load test results - Techniques for analyzing the large volume of system behavior data (e.g., execution logs and performance counters);
o Optimized execution of load tests to reduce the number and duration of tests;
o Development of realistic load tests;
o Load testing on for adaptive/autonomic systems;
o Leveraging cloud computing to conduct load testing;
Case studies and experience reports on load testing large scale applications;
The accepted papers would be published in the ICST 2012 Proceedings and will adhere to the deadlines for submission and notifications dates suggested by the workshop co-chairs in order to make the camera-ready deadlines."

A good article about load testing.