Abhinandan H. Patil; Neena Goveas; Krishnan Rangarajan

Regression Test Suite Execution Time Analysis using Statistical Techniques

Full Text (PDF, 478KB), PP.33-41

Views: 0 Downloads: 0

Author(s)

Abhinandan H. Patil ^1,* Neena Goveas ¹ Krishnan Rangarajan ²

1. BITS Pilani, Goa CS and IS Dept, Goa, India

2. CMRIT, CSE Dept, Bangalore, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijeme.2016.03.04

Received: 12 Jan. 2016 / Revised: 24 Feb. 2016 / Accepted: 6 Apr. 2016 / Published: 8 May 2016

Index Terms

Statistical Techniques, Java Virtual Machine, Applied Statistical Techniques, Simulator Tools, Test Execution Time Reduction

Abstract

After applying techniques such as test design generation using combinatorial approach, test case selection, test suite minimization and prioritization, further reduction in execution time of the test suite is possible. This is necessary when there is scarcity of resources and time to execute the test suites. We investigate the statistical techniques which can be employed for analysis and reduction of test execution time further. The approach can help in extrapolating the execution time of test suite when the regression team wants to augment the test suite. The statistical techniques can aid in choosing the best test setup in terms of operating system, tool and Java virtual machine combination for given test setup. Further, these techniques are not the activities that need to be carried out before every execution of the test suite. Once the best combination is chosen the same can be used unless there is change in one of the layers of test setup. The activities mentioned in the paper can be part of test setup planning and maintenance phase.

Cite This Paper

Abhinandan H. Patil, Neena Goveas, Krishnan Rangarajan,"Regression Test Suite Execution Time Analysis using Statistical Techniques", International Journal of Education and Management Engineering(IJEME), Vol.6, No.3, pp.33-41, 2016. DOI: 10.5815/ijeme.2016.03.04

Reference

[1]Raj Jain, "The art of computer systems performance analysis", text book, 2010.

[2]Erwin Kreyszig, "Advanced Engineering Mathematics, 9th edition", textbook, 2011.

[3]B S Grewal, "Higher Engineering Mathematics, 41st edition", text book, 2014.

[4]JVM Hotspot command line arguments =http://www.oracle.com/technetwork/java/javase/tech/vmoptions-jsp-140102.html

[5]E. Aranha and P. Borba, "Estimating Manual Test Execution Effort and Capacity Based on Execution Points", International Journal of Computer and Application, .2009.

[6]Eduardo Henrique da Silva Aranha, "Estimating Test Execution Effort Based on Test Specifications", thesis, 2009.

[7]Imran Muneer, "Systematic Review on Automated Testing Types, Effort and ROI", thesis, 2014.

[8]Suresh Nageswaran, "Test Effort Estimation Using Use Case Points", Quality week, 2001.

[9]Bartolomeo Ovilio, "Test effort and test coverage: correlation analysis in a safety critical operating system", thesis, 2012.

[10]Test environment management best practices = http://www.softwaretestinghelp.com/test-bed-test-environment-management-best-practices/

[11]Tong-Yu Hsieh, Kuen-Jong Lee and Jian-Jhih You, "Test Efficiency Analysis and Improvement of SOC Test Platforms", 16th IEEE Asian Test Symposium, 2007.

[12]Luay Tahat, Bogdan Korel, Mark Harman and Hasan Ural, "Regression Test Suite Prioritization using System Models", Wiley online Library, 2011.

[13]Aditya P. Mathur, "Foundations of software testing", text book, 2013.

[14]Paul C. Jorgensen, "Software testing a craftman's approach", text book, 2013.

[15]J. V. Oenen, "Improving regression test code coverage using meta heuristics", Thesis, 2010

International Journal of Education and Management Engineering (IJEME)