UPM Institutional Repository

An experimental assessment of module documentation-based testing.


Baharom, Salmi and Shukur, Zarina (2011) An experimental assessment of module documentation-based testing. Information and Software Technology, 53 (7). pp. 747-760. ISSN 0950-5849


Context: Testing a module that has memory using the black-box approach has been found to be expensive and relatively ineffective. Instead, testing without knowledge of the specifications (white-box approach) may not be effective in showing whether a program has been properly implemented as stated in its specifications. We propose instead a grey-box approach called Module Documentation-based Testing or MD-Test, the heart of which is an automatic generation of the test oracle from the external and internal views of the module. Objective: This paper presents an empirical analysis and comparison of MD-Test against three existing testing tools. Method: The experiment was conducted using a mutation-testing approach, in two phases that assess the capability of MD-Test in general and its capability of evaluating test results in particular. Results: The results of the general assessment indicate that MD-Test is more effective than the other three tools under comparison, where it is able to detect all faults. The second phase of the experiment, which is significant to this study, compares the capabilities of MD-Test and JUnit-black using the test evaluation results. Likewise, an analysis of the test evaluation results shows that MD-Test is more effective and efficient, where MD-Test is able to detect at least the same number of faults as, or is at par with, the black-box approach. Conclusion: It is concluded that test evaluation using grey-box approach is more effective and efficient that the black-box approach when testing a module that has memory.

Download File

PDF (Abstract)
An experimental assessment of module documentation.pdf

Download (85kB) | Preview

Additional Metadata

Item Type: Article
Divisions: Faculty of Computer Science and Information Technology
DOI Number: https://doi.org/10.1016/j.infsof.2011.01.005
Publisher: Elsevier
Keywords: Specification-based testing; Grey-box testing; Automated module testing; Mutation-testing
Depositing User: Mohamad Jefri Mohamed Fauzi
Date Deposited: 28 Nov 2013 06:15
Last Modified: 28 Aug 2015 00:49
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.1016/j.infsof.2011.01.005
URI: http://psasir.upm.edu.my/id/eprint/18476
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item