期刊
ACM COMPUTING SURVEYS
卷 43, 期 2, 页码 -出版社
ASSOC COMPUTING MACHINERY
DOI: 10.1145/1883612.1883618
关键词
Design; Experimentation; Reliability; Verification; Software testing; combinatorial testing (CT); test case generation; covering array
资金
- National Natural Science Foundation of China [60773104, 60721002, 90818027]
- 863 high technical plan of China [2008AA01Z143, 2009AA01Z147]
- Chinese Scholarship Council in CREST (Center for Research in Evolution, Search, and Testing), King's College London
Combinatorial Testing (CT) can detect failures triggered by interactions of parameters in the Software Under Test (SUT) with a covering array test suite generated by some sampling mechanisms. It has been an active field of research in the last twenty years. This article aims to review previous work on CT, highlights the evolution of CT, and identifies important issues, methods, and applications of CT, with the goal of supporting and directing future practice and research in this area. First, we present the basic concepts and notations of CT. Second, we classify the research on CT into the following categories: modeling for CT, test suite generation, constraints, failure diagnosis, prioritization, metric, evaluation, testing procedure and the application of CT. For each of the categories, we survey the motivation, key issues, solutions, and the current state of research. Then, we review the contribution from different research groups, and present the growing trend of CT research. Finally, we recommend directions for future CT research, including: (1) modeling for CT, (2) improving the existing test suite generation algorithm, (3) improving analysis of testing result, (4) exploring the application of CT to different levels of testing and additional types of systems, (5) conducting more empirical studies to fully understand limitations and strengths of CT, and (6) combining CT with other testing techniques.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据