4.2 Article

Dynamic test planning: a study in an industrial context

Publisher

SPRINGER HEIDELBERG
DOI: 10.1007/s10009-014-0319-0

Keywords

Test planning; Reliability growth model; Resource allocation; Risk-based testing; Mission-critical systems

Ask authors/readers for more resources

Testing accounts for a relevant part of the production cost of complex or critical software systems. Nevertheless, time and resources budgeted to testing are often underestimated with respect to the target quality goals. Test managers need engineering methods to perform appropriate choices in spending testing resources, so as to maximize the outcome. We present a method to dynamically allocate testing resources to software components minimizing the estimated number of residual defects and/or the estimated residual defect density. We discuss the application to a real-world critical system in the homeland security domain. We describe a support tool aimed at easing industrial technology transfer by hiding to practitioners the mathematical details of the method application.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Software Engineering

DevOpRET: Continuous reliability testing in DevOps

Antonia Bertolino, Guglielmo De Angelis, Antonio Guerriero, Breno Miranda, Roberto Pietrantuono, Stefano Russo

Summary: In DevOps practices, candidate software releases need to pass quality gates and meet key indicators, with software reliability being an important one. This research proposes DevOpRET, a reliability testing approach that utilizes operational-profile-based testing and usage/failure data to evaluate software reliability.

JOURNAL OF SOFTWARE-EVOLUTION AND PROCESS (2023)

Article Engineering, Industrial

Reliability assessment of service-based software under operational profile uncertainty

Roberto Pietrantuono, Peter Popov, Stefano Russo

RELIABILITY ENGINEERING & SYSTEM SAFETY (2020)

Article Computer Science, Software Engineering

Adaptive Test Case Allocation, Selection and Generation Using Coverage Spectrum and Operational Profile

Antonia Bertolino, Breno Miranda, Roberto Pietrantuono, Stefano Russo

Summary: The study presents an adaptive software testing strategy covrel+, which combines operational profile and coverage spectrum to enhance the reliability of the test program. Experimental results show that this strategy generally outperforms traditional operational testing in achieving a given reliability target or detecting faults within the same testing budget, with greater ability to detect hard-to-detect faults.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2021)

Article Computer Science, Theory & Methods

A Survey of Field-based Testing Techniques

Antonia Bertolino, Pietro Braione, Guglielmo De Angelis, Luca Gazzola, Fitsum Kifetew, Leonardo Mariani, Matteo Orru, Mauro Pezze, Roberto Pietrantuono, Stefano Russo, Paolo Tonella

Summary: Field testing refers to testing techniques that uncover faults missed during in-house testing by operating in the field. It is becoming more popular as software systems become more complex. By categorizing field testing approaches based on environment and system, and addressing research questions related to field testing requirements and management, this article highlights challenging research directions in field testing.

ACM COMPUTING SURVEYS (2021)

Article Computer Science, Software Engineering

Software micro-rejuvenation for Android mobile systems✩

Domenico Cotroneo, Luigi De Simone, Roberto Natella, Roberto Pietrantuono, Stefano Russo

Summary: The article introduces a configurable micro-rejuvenation technique to counter software aging in Android-based mobile devices, focusing on fine-grained manipulation of system data structures. Experimental results demonstrate significant improvements in responsiveness and time to failure of mobile operating systems.

JOURNAL OF SYSTEMS AND SOFTWARE (2022)

Article Computer Science, Hardware & Architecture

A Comparative Analysis of Software Aging in Image Classifiers on Cloud and Edge

Ermeson Andrade, Roberto Pietrantuono, Fumio Machida, Domenico Cotroneo

Summary: This paper investigates the software aging issue in an image classification system running on cloud and edge computing environments, and analyzes the degradation trends in system performance and memory resources. It is found that the edge environment has less impact on performance degradation compared to the cloud environment under high workload, despite having fewer allocated memory resources.

IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING (2023)

Article Computer Science, Theory & Methods

Survivability Analysis of IoT Systems Under Resource Exhausting Attacks

Roberto Pietrantuono, Massimo Ficco, Francesco Palmieri

Summary: This paper proposes a hybrid method to assess the survivability of an IoT system under resource-exhaustion attacks and optimize the preventive maintenance trigger period. The method combines measurements and model-based analysis to estimate resource consumption and simulate system behavior during attacks.

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY (2023)

Proceedings Paper Computer Science, Software Engineering

Microservices Integrated Performance and Reliability Testing

Matteo Camilli, Antonio Guerriero, Andrea Janes, Barbara Russo, Stefano Russo

Summary: Continuous quality assurance for extra-functional properties of modern software systems is a challenge. We propose a novel methodology and platform, called MIPaRT, for automatically testing the performance and reliability of microservice operations. The platform supports continuous testing and monitoring, and provides additional insights into the performance and reliability behavior of microservices.

3RD ACM/IEEE INTERNATIONAL CONFERENCE ON AUTOMATION OF SOFTWARE TEST (AST 2022) (2022)

Proceedings Paper Computer Science, Software Engineering

Memory Degradation Analysis in Private and Public Cloud Environments

Ermeson Andrade, Fumio Machida, Roberto Pietrantuono, Domenico Cotroneo

Summary: The study indicates that memory degradation trends in cloud computing environments have significant impacts on the performance and stability of applications. Through experimental investigation in private and public cloud environments, potential causes of memory degradation were identified.

2021 IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2021) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Automated Hypotheses Generation via Combinatorial Causal Optimization

Roberto Pietrantuono

Summary: The article introduces a new class called Combinatorial Causal Optimization Problems (CCOP) and discusses its application in causal inference. The research uses optimization algorithms to automatically construct cause-effect solutions for plausibility and novelty, providing useful solutions for real-world problems in various domains.

2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021) (2021)

Proceedings Paper Computer Science, Software Engineering

Learning-to-Rank vs Ranking-to-Learn: Strategies for Regression Testing in Continuous Integration

Antonia Bertolino, Antonio Guerriero, Breno Miranda, Roberto Pietrantuono, Stefano Russo

2020 ACM/IEEE 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2020) (2020)

No Data Available