4.7 Article

Expert judgments for performance shaping Factors' multiplier design in human reliability analysis

Journal

RELIABILITY ENGINEERING & SYSTEM SAFETY
Volume 194, Issue -, Pages -

Publisher

ELSEVIER SCI LTD
DOI: 10.1016/j.ress.2018.12.022

Keywords

Human reliability analysis; Performance shaping factors; Expert judgment; Absolute probability judgment; Ratio magnitude estimation

Funding

  1. National Natural Science Foundation of China [71601139, 71371104]
  2. Advanced Pressurized Water Reactor NPP Key Project [2011ZX06002]
  3. National Key R&D Program of China [2017YFF0208001]

Ask authors/readers for more resources

Human reliability analysis (HRA) still heavily relies on expert judgments to generate reliability data. There exists a widely recognized need to validate and justify the reliability data obtained from expert judgments. For demonstrating such effort, we provide a template of how we base expert elicitations and empirical studies to derive the multipliers of performance shaping factors (PSFs). We applied two expert judgment techniques-absolute probability judgment (APJ) and ratio magnitude estimation (RME)-to update the PSF multiplier design in Standardized Plant Analysis of Risk-Human Reliability Analysis (SPAR-H). Licensed operators (N = 17) from a nuclear power plant were recruited. It is found that APJ and RME have acceptable inter-rater reliability and convergent validity between them. The multipliers estimated by APJ and RME were compared with those from empirical studies in the human performance literature. Certain consistencies between these heterogeneous data sources were found. Combining these heterogeneous data, we suggested the multiplier design of PSFs for SPAR-H. We also bridged the relationship between every PSF and its psychological mechanism to trigger human errors. Our work might suggest the appropriateness of expert elicitations in generating useful data for HRA, and strengthen the empirical and psychological foundations of PSF-based HRA methods.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Public, Environmental & Occupational Health

Blame Attribution Asymmetry in Human-Automation Cooperation

Peng Liu, Yong Du

Summary: The study found that people tend to attribute more blame to automation systems in semi-autonomous vehicle accidents, a bias known as blame attribution asymmetry, partially due to the higher negative affect triggered by the automation-caused crash. This bias has implications for policies as it may lead to negative consequences.

RISK ANALYSIS (2022)

Article Computer Science, Cybernetics

Selfish or Utilitarian Automated Vehicles? Deontological Evaluation and Public Acceptance

Peng Liu, Jinting Liu

Summary: The study found that participants were more inclined to accept AVs programmed with selfish algorithms, predicting greater intention to use and willingness to pay a premium for them. While there were no significant differences in deontological evaluation and perceived risk between the AV types, perceived benefit and perceived risk were predictive of behavioral intention.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2021)

Article Computer Science, Cybernetics

Sharing the Roads: Robot Drivers (Vs. Human Drivers) Might Provoke Greater Driving Anger When They Perform Identical Annoying Driving Behaviors

Tingting Li, Lin Wang, Jinting Liu, Jiangshu Yuan, Peng Liu

Summary: The study found that perceiving automated vehicles as lacking agency may lead to greater anger towards their aberrant behaviors. Attributing high agency to AVs eliminated the difference between humans and AVs. Perceiving AVs as having high capability to feel and sense might induce more negative reactions.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2022)

Article Computer Science, Cybernetics

People Might Be More Willing to Use Automated Vehicles in Pandemics like COVID-19

Tingting Li, Peng Liu

Summary: The COVID-19 pandemic may have a positive impact on the adoption of automated vehicles, as individuals show a greater willingness to use driverless Robotaxis during similar situations. Participants exhibited a more positive attitude towards Robotaxis and were more willing to ride in them during the pandemic, indicating a potential shift in attitudes towards AVs in times of crises.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2022)

Article Engineering, Industrial

Effects of accessible information amount and judgment times on human diagnostic performance of nuclear power plant faults

Xi Lyu, Zhizhong Li, Quan Ma, Manrong She

Summary: This study investigates the influence of information amount on diagnosis by conducting an experiment using a simulated nuclear power plant accident. The findings suggest that increasing accessible information leads to a decrease in diagnostic accuracies, highlighting the need for system designers to limit information overload and users to make more efficient use of information.

ERGONOMICS (2023)

Article Nuclear Science & Technology

Collection of IDHEAS-based human error probability data for nuclear power plant commissioning through expert elicitation

Zijian Yin, Zhizhong Li, Zhaopeng Liu, Dongfang Yang, Jinghong Zhang, Lei Long, Yijing Zhang, Boyang Gong

Summary: Nominal human error probability (NHEP) data for nuclear power plant commissioning was collected through expert elicitation, providing a valuable indicator for assessing human reliability. The obtained NHEP values for detection, understanding, action execution, and inter-team coordination were consistent with those in the Integrated Human Event Analysis System (IDHEAS)-Event Cause Analysis (ECA), while the NHEP for decision-making was lower. Challenges related to the IDHEAS-based cognitive failure modes (CFMs) and expert elicitation process were identified. The applicability of the obtained NHEP values extends to other application domains due to the technology-neutral and human cognition-focused nature of the IDHEAS-based CFMs.

ANNALS OF NUCLEAR ENERGY (2023)

Article Engineering, Manufacturing

Coordination-behavior patterns of control crews in digital nuclear power plants during emergencies from a network perspective: An exploratory study

Junxiu Zhang, Dunxing Wang, Qin Gao, Zhizhong Li

Summary: This study examines the coordination-behavior patterns of control crews in digital nuclear power plants during emergencies. The findings show that high-performing crews demonstrate higher cohesion and more balanced behavioral patterns in team coordination compared to low-performing ones. Additionally, high-performing crews exhibit a higher level of team autonomy and self-management among junior operators, while low-performing crews tend to be centered around senior reactor operators.

HUMAN FACTORS AND ERGONOMICS IN MANUFACTURING & SERVICE INDUSTRIES (2023)

Article Engineering, Industrial

Automation complacency on the road

Yueying Chu, Peng Liu

Summary: Given that automation complacency is already used to blame and punish human drivers, it is essential to review its status quo and determine whether current research can support its legitimate usage. This review work shows that current academic research in driving automation cannot support its legitimate usage.

ERGONOMICS (2023)

Article Computer Science, Cybernetics

When Automation Fails: Examining the Effect of a Verbal Recovery Strategy on User Experience in Automated Driving

Zhigang Xu, Guanqun Wang, Siming Zhai, Peng Liu

Summary: Automated agents need social recovery strategies to mitigate the negative impacts of their errors and maintain resilient human-automation relationships. This study tested the efficacy of verbal recovery design in a real automated vehicle after a failure. The results showed that human-voice-recovery can somewhat mitigate the negative impacts on user experience, while Siri-voice-recovery works on positive experience but cannot fully restore it to normal levels. More empirical efforts are needed to develop strategies specific to human-automation interaction in natural environments.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2023)

Article Computer Science, Cybernetics

The Twofold Role of Legal Liability Misattribution on Intention to Buy Automated Vehicles: A Survey in China

Evangelos Paschalidis, Siming Zhai, Junhua Guo, Tangjian Wei, Peng Liu, Haibo Chen

Summary: The study investigated the impact of liability attribution on intention to buy automated vehicles. It found that improper liability attribution can negatively affect purchase intentions. Negative misattribution affects intention to buy through the mediating effects of trust, negative affect, and crash acceptability.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2023)

Review Engineering, Industrial

Team workload: Review and conceptualization

Yu Zhang, Manrong She, Zhizhong Li

Summary: The purpose of this paper is to provide a clear and systematic model of team workload. The models and conceptual framework of team workload are summarized from the perspectives of resource requirement, system, and interaction. A nominal definition of team workload is proposed as the total effort spent for processes involved in the execution of team tasks. The components and indicators of teamwork are identified from various team processes, and the team workload is constructed in four dimensions: task-focused activities, task-induced team activities, situational response, and team maintenance and development. Finally, the proposed model is compared with existing models.

INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS (2023)

Article Economics

When both human and machine drivers make mistakes: Whom to blame?

Siming Zhai, Shan Gao, Lin Wang, Peng Liu

Summary: The emergence of automated and algorithmic technology raises the question of responsibility when something goes wrong. This study examines human judgments of responsibility in automated vehicle crashes caused by both human and machine drivers. Participants assigned more responsibility to the test driver than the car manufacturer, but the car manufacturer was not completely exempt from responsibility. Manipulating passive and active errors did not significantly impact responsibility judgments. These findings provide insights for developing a socially-acceptable framework for assigning responsibility in automated vehicle crashes.

TRANSPORTATION RESEARCH PART A-POLICY AND PRACTICE (2023)

Article Computer Science, Cybernetics

Reflections on Automation Complacency

Peng Liu

Summary: Automation poses potential risks for operators, such as automation complacency, which has been extensively studied in the field of human-automation interaction. It has been identified as a probable cause of recent traffic crashes and has implications for liability litigation.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2023)

Letter Multidisciplinary Sciences

Public aversion against ChatGPT in creative fields?

Yueying Chu, Peng Liu

INNOVATION (2023)

Article Public, Environmental & Occupational Health

Machines meet humans on the social road: Risk implications

Peng Liu

Summary: The research presents two mental models - one suggesting machine drivers are superior, the other suggesting human and machine drivers may lead to negative outcomes due to incompatibility. Recent empirical studies support the second model, indicating emerging traffic risks from human-AV social interactions.

RISK ANALYSIS (2023)

Article Engineering, Industrial

Reliability analysis and redundancy optimization of k-out-of-n systems with random variable k using continuous time Markov chain and Monte Carlo simulation

Mateusz Oszczypala, Jakub Konwerski, Jaroslaw Ziolkowski, Jerzy Malachowski

Summary: This article discusses the issues related to the redundancy of k-out-of-n structures and proposes a probabilistic and simulation-based optimization method. The method was applied to real transport systems, demonstrating its effectiveness in reducing costs and improving system availability and performance.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Node importance identification of unweighted urban rail transit network: An Adjacency Information Entropy based approach

Wencheng Huang, Haoran Li, Yanhui Yin, Zhi Zhang, Anhao Xie, Yin Zhang, Guo Cheng

Summary: Inspired by the theory of degree entropy, this study proposes a new node identification approach called Adjacency Information Entropy (AIE) to identify the importance of nodes in urban rail transit networks (URTN). Through numerical and real-world case studies, it is found that AIE can effectively identify important nodes and facilitate connections among non-adjacent nodes.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Importance-based system cost management and failure risk analysis for different phases in life cycle

Hongyan Dui, Yaohui Lu, Liwei Chen

Summary: This paper discusses the four phases of the system life cycle and the different costs associated with each phase. It proposes an improvement importance method to optimize system reliability and analyzes the process of failure risk under limited resources.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Reliability analysis of multi-state balanced systems with standby components switching mechanism

Xian Zhao, Chen Wang, Siqi Wang

Summary: This paper proposes a new rebalancing strategy for balanced systems by switching standby components. Different switching rules are provided based on different balance conditions. The system reliability is derived using the finite Markov chain imbedding approach, and numerical examples and sensitivity analysis are presented for validation.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Probabilistic-based burst failure mechanism analysis and risk assessment of pipelines with random non-uniform corrosion defects, considering the interacting effects

Fengyuan Jiang, Sheng Dong

Summary: Corrosion defects are the primary causes of pipeline burst failures. The traditional methodologies ignore the effects of random morphologies on failure behaviors, leading to deviations in remaining strength estimation and reliability analysis. To address this issue, an integrated methodology combining random field, non-linear finite element analysis, and Monte-Carlo Simulation was developed to describe the failure behaviors of pipelines with random defects.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Optimal mission abort policy for a multi-component system with failure interaction

Guoqing Cheng, Jiayi Shen, Fang Wang, Ling Li, Nan Yang

Summary: This paper investigates the optimal joint inspection and mission abort policies for a multi-component system with failure interaction. The proportional hazards model is used to characterize the effect of one component's deterioration on other components' hazard rates. The optimal policy is studied to minimize the expected total cost, and some structural properties of the optimal policy are obtained.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Competing risks-based resilience approach for multi-state systems under multiple shocks

Hongyan Dui, Yaohui Lu, Shaomin Wu

Summary: A new resilience model is proposed in this paper for systems under competing risks, and related indices are introduced for evaluating the system's resilience. The model takes into account the degradation process, external shocks, and maintenance interactions of the system, and its effectiveness is demonstrated through a case study.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Neural network-aided simulation of non-Gaussian stochastic processes

Yang Li, Jun Xu

Summary: This paper proposes a translation model based on neural network for simulating non-Gaussian stochastic processes. By converting the target non-Gaussian power spectrum to the underlying Gaussian power spectrum, non-Gaussian samples can be generated.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Quantification analysis of potential risk in railway accidents: A new random walk based approach

Yanyan Liu, Keping Li, Dongyang Yan

Summary: This paper proposes a new random walk method, CBDRWR, to analyze the potential risk of railway accidents. By combining accident causation network, we assign different restart probabilities to each node and improve the transition probabilities. In the case study, the proposed method effectively quantifies the potential risk and identifies key risk sources.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Target spectrum-based risk analysis model for utility tunnel O&M in multiple scenarios and its application

Nan Hai, Daqing Gong, Zixuan Dai

Summary: The current risk management of utility tunnel operation and maintenance is of low quality and efficiency. This study proposes a theoretical model and platform that offer effective decision support and improve the safety of utility tunnel operation and maintenance.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Methodology for probabilistic tsunami-triggered oil spill fire hazard assessment based on Natech cascading disaster modeling

Tomoaki Nishino, Takuya Miyashita, Nobuhito Mori

Summary: A novel modeling methodology is proposed to simulate cascading disasters triggered by tsunamis considering uncertainties. The methodology focuses on tsunami-triggered oil spills and subsequent fires and quantitatively measures the fire hazard. It can help assess and improve risk reduction plans.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Prediction of pipeline fatigue crack propagation under rockfall impact based on multilayer perceptron

Mingjiang Xie, Yifei Wang, Jianli Zhao, Xianjun Pei, Tairui Zhang

Summary: This study investigates the effect of rockfall impact on the health management of pipelines with fatigue cracks and proposes a crack propagation prediction algorithm based on rockfall impact. Dynamic SIF values are obtained through finite element modeling and a method combining multilayer perceptron with Paris' law is used for accurate crack growth prediction. The method is valuable for decision making in pipeline reliability assessment and integrity management.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Weaponized disinformation spread and its impact on multi-commodity critical infrastructure networks

Saeed Jamalzadeh, Lily Mettenbrink, Kash Barker, Andres D. Gonzalez, Sridhar Radhakrishnan, Jonas Johansson, Elena Bessarabova

Summary: This study proposes an integrated epidemiological-optimization model to quantify the impacts of weaponized disinformation on transportation infrastructure and supply chains. Results show that disinformation targeted at transportation infrastructure can have wide-ranging impacts across different commodities.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

Maintenance scheduling at high-speed train depots: An optimization approach

Jiaxi Wang

Summary: This paper investigates the depot maintenance packet assignment and crew scheduling problem for high-speed trains. A mixed integer linear programming model is proposed, and computational experiments show the effectiveness and efficiency of the improved model compared to the baseline one.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

Article Engineering, Industrial

An adaptive structural dominant failure modes searching method based on graph neural network

Yuxuan Tian, Xiaoshu Guan, Huabin Sun, Yuequan Bao

Summary: This paper proposes a DFMs searching algorithm based on the graph neural network (GNN) to improve computational efficiency and adaptively identify DFMs. The algorithm terminates prematurely when unable to identify new DFMs.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)