4.2 Article

Distributed X-ray photon correlation spectroscopy data reduction using Hadoop MapReduce

Journal

JOURNAL OF SYNCHROTRON RADIATION
Volume 25, Issue -, Pages 1135-1143

Publisher

INT UNION CRYSTALLOGRAPHY
DOI: 10.1107/S160057751800601X

Keywords

multi-speckle X-ray photon correlation spectroscopy; XPCS; MapReduce; parallel implementation; Advanced Photon Source

Funding

  1. US Department of Energy, Office of Science [DE-AC02-06CH11357]
  2. APS computing cluster
  3. Daniel Murphy-Olson and Ryan Aydelott

Ask authors/readers for more resources

Multi-speckle X-ray photon correlation spectroscopy (XPCS) is a powerful technique for characterizing the dynamic nature of complex materials over a range of time scales. XPCS has been successfully applied to study a wide range of systems. Recent developments in higher-frame-rate detectors, while aiding in the study of faster dynamical processes, creates large amounts of data that require parallel computational techniques to process in near real-time. Here, an implementation of the multi-tau and two-time autocorrelation algorithms using the Hadoop MapReduce framework for distributed computing is presented. The system scales well with regard to the increase in the data size, and has been serving the users of beamline 8-ID-I at the Advanced Photon Source for near real-time autocorrelations for the past five years.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Marine

A dynamic model for microbiologically influenced corrosion (MIC) integrity risk management of subsea pipelines

Mohammad Yazdi, Faisal Khan, Rouzbeh Abbassi

Summary: Microbiologically Influenced Corrosion (MIC) poses a significant challenge to offshore oil and gas facilities, leading to pinholes and leaks. Preventive (coatings, cathodic protection) and mitigative (inhibitor and biocide treatment) actions are crucial for pipeline integrity management. A multi-objective functional methodology involving dynamic continuous Bayesian network modeling and a genetic algorithm is proposed to minimize operational risks associated with MIC.

OCEAN ENGINEERING (2023)

Article Engineering, Environmental

A methodical approach for knowledge-based fire and explosion accident likelihood analysis

Mohammad Zaid Kamil, Faisal Khan, S. Zohra Halim, Paul Amyotte, Salim Ahmed

Summary: This study aims to develop a framework and tools to extract data from an accident database and establish a generalized accident causation model. By integrating Natural Language Processing, Interpretive Structural Model, and probabilistic methods, the model provides insights into accident factors, interactions, and pathways, and can be used for accident prevention strategies.

PROCESS SAFETY AND ENVIRONMENTAL PROTECTION (2023)

Article Engineering, Chemical

Process safety analysis using operational data and Bayesian network

James Daley, Faisal Khan, Md. Tanjin Amin

Summary: This study proposes a method to assess the probability of process system failure based on operational data and system knowledge using principal component analysis and Bayesian network. The method can determine the probability of system failure once a fault is detected and provides valuable information for process safety.

PROCESS SAFETY PROGRESS (2023)

Article Engineering, Industrial

An operational risk awareness tool for small fishing vessels operating in harsh environment

Vindex Domeh, Francis Obeng, Faisal Khan, Neil Bose, Elizabeth Sanli

Summary: Probabilistic safety assessment using the Bayesian network (BN) is a popular method for developing risk analysis tools. However, the subjectivity introduced by using subject-matter experts in eliciting probabilities for conditional probability tables (CPTs) decreases the reliability of the resulting tool. To address this issue, a probability-scoring scale was proposed to assign probabilities to CPTs, ensuring consistent results among different experts. The scale was applied to a BN-based risk -awareness (RAw) tool for monitoring safety aboard small fishing vessels (SFV), benefiting SFV owners and operators, the commercial fishing industry, and maritime administrations.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2023)

Article Public, Environmental & Occupational Health

Textual data transformations using natural language processing for risk assessment

Mohammad Zaid Kamil, Mohammed Taleb-Berrouane, Faisal Khan, Paul Amyotte, Salim Ahmed

Summary: Underlying information about failure in free text can be used to determine causation in risk assessment. Advanced methodology is needed to identify the features in natural language expression. This study addresses the knowledge gap by extracting relevant features from textual data to develop cause-effect scenarios. The proposed methodology applies natural language processing and text-mining techniques to extract features and utilizes them in Bayesian networks for risk assessment.

RISK ANALYSIS (2023)

Article Computer Science, Interdisciplinary Applications

Risk assessment of human-automation conflict under cyberattacks in process systems

He Wen, Faisal Khan, Salim Ahmed, Syed Imtiaz, Stratos Pistikopoulos

Summary: Human-automation conflict is a frontier subject that needs to be vigilant against, especially under cyberattacks. This study transforms common attacks into understandable representations and explores the conflict under five generalized attacks using game theory. The results show that cyberattacks can significantly cause conflicts, and the control actions can buffer the impact of attacks within a limited range. The conflict risk can be used to distinguish faults and attacks, and appropriate measures can be taken accordingly.

COMPUTERS & CHEMICAL ENGINEERING (2023)

Article Engineering, Chemical

Assessment of Situation Awareness Conflict Risk between Human and AI in Process System Operation

He Wen, Md. Tanjin Amin, Faisal Khan, Salim Ahmed, Syed Imtiaz, Efstratios Pistikopoulos

Summary: The conflict between human and artificial intelligence is a critical issue in Process System Engineering. This study proposes a novel methodology to quantify interpretation conflict probability and risk. The results show that interpretation conflict is often hidden or mixed with traditional faults and noises, which can easily be triggered by sensor faults, logic errors, cyberattacks, human mistakes, and misunderstandings.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2023)

Article Engineering, Marine

A multivariate model to estimate environmental load on an offshore structure

Adhitya Ramadhani, Faisal Khan, Bruce Colbourne, Salim Ahmed, Mohammed Taleb-Berrouane

Summary: Offshore structures such as oil platforms are affected by significant environmental loads. The complexity of the offshore environment requires robust models to capture the dependencies among environmental variables. Vine copula models, using both symmetric and asymmetric copula functions, are shown to provide a better estimation of the total environmental load on offshore structures compared to traditional methods. The results have implications for probabilistic structural analysis and design of offshore structures.

OCEAN ENGINEERING (2023)

Article Chemistry, Multidisciplinary

Sulfide (H2S) Corrosion Modeling of Cr-Doped Iron (Fe) Using a Molecular Modeling Approach

Mohammad Asif, Faisal Khan, Kelly Hawboldt, Shams Anwar

Summary: This work uses density functional theory to investigate the mechanism of H2S adsorption/dissociation on the Cr-doped Fe(100) surface. It is found that H2S is weakly adsorbed on Cr-doped Fe, but the dissociated products are strongly chemisorbed. The dissociation of HS is more favorable on Fe compared to Cr-doped Fe. This study also reveals that H2S dissociation is a kinetically facile process and hydrogen diffusion follows a tortuous path. It contributes to a better understanding of sulfide corrosion mechanism and its impact, thus aiding the design of efficient corrosion prevention coatings.

ACS OMEGA (2023)

Article Engineering, Chemical

Cybersecurity and process safety synergy: An analytical exploration of cyberattack-induced incidents

He Wen, Faisal Khan

Summary: In recent years, the increase in cyber-connected industrial control systems (ICS) has raised cyber and process risks, highlighting the need for an integrated study on cybersecurity and process safety. This study analyzes cyber incidents related to ICS since 1990 and connects them with process accidents using the Bowtie method and the ATT&CK framework. It develops a Bayesian network to account for insignificant probabilities and confirms the vulnerability of the process industry to cyberattacks, with field controllers being the main targets. The study emphasizes the criticality of the safety instrument system (SIS) and the importance of dynamic threat assessment and neutralizing strategies.

CANADIAN JOURNAL OF CHEMICAL ENGINEERING (2023)

Article Engineering, Chemical

The business case for process safety: The foundational requirements to sustain success

Stewart W. Behie, Hans J. Pasman, Syeda Zohra Halim, Kathy Shell, Ahmed Hamdy El-Kady, Faisal Khan

Summary: This article discusses the importance of safety systems in high-risk businesses and the necessity of long-term impact for cross-functional programs. The article also emphasizes the core principles and beliefs needed to make necessary adjustments and ensure continued success in all circumstances.

JOURNAL OF LOSS PREVENTION IN THE PROCESS INDUSTRIES (2023)

Article Engineering, Marine

Loss of stability risk analysis in small fishing vessels

Vindex Domeh, Francis Obeng, Faisal Khan, Neil Bose, Elizabeth Sanli

Summary: A quantitative risk analysis approach is proposed to develop a tool for studying loss of stability aboard small fishing vessels. The tool, which incorporates Bayesian network and De Morgan gates, provides a probabilistic assessment of the risk factors responsible for loss of stability occurrence. It is an innovative tool that can proactively ensure the stability of small fishing vessels.

OCEAN ENGINEERING (2023)

Article Engineering, Industrial

Dynamic Bayesian network model to study under-deposit corrosion

Uyen Dao, Zaman Sajid, Faisal Khan, Yahui Zhang

Summary: This paper develops a dynamic model to study the impact of corrosion on pipeline equipment failure. It uses a Bayesian network model to understand different risk factors and their interdependencies, transforming the corrosion mechanism into a probabilistic framework. The results are consistent with industrial practices and are crucial for the inspection and maintenance schedule of corroded pipelines.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2023)

Article Transportation Science & Technology

Optimization of Daily Operations in the Marine Industry Using Ant Colony Optimization (ACO)-An Artificial Intelligence (AI) Approach

A. Sardar, M. Anantharaman, V. Garaniya, F. Khan

Summary: The maritime industry is essential to the global economy, handling about 90% of worldwide trade and employing over a million seafarers. However, the industry faces a high number of casualties due to human errors in decision-making. This study proposes an AI-based approach, using an Ant Colony Optimization algorithm, to design and validate standardized instructions for daily operational tasks. This solution can optimize task paths, provide clear instructions, and reduce human errors, contributing to improved efficiency in the maritime industry.

TRANSNAV-INTERNATIONAL JOURNAL ON MARINE NAVIGATION AND SAFETY OF SEA TRANSPORTATION (2023)

Article Engineering, Industrial

Improved pool fire-initiated domino effect assessment in atmospheric tank farms using structural response

Md. Tanjin Amin, Giordano Emrys Scarponi, Valerio Cozzani, Faisal Khan

Summary: This article examines the effectiveness and accuracy of threshold-based and probit-based methods in assessing domino effects. The results indicate that threshold-based methods are not suitable for quantitative assessment, and there are limitations in probit-based methods for time-dependent domino effect assessment. By utilizing site-specific structural response data and data analytics, a new improved time to failure prediction model is proposed, which demonstrates better performance compared to existing models.

RELIABILITY ENGINEERING & SYSTEM SAFETY (2024)

No Data Available