4.7 Article

Boosting Resolution and Recovering Texture of 2D and 3D Micro-CT Images with Deep Learning

Journal

WATER RESOURCES RESEARCH
Volume 56, Issue 1, Pages -

Publisher

AMER GEOPHYSICAL UNION
DOI: 10.1029/2019WR026052

Keywords

-

Ask authors/readers for more resources

Simulation of flow directly at the pore scale depends on high-quality digital rock images but is constrained by detector hardware. A trade-off between the image field of view (FOV) and image resolution is made. This can be compensated for with superresolution (SR) techniques that take a wide FOV, low-resolution (LR) image, and superresolve a high resolution (HR). The Enhanced Deep Super Resolution Generative Adversarial Network (EDSRGAN) is trained on the DeepRock-SR, a diverse compilation of raw and processed micro-computed tomography (mu CT) images in 2D and 3D. The 2D and 3D trained networks show comparable performance of 50% to 70% reduction in relative error over bicubic interpolation with minimal computational cost during usage. Texture regeneration with EDSRGAN shows superior visual similarity versus Super Resolution Convolutional Neural Network (SRCNN) and other methods. Difference maps show SRCNN recovers large-scale edge features while EDSRGAN regenerates perceptually indistinguishable high-frequency texture. Physical accuracy is measured by permeability and phase topology on consistently segmented images, showing EDSRGAN results achieving the closest match. Performance is generalized with augmentation, showing high adaptability to noise and blur. HR images are fed into the network, generating HR-SR images to extrapolate network performance to subresolution features present in the HR images themselves. Underresolution features are regenerated despite operating outside of trained specifications. Comparison with scanning electron microscopy (SEM) images shows details are consistent with the underlying geometry. Images that are normally constrained by the mineralogy of the rock, by fast transient imaging, or by the energy of the source can be superresolved accurately for further analysis. Plain Language Summary When capturing an X-ray image of the insides of a rock sample (or any opaque object), hardware limitations on the image quality and size exist. These limitations can be overcome with the use of machine learning algorithms that superresolve a lower resolution image. Once trained, the machine algorithm can sharpen otherwise blurry features and regenerate the underlying texture of the imaged object. We train such an algorithm on a large and wide array of digital rock images and test its flexibility on some images that it had never seen before, as well as on some very high quality images that it was not trained to superresolve. The results of training and testing the algorithm shows a promising degree of accuracy and flexibility in handling a wide array of images of different quality and allows for higher quality images to be generated for use in other image-based analysis techniques.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Energy & Fuels

Automatic fracture detection and characterization from unwrapped drill-core images using mask R-CNN

Fatimah Alzubaidi, Patrick Makuluni, Stuart R. Clark, Jan Erik Lie, Peyman Mostaghimi, Ryan T. Armstrong

Summary: This paper introduces a machine learning-based approach for automatic fracture recognition from unwrapped drill-core images. The method applies a state-of-the-art convolutional neural network for object identification and segmentation, and investigates the feasibility of using synthetic fracture images for training the learning model.

JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING (2022)

Article Engineering, Chemical

Dynamic X-ray micotomography of microfibrous cellulose liquid foams using deep learning

Syeda Rubaiya Muin, Patrick T. Spicer, Kunning Tang, Yufu Niu, Maryam Hosseini, Peyman Mostaghimi, Ryan T. Armstrong

Summary: The article introduces a method of using micro-CT technology to conduct three-dimensional microstructural analysis of foam, and improves the image collection and analysis capabilities through deep learning. The study evaluates the stability mechanism of microfibrillar cellulose in foam, explains the effect of fiber entrapment on foam structure stability, and provides detailed analysis of the data and evaluation of deep learning methods.

CHEMICAL ENGINEERING SCIENCE (2022)

Article Chemistry, Physical

Universal description of wetting on multiscale surfaces using integral geometry

Chenhao Sun, James McClure, Steffen Berg, Peyman Mostaghimi, Ryan T. Armstrong

Summary: This article proposes a universal description of wetting on multiscale surfaces through the combination of integral geometry and thermodynamic laws. The theoretical framework is presented and applied to different limiting cases. Simulations of fluid droplets on structurally rough and chemically heterogeneous surfaces are conducted to explore the wetting behavior. The findings reveal the origin of classical wetting models within the proposed framework.

JOURNAL OF COLLOID AND INTERFACE SCIENCE (2022)

Article Computer Science, Interdisciplinary Applications

Deep learning for full-feature X-ray microcomputed tomography segmentation of proton electron membrane fuel cells

Kunning Tang, Quentin Meyer, Robin White, Ryan T. Armstrong, Peyman Mostaghimi, Ying Da Wang, Shiyang Liu, Chuan Zhao, Klaus Regenauer-Lieb, Patrick Kin Man Tung

Summary: This study demonstrates the benefits of using convolutional neural networks (CNNs) in accurately classifying different materials of proton exchange membrane fuel cells using X-ray micro-computed tomography. The study shows that a novel UResNet CNN can effectively segment the complete volume of the fuel cells with high accuracy. The CNN outperforms the manual segmentation, especially in separating carbon fibres and binder phase in the gas diffusion layer. Additionally, the CNN provides realistic permeability calculation results for the binder void space.

COMPUTERS & CHEMICAL ENGINEERING (2022)

Article Engineering, Chemical

Deep convolutional neural network for 3D mineral identification and liberation analysis

Kunning Tang, Ying Da Wang, Peyman Mostaghimi, Mark Knackstedt, Chad Hargrave, Ryan T. Armstrong

Summary: Mineral Liberation Analysis (MLA) is an automated system for identifying minerals in mineral samples. This study extends MLA to three dimensions using 3D X-ray microcomputed tomography and convolutional neural networks. Comparison between 2D and 3D analysis shows significant differences in the results.

MINERALS ENGINEERING (2022)

Article Engineering, Chemical

Super-Resolved Segmentation of X-ray Images of Carbonate Rocks Using Deep Learning

Naif J. Alqahtani, Yufu Niu, Ying Da Wang, Traiwit Chung, Zakhar Lanetc, Aleksandr Zhuravljov, Ryan T. Armstrong, Peyman Mostaghimi

Summary: Reliable quantitative analysis of digital rock images, especially in heterogeneous rocks like carbonates with complex pore size distributions, requires precise segmentation and identification. In recent years, deep learning algorithms have provided efficient and automated solutions for digital rock super-resolution and segmentation. This study presents a framework that uses convolutional neural networks (CNNs) to achieve super-resolved segmentations of carbonate rock images in order to identify sub-resolution porosity. Comparison of voxel-wise segmentation accuracy metrics, topological features, and effective properties confirms the accuracy of the trained model and highlights the value of integrating deep learning frameworks in digital rock analysis.

TRANSPORT IN POROUS MEDIA (2022)

Article Physics, Applied

Generalizable Framework of Unpaired Domain Transfer and Deep Learning for the Processing of Real-Time Synchrotron-Based X-Ray Microcomputed Tomography Images of Complex Structures

Kunning Tang, Ying Da Wang, James McClure, Cheng Chen, Peyman Mostaghimi, Ryan T. Armstrong

Summary: Mitigating greenhouse gas emissions and finding solutions for future energy is essential. Understanding geochemical reactions and flow behavior at the interface is important for successful underground storage. This study introduces an image-processing workflow using synchrotron-based μCT and CNNs to extract quantitative data and analyze porous materials for energy applications. The results show the need for comprehensive assessment beyond pixel-wise accuracy.

PHYSICAL REVIEW APPLIED (2022)

Article Energy & Fuels

Coupling of pore network modelling and volume of fluid methods for multiphase flow in fractured media

Zakhar Lanetc, Aleksandr Zhuravljov, Yu Jing, Ryan T. Armstrong, Peyman Mostaghimi

Summary: Modelling multiphase flow in fractured media is a challenging problem of great importance for oil production. The use of dynamic pore network models allows for capturing the transient nature of multiphase flow, overcoming the limitations of numerical oscillations and interface tracking. The proposed hybrid numerical method offers a promising approach for investigating transient immiscible multiphase flow phenomena in fractures.
Article Green & Sustainable Science & Technology

The effect of original and initial saturation on residual nonwetting phase capillary trapping efficiency

Elizabeth J. H. Kimbrel, Dorthe Wildenschild, Anna L. Herring, Ryan T. Armstrong

Summary: This article investigates the efficiency of CO2 trapping in geological storage. Through experiments on the imbibition and drainage processes of proxy fluids, it is found that the amount of trapped CO2 is dependent on the presence of the nonwetting phase and the initial injection method of supercritical CO2, factors that are not considered in current trapping models.

INTERNATIONAL JOURNAL OF GREENHOUSE GAS CONTROL (2022)

Article Mechanics

Relative permeability as a stationary process: Energy fluctuations in immiscible displacement

James E. McClure, Ming Fan, Steffen Berg, Ryan T. T. Armstrong, Carl Fredrik Berg, Zhe Li, Thomas Ramstad

Summary: Relative permeability is derived from conservation of energy and used to model fluid flow through porous materials. The study finds dynamic connectivity and explores the distribution of energy fluctuations during steady-state flow. It demonstrates the effectiveness of the conventional relative permeability relationship in simulating energy dissipation in systems with complex pore-scale dynamics.

PHYSICS OF FLUIDS (2022)

Article Engineering, Chemical

Paired and Unpaired Deep Learning Methods for Physically Accurate Super-Resolution Carbonate Rock Images

Yufu Niu, Samuel J. Jackson, Naif Alqahtani, Peyman Mostaghimi, Ryan T. Armstrong

Summary: This study compares two state-of-the-art super-resolution deep learning techniques, demonstrating that the unpaired GAN approach can accurately reconstruct super-resolution images as precise as the paired CNN method, with comparable training times and dataset requirements. This opens up new possibilities for micro-CT image enhancement using unpaired deep learning methods, eliminating the need for image registration.

TRANSPORT IN POROUS MEDIA (2022)

Article Environmental Sciences

Predictive Soft Computing Methods for Building Digital Rock Models Verified by Positron Emission Tomography Experiments

Mohammad Ebadi, Ryan T. Armstrong, Peyman Mostaghimi, Ying Da Wang, Naif Alqahtani, Tammy Amirian, Lesley Anne James, Arvind Parmar, David Zahra, Hasar Hamze, Dmitry Koroteev

Summary: This paper proposes a fully automated workflow based on soft computing to characterize the heterogeneous flow properties of cores and build predictive continuum-scale models. The workflow classifies rock types using image features and morphological properties, and evaluates petrophysical properties through pore-scale simulations. Experimental results demonstrate the high-fidelity characterization provided by this workflow.

WATER RESOURCES RESEARCH (2022)

Article Chemistry, Physical

Operando monitoring of the evolution of triple-phase boundaries in proton exchange membrane fuel cells

Quentin Meyer, Shiyang Liu, Karin Ching, Ying Da Wang, Chuan Zhao

Summary: This study introduces a new approach to monitoring the evolutions of the triple-phase boundary in proton exchange membrane fuel cells. By simultaneously capturing the ohmic resistance and double-layer capacitance using high-frequency zero-phase impedance spectroscopy, the impact of fuel cell operations on the triple-phase boundary can be accurately analyzed. The results show that the triple-phase boundary area reduces throughout the operations, indicating changes in proton transport, electron transport, and oxygen diffusion.

JOURNAL OF POWER SOURCES (2023)

Article Engineering, Chemical

Particle classification of iron ore sinter green bed mixtures by 3D X-ray microcomputed tomography and machine learning

Kunning Tang, Ying Da Wang, Yufu Niu, Tom A. Honeyands, Damien O'Dea, Peyman Mostaghimi, Ryan T. Armstrong, Mark Knackstedt

Summary: The iron ore sintering process needs to be optimized to reduce energy consumption and carbon emissions, while producing high-quality sinter for low carbon blast furnace operations. 3D X-ray micro-computed tomography can provide particle-level information of iron ore mixtures, but algorithms are needed to identify and classify particles and establish the relationship between ore sources and sinter quality.

POWDER TECHNOLOGY (2023)

Article Multidisciplinary Sciences

Large-scale physically accurate modelling of real proton exchange membrane fuel cell with deep learning

Ying Da Wang, Quentin Meyer, Kunning Tang, James E. McClure, Robin T. White, Stephen T. Kelly, Matthew M. Crawford, Francesco Iacoviello, Dan J. L. Brett, Paul R. Shearing, Peyman Mostaghimi, Chuan Zhao, Ryan T. Armstrong

Summary: The authors utilize X-ray micro-computed tomography, deep learned super-resolution, multi-label segmentation, and direct multiphase simulation to simulate fuel cells and guide their design, addressing the challenge of accurate liquid water modelling.

NATURE COMMUNICATIONS (2023)

No Data Available