4.6 Article

Machine learning-based multidomain processing for texture-based image segmentation and analysis

Journal

APPLIED PHYSICS LETTERS
Volume 116, Issue 4, Pages -

Publisher

AIP Publishing
DOI: 10.1063/1.5135328

Keywords

-

Funding

  1. U.S. Department of Energy [DE-AC05-00OR22725, DE-AC0500OR22725]
  2. Fluid Interface Reactions, Structures, and Transport (FIRST) Center, an Energy Frontier Research Center (EFRC) - U.S. Department of Energy, Office of Science, Office of Basic Energy Sciences
  3. Center for Nanophase Materials Sciences in the Oak Ridge National Lab

Ask authors/readers for more resources

Atomic and molecular resolved atomic force microscopy (AFM) images offer unique insights into materials' properties such as local ordering, molecular orientation, and topological defects, which can be used to pinpoint physical and chemical interactions occurring at the surface. Utilizing machine learning for extracting underlying physical parameters increases the throughput of AFM data processing and eliminates inconsistencies intrinsic to manual image analysis, thus enabling the creation of reliable frameworks for qualitative and quantitative evaluation of experimental data. Here, we present a robust and scalable approach to the segmentation of AFM images based on flexible pre-selected classification criteria. The usage of supervised learning and feature extraction allows us to retain the consideration of specific problem-dependent features (such as types of periodical structures observed in the images and the associated numerical parameters: spacing, orientation, etc.). We highlight the applicability of this approach for the segmentation of molecular resolved AFM images based on the crystal orientation of the observed domains, automated selection of boundaries, and collection of relevant statistics. Overall, we outline a general strategy for machine learning-enabled analysis of nanoscale systems exhibiting periodic order that could be applied to any analytical imaging technique.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Mathematics

Lift of the Trivial Representation to a Nonlinear Double Cover

Wan-Yu Tsai

Summary: This paper investigates the set of genuine small representations of the nonlinear double cover similar to G, and proves that similar to s./2 (similar to G) is precisely the set of genuine irreducible representations arising from the KazhdanPatterson lifting of the trivial representation when similar to G is simply laced and split.

INTERNATIONAL MATHEMATICS RESEARCH NOTICES (2023)

Review Physics, Applied

A review on recent machine learning applications for imaging mass spectrometry studies

Albina Jetybayeva, Nikolay Borodinov, Anton V. Ievlev, Md Inzamam Ul Haque, Jacob Hinkle, William A. Lamberti, J. Carson Meredith, David Abmayr, Olga S. Ovchinnikova

Summary: Imaging mass spectrometry (IMS) is a powerful analytical technique used in various fields that provides qualitative compositional analysis and spatial mapping. The combination of mass spectra with spatial information produces large high-dimensional datasets, making automated computational methods crucial for exploratory analysis.

JOURNAL OF APPLIED PHYSICS (2023)

Article Biochemical Research Methods

Deep Learning on Multimodal Chemical and Whole Slide Imaging Data for Predicting Prostate Cancer Directly from Tissue Images

Md Inzamam Ul Haque, Debangshu Mukherjee, Sylwia A. Stopka, Nathalie Y. R. Agar, Jacob Hinkle, Olga S. Ovchinnikova

Summary: This study correlates H&E-stained biopsy data with MALDI mass-spectrometric imaging data to determine cancerous regions and their unique chemical signatures. The correlation between optical H&E features and chemical information in MSI allows for the prediction of prostate cancer with around 80% accuracy. Additionally, two chemical biomarkers were found to predict cancerous regions.

JOURNAL OF THE AMERICAN SOCIETY FOR MASS SPECTROMETRY (2023)

Article Chemistry, Physical

Understanding the Role of Cesium on Chemical Complexity in Methylammonium-Free Metal Halide Perovskites

Jonghee Yang, Diana K. LaFollette, Benjamin J. Lawrie, Anton V. Ievlev, Yongtao Liu, Kyle P. Kelley, Sergei V. Kalinin, Juan-Pablo Correa-Baena, Mahshid Ahmadi

Summary: Mixed cesium- and formamidinium-based metal halide perovskites (MHPs) are promising photovoltaic materials, but high cesium ratios result in chemical complexities and local inhomogeneities, compromising the optoelectronic performance.

ADVANCED ENERGY MATERIALS (2023)

Article Nanoscience & Nanotechnology

Effect of Electrode/Electrolyte Coupling on Birnessite (δ-MnO2) Mechanical Response and Degradation

Wan-Yu Tsai, Shelby B. Pillai, Karthik Ganeshan, Saeed Saeed, Yawei Gao, Adri C. T. van Duin, Veronica Augustyn, Nina Balke

Summary: In this study, the deformation of birnessite (& delta;-MnO2) electrode during charge storage in aqueous electrolytes was investigated. The effect of electrolyte cation and electrode morphology on the deformation was analyzed using operando atomic force microscopy (AFM) and molecular dynamics (MD) simulation. The results showed that the electrode underwent expansion during cation intercalation in both K2SO4 and Li2SO4 electrolytes, but with different potential dependencies. The stronger cation-birnessite interaction in Li2SO4 electrolyte resulted in higher local stress heterogeneity, leading to pronounced electrode degradation.

ACS APPLIED MATERIALS & INTERFACES (2023)

Article Chemistry, Multidisciplinary

Disentangling Electronic Transport and Hysteresis at Individual Grain Boundaries in Hybrid Perovskites via Automated Scanning Probe Microscopy

Yongtao Liu, Jonghee Yang, Benjamin J. Lawrie, Kyle P. Kelley, Maxim Ziatdinov, Sergei V. Kalinin, Mahshid Ahmadi

Summary: The increasing photovoltaic efficiency and stability of metal halide perovskites (MHPs) are attributed to the improvement in understanding the microstructure of polycrystalline MHP thin films. A workflow combining conductive atomic force microscopy (AFM) measurement with a machine learning (ML) algorithm was designed to systematically investigate the grain boundaries in MHPs. This approach revealed that the properties of grain boundaries play critical roles in MHP stability.

ACS NANO (2023)

Article Chemistry, Physical

Exploring the Relationship of Microstructure and Conductivity in Metal Halide Perovskites via Active Learning-Driven Automated Scanning Probe Microscopy

Yongtao Liu, Jonghee Yang, Rama K. Vasudevan, Kyle P. Kelley, Maxim Ziatdinov, Sergei Kalinin, Mahshid Ahmadi

Summary: We demonstrate an active machine learning framework for driving an automated scanning probe microscope (SPM) to discover the microstructures responsible for specific aspects of transport behavior in metal halide perovskites (MHPs). This approach allows the microscope to discover the microstructural elements that maximize the onset of conduction, hysteresis, or any other characteristic derived from a set of current-voltage spectra. It provides new opportunities for exploring the origins of materials functionality in complex materials by SPM and can be integrated with other characterization techniques.

JOURNAL OF PHYSICAL CHEMISTRY LETTERS (2023)

Article Chemistry, Physical

Learning the right channel in multimodal imaging: automated experiment in piezoresponse force microscopy

Yongtao Liu, Rama K. K. Vasudevan, Kyle P. Kelley, Hiroshi Funakubo, Maxim Ziatdinov, Sergei V. V. Kalinin

Summary: We developed automated experiment workflows for identifying the best predictive channel in spectroscopic measurements. The approach combines ensembled deep kernel learning for probabilistic predictions and reinforcement learning for channel selection. The implementation in multimodal imaging of piezoresponse force microscopy (PFM) showed that the amplitude is the best predictive channel for polarization-voltage and frequency-voltage hysteresis loop areas. This workflow and code can be applied to other multimodal imaging and local characterization methods.

NPJ COMPUTATIONAL MATERIALS (2023)

Article Computer Science, Artificial Intelligence

Autonomous scanning probe microscopy with hypothesis learning: Exploring the physics of domain switching in ferroelectric materials

Yongtao Liu, Anna N. Morozovska, Eugene A. Eliseev, Kyle P. Kelley, Rama Vasudevan, Maxim Ziatdinov, Sergei V. Kalinin

Summary: Using hypothesis-learning-driven automated scanning probe microscopy (SPM), this study investigates the bias-induced transformations in various devices and materials. It is crucial to understand these mechanisms on the nanometer scale with a wide range of control parameters, which is experimentally challenging. The hypothesis-driven SPM autonomously identifies the mechanisms of bias-induced domain switching and reveals the importance of kinetic control.

PATTERNS (2023)

Article Computer Science, Artificial Intelligence

Optimizing training trajectories in variational autoencoders via latent Bayesian optimization approach *

Arpan Biswas, Rama Vasudevan, Maxim Ziatdinov, Sergei Kalinin

Summary: Unsupervised and semi-supervised ML methods like VAE are widely used in physics, chemistry, and materials sciences for disentangling representations and finding latent manifolds in complex experimental data. This study explores a latent Bayesian optimization approach for hyperparameter trajectory optimization in unsupervised and semi-supervised ML, demonstrated by joint-VAE with rotational invariances. The method is applied to finding joint discrete and continuous rotationally invariant representations in the MNIST database and a plasmonic nanoparticles material system.

MACHINE LEARNING-SCIENCE AND TECHNOLOGY (2023)

Article Physics, Applied

Ferroelectric Schottky diodes of CuInP2S6 nanosheet

Jinyuan Yao, Yongtao Liu, Shaoqing Ding, Yanglin Zhu, Zhiqiang Mao, Sergei V. Kalinin, Ying Liu

Summary: Ferroelectricity in van der Waals layered material has attracted significant attention. The ferroelectric properties of CuInP2S6 (CIPS), which is the only van der Waals layered material that has demonstrated ferroelectricity in the bulk, have been observed to persist even at a few nanometers thickness. However, the potential device applications of CIPS' ferroelectric properties are just beginning to be explored.

APPLIED PHYSICS LETTERS (2023)

Article Computer Science, Artificial Intelligence

Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders

Maxim Ziatdinov, Chun Yin (Tommy) Wong, Sergei Kalinin

Summary: Recent advances in scanning tunneling and transmission electron microscopies have generated large volumes of imaging data containing information on the structure and functionality of materials. However, automatic extraction and classification of patterns in the images is non-trivial. To address this problem, the authors propose a shift-invariant variational autoencoder approach and demonstrate its effectiveness on 1D, synthetic, and experimental data. The shift VAE analysis shows promise for pattern discovery, but also has limitations.

MACHINE LEARNING-SCIENCE AND TECHNOLOGY (2023)

Article Nanoscience & Nanotechnology

Effect of Electrode/Electrolyte Coupling on Birnessite (δ-MnO2) Mechanical Response and Degradation

Wan-Yu Tsai, Shelby B. B. Pillai, Karthik Ganeshan, Saeed Saeed, Yawei Gao, Adri C. T. van Duin, Veronica Augustyn, Nina Balke

Summary: The effect of electrolyte cation and electrode morphology on the deformation of birnessite (delta-MnO2) during charge storage in aqueous electrolytes was investigated. The results showed that the delta-MnO2 electrode underwent expansion during cation intercalation, but with different potential dependencies. The stronger cation-birnessite interaction in Li2SO4 electrolyte led to higher local stress heterogeneity, which might be the reason for the pronounced electrode degradation in this electrolyte.

ACS APPLIED MATERIALS & INTERFACES (2023)

Article Automation & Control Systems

Exploring the Evolution of Metal Halide Perovskites via Latent Representations of the Photoluminescent Spectra

Sheryl Sanchez, Yongtao Liu, Jonghee Yang, Sergei V. Kalinin, Maxim Ziatdinov, Mahshid Ahmadi

Summary: In recent years, laboratory automation and high-throughput synthesis and characterization have become increasingly important in the research community. To effectively analyze the large datasets and extract system properties, suitable machine learning techniques, such as the variational autoencoder (VAE) approach, are needed. This study explores the binary library of metal halide perovskite microcrystals using low-dimensional latent representations of photoluminescence spectra. The combination of translationally invariant variational autoencoders (tVAEs) and conditional autoencoders (cVAEs) allows for a deeper understanding of the underlying mechanisms within the data.

ADVANCED INTELLIGENT SYSTEMS (2023)

No Data Available