4.4 Article

Scaling molecular dynamics beyond 100,000 processor cores for large-scale biophysical simulations

Journal

JOURNAL OF COMPUTATIONAL CHEMISTRY
Volume 40, Issue 21, Pages 1919-1930

Publisher

WILEY
DOI: 10.1002/jcc.25840

Keywords

high performance computing; biomolecular simulation; 3D modeling; GENESIS MD software

Funding

  1. JSPS KAKENHI [26119006]
  2. JST CREST
  3. Los Alamos National Laboratory [CNLS]
  4. Los Alamos National Laboratory LDRD
  5. RIKEN
  6. Los Alamos National Laboratory Institutional Computing
  7. U.S. Department of Energy
  8. LANL
  9. NIGMS [R35GM122562]
  10. University of Tokyo

Ask authors/readers for more resources

The growing interest in the complexity of biological interactions is continuously driving the need to increase system size in biophysical simulations, requiring not only powerful and advanced hardware but adaptable software that can accommodate a large number of atoms interacting through complex forcefields. To address this, we developed and implemented strategies in the GENESIS molecular dynamics package designed for large numbers of processors. Long-range electrostatic interactions were parallelized by minimizing the number of processes involved in communication. A novel algorithm was implemented for nonbonded interactions to increase single instruction multiple data (SIMD) performance, reducing memory usage for ultra large systems. Memory usage for neighbor searches in real-space nonbonded interactions was reduced by approximately 80%, leading to significant speedup. Using experimental data describing physical 3D chromatin interactions, we constructed the first atomistic model of an entire gene locus (GATA4). Taken together, these developments enabled the first billion-atom simulation of an intact biomolecular complex, achieving scaling to 65,000 processes (130,000 processor cores) with 1 ns/day performance. Published 2019. This article is a U.S. Government work and is in the public domain in the USA.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.4
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Biochemistry & Molecular Biology

Weight average approaches for predicting dynamical properties of biomolecules

Kiyoshi Yagi, Suyong Re, Takaharu Mori, Yuji Sugita

Summary: Recent advances in atomistic molecular dynamics simulations have allowed us to explore the conformational spaces of biomolecules and observe transitions between distinct structures. Weight average approaches are used to analyze various experimental measurements and improve our understanding of molecular functions based on atomic structures.

CURRENT OPINION IN STRUCTURAL BIOLOGY (2022)

Article Chemistry, Physical

Computational Analysis on the Allostery of Tryptophan Synthase: Relationship between α/β-Ligand Binding and Distal Domain Closure

Shingo Ito, Kiyoshi Yagi, Yuji Sugita

Summary: In this study, the allosteric regulation of TRPS was investigated using molecular dynamics simulations. The results revealed the effects of IGP binding on the conformation of the alpha and beta subunits, as well as the critical role of hydrogen bonds. These findings provide insights into the allosteric regulation of multidomain proteins.

JOURNAL OF PHYSICAL CHEMISTRY B (2022)

Article Biochemical Research Methods

Implementation of residue-level coarse-grained models in GENESIS for large-scale molecular dynamics simulations

Cheng Tan, Jaewoon Jung, Chigusa Kobayashi, Diego Ugarte La Torre, Shoji Takada, Yuji Sugita

Summary: Residue-level coarse-grained (CG) models play a crucial role in biomolecular simulations, enabling the study of large-scale biological phenomena with unified treatments of proteins and nucleic acids, as well as efficient parallel computations. The toolbox and methods introduced can help optimize the performance in CG MD simulations.

PLOS COMPUTATIONAL BIOLOGY (2022)

Article Biology

The inherent flexibility of receptor binding domains in SARS-CoV-2 spike protein

Hisham M. Dokainish, Suyong Re, Takaharu Mori, Chigusa Kobayashi, Jaewoon Jung, Yuji Sugita

Summary: The Spike protein plays a crucial role in neutralization and vaccine development for SARS-CoV-2. Its inherent flexibility provides essential information for designing antiviral drugs and vaccines.

ELIFE (2022)

Article Biophysics

Structural effects of spike protein D614G mutation in SARS-CoV-2

Hisham M. Dokainish, Yuji Sugita

Summary: A single mutation (D614G) in the spike protein of SARS-CoV-2, which causes COVID-19, has become the dominant variant. This mutation enhances the virus's infectivity by inducing structural changes. Molecular dynamics simulations reveal that the mutation orders the structure, weakens local interactions, and alters global interactions, leading to conformational changes. Understanding this mutation is crucial as it is present in all variants of concern.

BIOPHYSICAL JOURNAL (2023)

Article Chemistry, Multidisciplinary

Acceleration of generalized replica exchange with solute tempering simulations of large biological systems on massively parallel supercomputer

Jaewoon Jung, Chigusa Kobayashi, Yuji Sugita

Summary: gREST is an enhanced sampling algorithm used for proteins or other systems with rugged energy landscapes. It differs from the REMD method as the solvent temperatures are the same in all replicas, while solute temperatures are different and frequently exchanged between replicas to explore various solute structures. The gREST scheme is applied to large biological systems using a large number of processors, reducing communication time and performing energy evaluations on-the-fly during simulations. These advanced schemes in the GENESIS software provide new possibilities for studying large biomolecular complex systems with slow conformational dynamics.

JOURNAL OF COMPUTATIONAL CHEMISTRY (2023)

Article Multidisciplinary Sciences

Characterization of SARS-CoV-2 Omicron BA.2.75 clinical isolates

Ryuta Uraki, Shun Iida, Peter J. Halfmann, Seiya Yamayoshi, Yuichiro Hirata, Kiyoko Iwatsuki-Horimoto, Maki Kiso, Mutsumi Ito, Yuri Furusawa, Hiroshi Ueki, Yuko Sakai-Tagawa, Makoto Kuroda, Tadashi Maemura, Taksoo Kim, Sohtaro Mine, Noriko Iwamoto, Rong Li, Yanan Liu, Deanna Larson, Shuetsu Fukushi, Shinji Watanabe, Ken Maeda, Zhongde Wang, Norio Ohmagari, James Theiler, Will Fischer, Bette Korber, Masaki Imai, Tadaki Suzuki, Yoshihiro Kawaoka

Summary: The Omicron subvariant BA.2.75 rapidly spread globally in India and Nepal during the summer of 2022. However, its virological features were largely unknown. In this study, BA.2.75 clinical isolates were evaluated in Syrian hamsters, and it was found that BA.2.75 had higher replicative ability in the lungs compared to BA.2 and BA.5. BA.2.75 also caused focal viral pneumonia in hamsters, unlike BA.5. These findings suggest that BA.2.75 may cause more severe respiratory disease and should be closely monitored.

NATURE COMMUNICATIONS (2023)

Article Medicine, General & Internal

SARS-CoV-2 variant transition dynamics are associated with vaccination rates, number of co-circulating variants, and convalescent immunity

Lauren J. Beesley, Kelly R. Moran, Kshitij Wagh, Lauren A. Castro, James Theiler, Hyejin Yoon, Will Fischer, Nick W. Hengartner, Bette Korber, Sara Y. Del Valle

Summary: This paper retrospectively analyzes longitudinal sequencing data to characterize differences in the speed, calendar timing, and magnitude of 16 SARS-CoV-2 variant waves/transitions for 230 countries and sub-country regions. It also identifies groups of locations exhibiting similar variant transitions through clustering. The study finds associations between the behavior of an emerging variant and the number of co-circulating variants, as well as the demographic context of the population.

EBIOMEDICINE (2023)

Article Chemistry, Multidisciplinary

Highly Charged Proteins and Their Repulsive Interactions Antagonize Biomolecular Condensation

Cheng Tan, Ai Niitsu, Yuji Sugita

Summary: In this study, the interactions between Hero11 protein and TDP-43-LCD protein were investigated using multiscale molecular dynamics simulations. Three possible regulatory mechanisms of Hero11 were proposed based on the simulation results. It was found that Hero11 can permeate into TDP-43-LCD condensates and induce changes in their conformation, intermolecular interactions, and dynamics. These mechanisms provide new insights into the regulation of biomolecular condensation under different conditions.

JACS AU (2023)

Article Chemistry, Physical

Extension of the iSoLF implicit-solvent coarse-grained model for multicomponent lipid bilayers

Diego Ugarte La Torre, Shoji Takada, Yuji Sugita

Summary: iSoLF is a coarse-grained model used in molecular dynamics simulations of biological membranes with the implicit solvent approximation. By explicitly treating the electrostatic interactions and adding new particle types, the model can now simulate a wider range of lipid molecules. The improved model has been parameterized and validated, and it is also capable of simulating phase behaviors of lipid mixtures.

JOURNAL OF CHEMICAL PHYSICS (2023)

Article Immunology

US National Institutes of Health Prioritization of SARS-CoV-2 Variants

Sam Turner, Arghavan Alisoltani, Debbie Bratt, Liel Cohen-Lavi, Bethany L. Dearlove, Christian Drosten, Will M. Fischer, Ron A. M. Fouchier, Ana Silvia Gonzalez-Reiche, Lukasz Jaroszewski, Zain Khalil, Eric LeGresley, Marc Johnson, Terry C. Jones, Barbara Muehlemann, David O'Connor, Mayya Sedova, Maulik Shukla, James Theiler, Zachary S. Wallace, Hyejin Yoon, Yun Zhang, Harm van Bakel, Marciela M. Degrace, Elodie Ghedin, Adam Godzik, Tomer Hertz, Bette Korber, Jacob Lemieux, Anna M. Niewiadomska, Diane J. Post, Morgane Rolland, Richard Scheuermann, Derek J. Smith

Summary: Since late 2020, SARS-CoV-2 variants with competitive and phenotypic differences have been regularly emerging, sometimes having the potential to escape immunity. The Early Detection group of the US National Institutes of Health uses bioinformatics to monitor and prioritize the most relevant variants for experimental characterization. Their success includes identifying major variants and providing updated information for phenotypic investigations.

EMERGING INFECTIOUS DISEASES (2023)

Article Medicine, Research & Experimental

Trivalent mosaic or consensus HIV immunogens prime humoral and broader cellular immune responses in adults

Kristen W. Cohen, Andrew Fiore-Gartland, Stephen R. Walsh, Karina Yusim, Nicole Frahm, Marnie L. Elizaga, Janine Maenza, Hyman Scott, Kenneth H. Mayer, Paul A. Goepfert, Srilatha Edupuganti, Giuseppe Pantaleo, Julia Hutter, Daryl E. Morris, Stephen C. De Rosa, Daniel E. Geraghty, Merlin L. Robb, Nelson L. Michael, Will Fischer, Elena E. Giorgi, Harman Malhi, Michael N. Pensiero, Guido Ferrari, Georgia D. Tomaras, David C. Montefiori, Peter B. Gilbert, M. Juliana McElrath, Barton F. Haynes, Bette T. Korber, Lindsey R. Baden

Summary: This study found that vaccination with mosaic immunogens could induce more specific T cell responses and increase recognition of heterologous variants, suggesting that mosaic and consensus immunogens are promising approaches to address the global diversity of HIV-1.

JOURNAL OF CLINICAL INVESTIGATION (2023)

Article Chemistry, Multidisciplinary

SPANA: Spatial decomposition analysis for cellular-scale molecular dynamics simulations

Isseki Yu, Takaharu Mori, Daisuke Matsuoka, Donatas Surblys, Yuji Sugita

Summary: The rapid increase in computational power has enabled atomistic molecular dynamics simulations of biomolecules in large-scale biological systems. Spatial decomposition analysis (SPANA) reduces computational time and memory size by distributing analysis tasks to multiple CPU cores, opening new possibilities for detailed atomistic analyses of biomacromolecules and other molecules in MD simulation trajectories.

JOURNAL OF COMPUTATIONAL CHEMISTRY (2023)

Article Biochemistry & Molecular Biology

Modified Protein-Water Interactions in CHARMM36m for Thermodynamics and Kinetics of Proteins in Dilute and Crowded Solutions

Daiki Matsubara, Kento Kasahara, Hisham M. Dokainish, Hiraku Oshima, Yuji Sugita

Summary: Proper balance between protein-protein and protein-water interactions is crucial for molecular dynamics simulations of proteins. Increasing the protein-water interactions helps optimize the balance and has significant effects on diffusive properties of proteins in crowded solutions.

MOLECULES (2022)

Article Chemistry, Multidisciplinary

Toward accurate modeling of structure and energetics of bulk hexagonal boron nitride

Michal Novotny, Matus Dubecky, Frantisek Karlicky

Summary: This paper investigates the accuracy of different DFT-based computational approaches in calculating the equilibrium lattice constants and exfoliation energy of hexagonal boron nitride (h-BN). The results are compared with experiments and reference QMC calculations to evaluate the accuracy of these computational methods.

JOURNAL OF COMPUTATIONAL CHEMISTRY (2024)

Article Chemistry, Multidisciplinary

Tuning ultrafast time-evolution of photo-induced charge-transfer states: A real-time electronic dynamics study in substituted indenotetracene derivatives

Luigi Crisci, Federico Coppola, Alessio Petrone, Nadia Rega

Summary: The charge transfer dynamics in asymmetrically substituted indenotetracene molecules upon photo-excitation were investigated using real-time time-dependent density functional theory simulations. The study found that the electron-donating character of the substituents affects the overall electronic energy spacing and ultrafast charge transfer dynamics.

JOURNAL OF COMPUTATIONAL CHEMISTRY (2024)

Article Chemistry, Multidisciplinary

The stability of oxygen-centered radicals and its response to hydrogen bonding interactions

Vasilii Korotenko, Hendrik Zipse

Summary: The stability of various radicals and molecules has been studied using different theoretical methods, and good correlations between theoretical calculations and experimental results have been found. The effects of hydrogen bonding interactions on the stability of oxygen-centered radicals have also been investigated.

JOURNAL OF COMPUTATIONAL CHEMISTRY (2024)

Article Chemistry, Multidisciplinary

Accurate ab initio potential energy surface, rovibrational energy levels and resonance interactions of triplet ((X)over-tilde3B1) methylene

Oleg Egorov, Michael Rey, Dominika Viglaska, Andrei V. Nikitin

Summary: In this work, the rovibrational energy levels of four isotopologues of methylene were calculated using a new accurate ab initio potential energy surface. The accuracy of the calculations was improved by considering scalar relativistic effects, DBOC, and high-order electronic correlations. For the first time, all available experimental rovibrational transitions were reproduced with high accuracy, without any empirical corrections.

JOURNAL OF COMPUTATIONAL CHEMISTRY (2024)