4.8 Article

Joint Embedding of Graphs

Journal

Publisher

IEEE COMPUTER SOC
DOI: 10.1109/TPAMI.2019.2948619

Keywords

Feature extraction; Symmetric matrices; Numerical models; Task analysis; Inference algorithms; Stochastic processes; Machine learning algorithms; Graphs; embedding; feature extraction; statistical inference

Funding

  1. GRAPHS program of the Defense Advanced Research Projects Agency (DARPA) [N66001-14-1-4028]
  2. DARPA SIMPLEX program [N66001-15-C-4041]
  3. DARPA D3M program [FA8750-17-2-0112]
  4. DARPA MAA program [FA8750-18-2-0035]

Ask authors/readers for more resources

The proposed method for jointly embedding multiple undirected graphs efficiently learns features with important applications in statistical inference on graphs. The random graph model for multiple graphs generalizes classical models and produces parameter estimates with small errors. Through simulation experiments, the joint embedding method demonstrates state-of-the-art performance in classifying graphs.
Feature extraction and dimension reduction for networks is critical in a wide variety of domains. Efficiently and accurately learning features for multiple graphs has important applications in statistical inference on graphs. We propose a method to jointly embed multiple undirected graphs. Given a set of graphs, the joint embedding method identifies a linear subspace spanned by rank one symmetric matrices and projects adjacency matrices of graphs into this subspace. The projection coefficients can be treated as features of the graphs, while the embedding components can represent vertex features. We also propose a random graph model for multiple graphs that generalizes other classical models for graphs. We show through theory and numerical experiments that under the model, the joint embedding method produces estimates of parameters with small errors. Via simulation experiments, we demonstrate that the joint embedding method produces features which lead to state of the art performance in classifying graphs. Applying the joint embedding method to human brain graphs, we find it extracts interpretable features with good prediction accuracy in different tasks.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Statistics & Probability

The Chi-Square Test of Distance Correlation

Cencheng Shen, Sambit Panda, Joshua T. Vogelstein

Summary: Distance correlation is a popular topic in data science, with a straightforward sample statistic that is ideal for discovering dependency structures. However, the testing process presents a bottleneck due to the need for costly permutation tests. To address this challenge, a chi-squared test method is proposed, which is nonparametric, fast, and applicable to various types of metrics, showing similar testing power to permutation tests.

JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS (2022)

Letter Biochemical Research Methods

CloudReg: automatic terabyte-scale cross-modal brain volume registration

Vikram Chandrashekhar, Daniel J. Tward, Devin Crowley, Ailey K. Crow, Matthew A. Wright, Brian Y. Hsueh, Felicity Gore, Timothy A. Machado, Audrey Branch, Jared S. Rosenblum, Karl Deisseroth, Joshua T. Vogelstein

NATURE METHODS (2021)

Article Statistics & Probability

Overlapping Community Detection in Networks via Sparse Spectral Decomposition

Jesus Arroyo, Elizaveta Levina

Summary: The study focuses on estimating overlapping community memberships in a network, particularly sparse node membership vectors. An algorithm based on sparse principal subspace estimation is developed, showing computational efficiency and eliminating the need for additional clustering steps. The method's fixed point corresponds to correct node memberships in a version of the stochastic block model, with good statistical performance and computational efficiency demonstrated on simulated and real-world networks.

SANKHYA-SERIES A-MATHEMATICAL STATISTICS AND PROBABILITY (2022)

Editorial Material Computer Science, Interdisciplinary Applications

Is Neuroscience FAIR? A Call for Collaborative Standardisation of Neuroscience Data COMMENT

Jean-Baptiste Poline, David N. Kennedy, Friedrich T. Sommer, Giorgio A. Ascoli, David C. Van Essen, Adam R. Ferguson, Jeffrey S. Grethe, Michael J. Hawrylycz, Paul M. Thompson, Russell A. Poldrack, Satrajit S. Ghosh, David B. Keator, Thomas L. Athey, Joshua T. Vogelstein, Helen S. Mayberg, Maryann E. Martone

Summary: This perspective article discusses the importance of international collaboration and organizations in promoting standardization of neuroscience data to make it more Findable, Accessible, Interoperable, and Reusable (FAIR). The article emphasizes the current inadequacy of standards as a major obstacle to the interoperability and reusability of research results, calling for increased international collaboration to address this issue.

NEUROINFORMATICS (2022)

Article Statistics & Probability

Valid two-sample graph testing via optimal transport Procrustes and multiscale graph correlation with applications in connectomics

Jaewon Chung, Bijan Varjavand, Jesus Arroyo-Relion, Anton Alyakin, Joshua Agterberg, Minh Tang, Carey E. Priebe, Joshua T. Vogelstein

Summary: This study focuses on testing whether two graphs come from the same distribution in brain network analysis. By utilizing methods such as adjacency spectral embedding and nonparametric maximum mean discrepancy test, the alignment and distribution comparison issues between different graphs are addressed. The results indicate that using multiscale graph correlation test can lead to more powerful outcomes in Drosophila brain network data.
Article Medicine, General & Internal

Inpatient Administration of Alpha-1-Adrenergic Receptor Blocking Agents Reduces Mortality in Male COVID-19 Patients

Shilong Li, Tomi Jun, Jonathan Tyler, Emilio Schadt, Yu-Han Kao, Zichen Wang, Maximilian F. Konig, Chetan Bettegowda, Joshua T. Vogelstein, Nickolas Papadopoulos, Ramon E. Parsons, Rong Chen, Eric E. Schadt, Li Li, William K. Oh

Summary: Alpha-1-adrenergic receptor antagonists may improve in-hospital mortality among COVID-19 patients by suppressing pro-inflammatory cytokines. This study found that exposure to alpha-1-blockers was independently associated with improved in-hospital mortality in COVID-19 patients.

FRONTIERS IN MEDICINE (2022)

Article Biology

Hidden Markov modeling for maximum probability neuron reconstruction

Thomas L. Athey, Daniel J. Tward, Ulrich Mueller, Joshua T. Vogelstein, Michael I. Miller

Summary: ViterBrain is an automated probabilistic reconstruction method that reconstructs neuronal geometry and processes from microscopy images. It combines a hidden Markov state process and a random field appearance model of neuron fluorescence, and uses dynamic programming to compute the most probable neuron path. The method can handle imperfect image segmentations and noise, and provides an interactive framework for users to trace neurons.

COMMUNICATIONS BIOLOGY (2022)

Article Neurosciences

Bisected graph matching improves automated pairing of bilaterally homologous neurons from connectomes

Benjamin D. D. Pedigo, Michael Winding, Carey E. E. Priebe, Joshua T. T. Vogelstein

Summary: Graph matching algorithms aim to find the best correspondence between nodes in two networks. They have been used to match individual neurons in nanoscale connectomes, especially those across hemispheres. However, they usually only utilize the same hemisphere subgraphs. We propose a modification to a state-of-the-art graph matching algorithm that allows it to solve the bisected graph matching problem, using connections between brain hemispheres for better neuron pair predictions. We demonstrate improved matching accuracy by combining our approach with previous extensions to graph matching, including edge types and known neuron pairings.

NETWORK NEUROSCIENCE (2023)

Article Computer Science, Artificial Intelligence

Distance-based positive and unlabeled learning for ranking

Hayden S. Helm, Amitabh Basu, Avanti Athreya, Youngser Park, Joshua T. Vogelstein, Carey E. Priebe, Michael Winding, Marta Zlatic, Albert Cardona, Patrick Bourke, Jonathan Larson, Marah Abdin, Piali Choudhury, Weiwei Yang, Christopher W. White

Summary: Learning to rank is a problem of general interest, and we propose an effective approach using an integer linear program. We demonstrate its effectiveness through theoretical analysis, simulations, and real data examples.

PATTERN RECOGNITION (2023)

Article Medicine, General & Internal

Exploration of Residual Confounding in Analyses of Associations of Metformin Use and Outcomes in Adults With Type 2 Diabetes

Mike Powell, Callahan Clark, Anton Alyakin, Joshua T. Vogelstein, Brian Hart

Summary: This retrospective cohort study examines the use of metformin in patients with diabetes and proposes a more robust study design to address residual confounding. The results suggest that common observational study designs for metformin research are at risk for significant confounding.

JAMA NETWORK OPEN (2022)

Article Biochemical Research Methods

ReX: an integrative tool for quantifying and optimizing measurement reliability for the study of individual differences

Ting Xu, Gregory Kiar, Jae Wook Cho, Eric W. Bridgeford, Aki Nikolaidis, Joshua T. Vogelstein, Michael P. Milham

Summary: This article presents an integrative toolbox called Reliability eXplorer (ReX) that aids in examining individual variation and reliability in neuroscience biomarker discovery. Additionally, the article introduces a two-dimensional field map-based approach called gradient flows, which is implemented in ReX to identify and represent the most effective optimization direction for measuring individual differences.

NATURE METHODS (2023)

Article Biology

Generative network modeling reveals quantitative definitions of bilateral symmetry exhibited by a whole insect brain connectome

Benjamin D. Pedigo, Mike Powell, Eric W. Bridgeford, Michael Winding, Carey E. Priebe, Joshua T. Vogelstein, Srdjan Ostojic

Summary: Comparing connectomes can provide insights into the relationship between neural connectivity, genetics, disease, development, learning, and behavior. However, statistical inference about differences between two networks is challenging, especially at the nanoscale level. In this study, we investigate the bilateral symmetry of a larval Drosophila brain connectome to refine our understanding of symmetry. We find significant differences in connection probabilities across the left and right networks, as well as between specific cell types. This work demonstrates how statistical inferences from networks can enhance the study of connectomes.

ELIFE (2023)

Review Computer Science, Artificial Intelligence

First Organoid Intelligence (OI) workshop to form an OI community

Itzy Morales E. Pantoja, Lena Smirnova, Alysson R. Muotri, Karl J. Wahlin, Jeffrey Kahn, J. Lomax Boyd, David H. Gracias, Timothy D. Harris, Tzahi Cohen-Karni, Brain S. Caffo, Alexander S. Szalay, Fang Han, Donald J. Zack, Ralph Etienne-Cummings, Akwasi Akwaboah, July Carolina Romero, Dowlette-Mary Alam El Din, Jesse D. Plotkin, Barton L. Paulhamus, Erik C. Johnson, Frederic Gilbert, J. Lowry Curley, Ben Cappiello, Jens C. Schwamborn, Eric J. Hill, Paul Roach, Daniel Tornero, Caroline Krall, Rheinallt Parri, Fenna Sille, Andre Levchenko, Rabih E. Jabbour, Brett J. Kagan, Cynthia A. Berlinicke, Qi Huang, Alexandra Maertens, Kathrin Herrmann, Katya Tsaioun, Raha Dastgheyb, Christa Whelan Habela, Joshua T. Vogelstein, Thomas Hartung

Summary: The brain is a powerful computation system with efficient processing and adaptability. Advances in stem cell technology have led to the development of three-dimensional brain organoids that better mimic human brain functionality. Organoid Intelligence aims to use these capabilities for biocomputing and synthetic intelligence. Understanding how learning changes organoid connectivity can shed light on cognition in the human brain.

FRONTIERS IN ARTIFICIAL INTELLIGENCE (2023)

Article Mathematics, Applied

Manifold Oblique Random Forests: Towards Closing the Gap on Convolutional Deep Networks

Adam Li, Ronan Perry, Chester Huynh, Tyler M. Tomita, Ronak Mehta, Jesus Arroyo, Jesse Patsolic, Ben Falk, Sridevi Sarma, Joshua Vogelstein

Summary: Decision forests, such as random forests and gradient boosting trees, are highly accurate in unstructured tabular data while convolutional deep networks (ConvNets) outperform forests in structured data like images and time-series. This is partly because networks consider feature indices while naive forest implementations do not. The Manifold Oblique Random Forests (Morf) approach incorporates feature locality by choosing distributions in a manifold-aware manner, achieving fast computation and maintaining interpretability and theoretical justification. Morf exhibits excellent performance in classification tasks on both simulated data and real images and time-series.

SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE (2023)

Review Computer Science, Artificial Intelligence

Biological underpinnings for lifelong learning machines

Dhireesha Kudithipudi, Mario Aguilar-Simon, Jonathan Babb, Maxim Bazhenov, Douglas Blackiston, Josh Bongard, Andrew P. Brna, Suraj Chakravarthi Raja, Nick Cheney, Jeff Clune, Anurag Daram, Stefano Fusi, Peter Helfer, Leslie Kay, Nicholas Ketz, Zsolt Kira, Soheil Kolouri, Jeffrey L. Krichmar, Sam Kriegman, Michael Levin, Sandeep Madireddy, Santosh Manicka, Ali Marjaninejad, Bruce McNaughton, Risto Miikkulainen, Zaneta Navratilova, Tej Pandit, Alice Parker, Praveen K. Pilly, Sebastian Risi, Terrence J. Sejnowski, Andrea Soltoggio, Nicholas Soures, Andreas S. Tolias, Dario Urbina-Melendez, Francisco J. Valero-Cuevas, Gido M. van de Ven, Joshua T. Vogelstein, Felix Wang, Ron Weiss, Angel Yanguas-Gil, Xinyun Zou, Hava Siegelmann

Summary: Biological organisms learn from interactions with their environment, and artificial systems also need the ability to learn throughout their lifetime. This article introduces biological mechanisms and artificial models and mechanisms for lifelong learning, and discusses opportunities to bridge the gap between natural and artificial intelligence.

NATURE MACHINE INTELLIGENCE (2022)

No Data Available