4.6 Review Book Chapter

Emerging Themes in Image Informatics and Molecular Analysis for Digital Pathology

期刊

出版社

ANNUAL REVIEWS
DOI: 10.1146/annurev-bioeng-112415-114722

关键词

digital pathology; algorithms; computational; precision medicine; chemical imaging; infrared spectroscopic imaging; FT-IR spectroscopy; microenvironment; stainless staining; diagnosis; prognosis; outcome

资金

  1. NCI NIH HHS [R01 CA197516, R21 CA179327, U24 CA199374, R21 CA195152, R21 CA190120] Funding Source: Medline
  2. NIBIB NIH HHS [R01 EB009745] Funding Source: Medline
  3. NIDDK NIH HHS [R01 DK098503] Funding Source: Medline
  4. NIGMS NIH HHS [R01 GM117594] Funding Source: Medline
  5. NATIONAL CANCER INSTITUTE [U24CA199374, R21CA179327, R21CA195152, R21CA190120, R01CA197516] Funding Source: NIH RePORTER
  6. NATIONAL INSTITUTE OF BIOMEDICAL IMAGING AND BIOENGINEERING [R01EB009745] Funding Source: NIH RePORTER
  7. NATIONAL INSTITUTE OF DIABETES AND DIGESTIVE AND KIDNEY DISEASES [R01DK098503] Funding Source: NIH RePORTER
  8. NATIONAL INSTITUTE OF GENERAL MEDICAL SCIENCES [R01GM117594] Funding Source: NIH RePORTER

向作者/读者索取更多资源

Pathology is essential for research in disease and development, as well as for clinical decision making. For more than 100 years, pathology practice has involved analyzing images of stained, thin tissue sections by a trained human using an optical microscope. Technological advances are now driving major changes in this paradigm toward digital pathology (DP). The digital transformation of pathology goes beyond recording, archiving, and retrieving images, providing new computational tools to inform better decision making for precision medicine. First, we discuss some emerging innovations in both computational image analytics and imaging instrumentation in DP. Second, we discuss molecular contrast in pathology. Molecular DP has traditionally been an extension of pathology with molecularly specific dyes. Label-free, spectroscopic images are rapidly emerging as another important information source, and we describe the benefits and potential of this evolution. Third, we describe multimodal DP, which is enabled by computational algorithms and combines the best characteristics of structural and molecular pathology. Finally, we provide examples of application areas in telepathology, education, and precision medicine. We conclude by discussing challenges and emerging opportunities in this area.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Oncology

Computational image features of immune architecture is associated with clinical benefit and survival in gynecological cancers across treatment modalities

Sepideh Azarianpour, German Corredor, Kaustav Bera, Patrick Leo, Pingfu Fu, Paula Toro, Amy Joehlin-Price, Mojgan Mokhtari, Haider Mahdi, Anant Madabhushi

Summary: This study presents a computational approach for characterizing the architecture and interplay of tumor-infiltrating lymphocytes (TILs) in gynecological cancer. The results show that the computed features are prognostic in different treatment types and are closely associated with central biological processes that impact tumor progression.

JOURNAL FOR IMMUNOTHERAPY OF CANCER (2022)

Article Gastroenterology & Hepatology

Integrating Radiomics With Clinicoradiological Scoring Can Predict High-Risk Patients Who Need Surgery in Crohn's Disease: A Pilot Study

Prathyush Chirra, Anamay Sharma, Kaustav Bera, H. Matthew Cohn, Jacob A. Kurowski, Katelin Amann, Marco-Jose Rivero, Anant Madabhushi, Cheng Lu, Rajmohan Paspulati, Sharon L. Stein, Jeffrey A. Katz, Satish E. Viswanath, Maneesh Dave

Summary: Radiomic features extracted from magnetic resonance enterography are associated with the need for surgery in Crohn's disease patients at risk of complications, and when combined with clinical variables and radiological assessment, they can accurately predict the time to surgery.

INFLAMMATORY BOWEL DISEASES (2023)

Article Oncology

Automated analysis of computerized morphological features of cell clusters associated with malignancy on bile duct brushing whole slide images

Shayan Monabbati, Patrick Leo, Kaustav Bera, Claire W. Michael, Behtash G. Nezami, Aparna Harbhajanka, Anant Madabhushi

Summary: This study used computational image analysis to predict the presence of pancreatic and biliary tract adenocarcinoma on digitized brush cytology specimens. By extracting nuclear morphological and texture features and training machine learning classifiers, the researchers successfully improved the sensitivity and specificity of diagnosis.

CANCER MEDICINE (2023)

Article Medicine, Research & Experimental

Deepfake Histologic Images for Enhancing Digital Pathology

Kianoush Falahkheirkhah, Saumya Tiwari, Kevin Yeh, Sounak Gupta, Loren Herrera-Hernandez, Michael R. McCarthy, Rafael E. Jimenez, John C. Cheville, Rohit Bhargava

Summary: A pathologist's examination of tissue on glass slides is the gold standard for tissue diagnostics, but obtaining expert-level annotated images is expensive. This study presents a generative adversarial network model that synthesizes pathology images, which performed similarly to real data. Furthermore, the ability for a user to generate deepfake histologic images using a simple markup of sematic labels is demonstrated.

LABORATORY INVESTIGATION (2023)

Article Computer Science, Artificial Intelligence

Multi-site cross-organ calibrated deep learning (MuSClD): Automated diagnosis of non-melanoma skin cancer

Yufei Zhou, Can Koyuncu, Cheng Lu, Rainer Grobholz, Ian Katz, Anant Madabhushi, Andrew Janowczyk

Summary: Deep learning performs well in computational pathology tasks but struggles with domain shift on whole slide images generated at external test sites. To address this, researchers propose using off-target organs from the test site for calibration, effectively mitigating the domain shift and improving the robustness of the model for skin cancer classification.

MEDICAL IMAGE ANALYSIS (2023)

Article Oncology

Nondestructive 3D pathology with analysis of nuclear features for prostate cancer risk assessment

Robert Serafin, Can Koyuncu, Weisi Xie, Hongyi Huang, Adam K. Glaser, Nicholas P. Reder, Andrew Janowczyk, Lawrence D. True, Anant Madabhushi, Jonathan T. C. Liu

Summary: Previous studies have shown that computational analysis of 2D histology images can improve prognostication of prostate cancer outcomes. This study expands on previous work by exploring the prognostic value of 3D shape-based nuclear features in prostate cancer. The results suggest that these features are associated with cancer aggressiveness and could be valuable for decision-support tools.

JOURNAL OF PATHOLOGY (2023)

Article Chemistry, Multidisciplinary

Plasma Electrochemistry for Carbon-Carbon Bond Formation via Pinacol Coupling

Jian Wang, Necip B. Uner, Scott Edwin Dubowsky, Matthew P. Confer, Rohit Bhargava, Yunyan Sun, Yuting Zhou, R. Mohan Sankaran, Jeffrey S. Moore

Summary: The formation of carbon-carbon bonds by pinacol coupling of aldehydes and ketones can be achieved using solvated electrons generated via a plasma-liquid process. Selectivity over the competing reduction to the alcohol requires careful control over mass transport. The generality of this method is demonstrated with various substrates, and a reaction-diffusion model and ab initio calculations provide insights into the mechanism. This study opens the possibility of a metal-free, electrically-powered, sustainable method for reductive organic reactions.

JOURNAL OF THE AMERICAN CHEMICAL SOCIETY (2023)

Article Chemistry, Analytical

Phasor Representation Approach for Rapid Exploratory Analysis of Large Infrared Spectroscopic Imaging Data Sets

Sudipta S. Mukherjee, Rohit Bhargava

Summary: Infrared (IR) spectroscopic imaging provides spatially resolved molecular absorption spectra, and this study introduces a fast and reliable method based on a phasor representation of spectra. The method is applicable for rapid data exploration and analysis of IR imaging data, and shows potential in biomedical tissue imaging.

ANALYTICAL CHEMISTRY (2023)

Review Oncology

Pitfalls in machine learning-based assessment of tumor-infiltrating lymphocytes in breast cancer: a report of the international immuno-oncology biomarker working group

Jeppe Thagaard, Glenn Broeckx, David B. Page, Chowdhury Arif Jahangir, Sara Verbandt, Zuzana Kos, Rajarsi Gupta, Reena Khiroya, Khalid Abduljabbar, Gabriela Acosta Haab, Balazs Acs, Guray Akturk, Jonas S. Almeida, Isabel Alvarado-Cabrero, Mohamed Amgad, Farid Azmoudeh-Ardalan, Sunil Badve, Nurkhairul Bariyah Baharun, Eva Balslev, Enrique R. Bellolio, Vydehi Bheemaraju, Kim R. M. Blenman, Luciana Botinelly Mendonca Fujimoto, Najat Bouchmaa, Octavio Burgues, Alexandros Chardas, Maggie U. Cheang, Francesco Ciompi, Lee A. D. Cooper, An Coosemans, German Corredor, Anders B. Dahl, Flavio Luis Dantas Portela, Frederik Deman, Sandra Demaria, Johan Dore Hansen, Sarah N. Dudgeon, Thomas Ebstrup, Mahmoud Elghazawy, Claudio Fernandez-Martin, Stephen B. Fox, William M. Gallagher, Jennifer M. Giltnane, Sacha Gnjatic, Paula Gonzalez-Ericsson, Anita Grigoriadis, Niels Halama, Matthew G. Hanna, Aparna Harbhajanka, Steven N. Hart, Johan Hartman, Soren Hauberg, Stephen Hewitt, Akira Hida, Hugo M. Horlings, Zaheed Husain, Evangelos Hytopoulos, Sheeba Irshad, Emiel A. M. Janssen, Mohamed Kahila, Tatsuki R. Kataoka, Kosuke Kawaguchi, Durga Kharidehal, Andrey Khramtsov, Umay Kiraz, Pawan Kirtani, Liudmila L. Kodach, Konstanty Korski, Aniko Kovacs, Anne-Vibeke Laenkholm, Corinna Lang-Schwarz, Denis Larsimont, Jochen K. Lennerz, Marvin Lerousseau, Xiaoxian Li, Amy Ly, Anant Madabhushi, Sai K. Maley, Vidya Manur Narasimhamurthy, Douglas K. Marks, Elizabeth S. McDonald, Ravi Mehrotra, Stefan Michiels, Fayyaz ul Amir Afsar Minhas, Shachi Mittal, David A. Moore, Shamim Mushtaq, Hussain Nighat, Thomas Papathomas, Frederique Penault-Llorca, Rashindrie D. Perera, Christopher J. Pinard, Juan Carlos Pinto-Cardenas, Giancarlo Pruneri, Lajos Pusztai, Arman Rahman, Nasir Mahmood Rajpoot, Bernardo Leon Rapoport, Tilman T. Rau, Jorge S. Reis-Filho, Joana M. Ribeiro, David Rimm, Anne Roslind, Anne Vincent-Salomon, Manuel Salto-Tellez, Joel Saltz, Shahin Sayed, Ely Scott, Kalliopi P. Siziopikou, Christos Sotiriou, Albrecht Stenzinger, Maher A. Sughayer, Daniel Sur, Susan Fineberg, Fraser Symmans, Sunao Tanaka, Timothy Taxter, Sabine Tejpar, Jonas Teuwen, E. Aubrey Thompson, Trine Tramm, William T. Tran, Jeroen van Der Laak, Paul J. van Diest, Gregory E. Verghese, Giuseppe Viale, Michael Vieth, Noorul Wahab, Thomas Walter, Yannick Waumans, Hannah Y. Wen, Wentao Yang, Yinyin Yuan, Reena Md Zin, Sylvia Adams, John Bartlett, Sibylle Loibl, Carsten Denkert, Peter Savas, Sherene Loi, Roberto Salgado, Elisabeth Specht Stovgaard

Summary: The clinical significance of tumor-immune interaction in breast cancer has been established. Tumor-infiltrating lymphocytes (TILs) have emerged as predictive and prognostic biomarkers for patients with triple-negative and HER2-positive breast cancer. The use of machine learning (ML) to automatically evaluate TILs has shown promising results. However, there are challenges in implementing this in trial and routine clinical management, including technical slide issues, ML and image analysis aspects, data challenges, and validation issues.

JOURNAL OF PATHOLOGY (2023)

Review Oncology

Spatial analyses of immune cell infiltration in cancer: current methods and future directions. A report of the International Immuno-Oncology Biomarker Working Group on Breast Cancer

David B. Page, Glenn Broeckx, Chowdhury Arif Jahangir, Chowdhury Jahangir, Sara Verbandt, Rajarsi R. Gupta, Jeppe Thagaard, Reena Khiroya, Zuzana Kos, Khalid Abduljabbar, Gabriela Acosta Haab, Balazs Acs, Jonas S. Almeida, Isabel Alvarado-Cabrero, Farid Azmoudeh-Ardalan, Sunil Badve, Nurkhairul Bariyah Baharun, Enrique R. Bellolio, Vydehi Bheemaraju, Kim R. M. Blenman, Luciana Botinelly Mendonca Fujimoto, Octavio Burgues, Maggie Chon U. Cheang, Francesco Ciompi, Lee A. D. Cooper, An Coosemans, German Corredor, Flavio Luis Dantas Portela, Frederik Deman, Sandra Demaria, Sarah N. Dudgeon, Mahmoud Elghazawy, Scott Ely, Claudio Fernandez-Martin, Susan Fineberg, Stephen B. Fox, William M. Gallagher, Jennifer M. Giltnane, Sacha Gnjatic, Paula Gonzalez-Ericsson, Anita Grigoriadis, Niels Halama, Matthew G. Hanna, Aparna Harbhajanka, Alexandros Hardas, Steven N. Hart, Johan Hartman, Stephen Hewitt, Akira Hida, Hugo M. Horlings, Zaheed Husain, Evangelos Hytopoulos, Sheeba Irshad, Emiel A. M. Janssen, Mohamed Kahila, Tatsuki R. Kataoka, Kosuke Kawaguchi, Durga Kharidehal, Andrey Khramtsov, Umay Kiraz, Pawan Kirtani, Liudmila L. Kodach, Konstanty Korski, Aniko Kovacs, Anne-Vibeke Laenkholm, Corinna Lang-Schwarz, Denis Larsimont, Jochen K. Lennerz, Marvin Lerousseau, Xiaoxian Li, Amy Ly, Anant Madabhushi, Sai K. Maley, Vidya Manur Narasimhamurthy, Douglas K. Marks, Elizabeth S. McDonald, Ravi Mehrotra, Stefan Michiels, Fayyaz ul Amir Afsar Minhas, Shachi Mittal, David A. Moore, Shamim Mushtaq, Hussain Nighat, Thomas Papathomas, Frederique Penault-Llorca, Rashindrie D. Perera, Christopher J. Pinard, Juan Carlos Pinto-Cardenas, Giancarlo Pruneri, Lajos Pusztai, Arman Rahman, Nasir Mahmood Rajpoot, Bernardo Leon Rapoport, Tilman T. Rau, Jorge S. Reis-Filho, Joana M. Ribeiro, David Rimm, Anne-Vincent Salomon, Manuel Salto-Tellez, Joel Saltz, Shahin Sayed, Kalliopi P. Siziopikou, Christos Sotiriou, Albrecht Stenzinger, Maher A. Sughayer, Daniel Sur, Fraser Symmans, Sunao Tanaka, Timothy Taxter, Sabine Tejpar, Jonas Teuwen, E. Aubrey Thompson, Trine Tramm, William T. Tran, Jeroen van Der Laak, Paul J. van Diest, Gregory E. Verghese, Giuseppe Viale, Michael Vieth, Noorul Wahab, Thomas Walter, Yannick Waumans, Hannah Y. Wen, Wentao Yang, Yinyin Yuan, Sylvia Adams, John Mark Seaverns Bartlett, Sibylle Loibl, Carsten Denkert, Peter Savas, Sherene Loi, Roberto Salgado, Elisabeth Specht Stovgaard, Guray Akturk, Najat Bouchmaa

Summary: Modern histologic imaging platforms combined with machine learning methods offer new opportunities for studying the spatial distribution of immune cells in the tumor microenvironment. However, there is currently no standardized method for describing or analyzing spatial immune cell data, and most previous spatial analyses have been simplistic. In this review, two approaches (raster versus vector-based) for reporting and analyzing spatial data are outlined, along with a summary of reported spatial immune cell metrics and their prognostic associations in various cancers. Two well-described clinical biomarkers, the breast cancer stromal tumor infiltrating lymphocytes score and the colon cancer Immunoscore, are also discussed, along with potential research opportunities to improve the clinical utility of these spatial biomarkers.

JOURNAL OF PATHOLOGY (2023)

Article Oncology

Delta radiomic patterns on serial bi-parametric MRI are associated with pathologic upgrading in prostate cancer patients on active surveillance: preliminary findings

Abhishek Midya, Amogh Hiremath, Jacob Huber, Vidya Sankar Viswanathan, Danly Omil-Lima, Amr Mahran, Leonardo K. Bittencourt, Sree Harsha Tirumani, Lee Ponsky, Rakesh Shiradkar, Anant Madabhushi

Summary: The objective of this study was to quantify radiomic changes in prostate cancer progression on serial MRI among patients on active surveillance and evaluate their association with pathologic progression on biopsy. The study found that delta radiomics were more strongly associated with upgrade events compared to other clinical variables, and the combination of delta radiomics with baseline clinical variables showed the strongest association with biopsy upgrade prediction.

FRONTIERS IN ONCOLOGY (2023)

Article Oncology

Radiomic predicts early response to CDK4/6 inhibitors in hormone receptor positive metastatic breast cancer

Mohammadhadi Khorrami, Vidya Sakar Viswanathan, Priyanka Reddy, Nathaniel Braman, Siddharth Kunte, Amit Gupta, Jame Abraham, Alberto J. Montero, Anant Madabhushi

Summary: Imaging texture biomarkers before and after CDK4/6i therapy can predict early response and overall survival in MBC patients with liver metastases. Radiomic features can predict a lack of response earlier than standard anatomic/RECIST 1.1 assessment, highlighting the need for further study and clinical validation.

NPJ BREAST CANCER (2023)

Article Pathology

Identifying primary tumor site of origin for liver metastases via a combination of handcrafted and deep learning features

Chuheng Chen, Cheng Lu, Vidya Viswanathan, Brandon Maveal, Bhunesh Maheshwari, Joseph Willis, Anant Madabhushi

Summary: This study uses computer-extracted histomorphometric features to identify the primary site of origin for liver metastases. It found that features related to nuclear and peri-nuclear shape were the most important in classifying different metastatic tumors. Additionally, attention maps generated by a deep learning network can provide a composite feature similarity heat map between primary tumors and their associated metastases.

JOURNAL OF PATHOLOGY CLINICAL RESEARCH (2023)

Article Computer Science, Interdisciplinary Applications

Automatic myeloblast segmentation in acute myeloid leukemia images based on adversarial feature learning

Zelin Zhang, Sara Arabyarmohammadi, Patrick Leo, Howard Meyerson, Leland Metheny, Jun Xu, Anant Madabhushi

Summary: This article introduces a segmentation model based on conditional generative adversarial network for efficient segmentation of myeloblasts from slides of AML patients. Through validation experiments, it is confirmed that this method has better segmentation performance than other deep learning models, and prognostic models for predicting the risk of recurrence in AML patients have been constructed using the segmentation results.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2024)

Article Urology & Nephrology

Clinical Relevance of Computationally Derived Attributes of Peritubular Capillaries from Kidney Biopsies

Yijiang Chen, Jarcy Zee, Andrew R. Janowczyk, Jeremy Rubin, Paula Toro, Kyle J. Lafata, Laura H. Mariani, Lawrence B. Holzman, Jeffrey B. Hodgin, Anant Madabhushi, Laura Barisoni

Summary: Computational image analysis enables quantification of PTC attributes and the discovery of a previously unrecognized PTC biomarker (aspect ratio) associated with clinical outcome.

KIDNEY360 (2023)

暂无数据