4.7 Article

Synthetic images of high-throughput microscopy for validation of image analysis methods

Journal

PROCEEDINGS OF THE IEEE
Volume 96, Issue 8, Pages 1348-1360

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JPROC.2008.925490

Keywords

cell shape; high-throughput measurement; simulation; validation

Ask authors/readers for more resources

Automated image analysis provides a powerful tool when quantifying various characteristics of cell populations. Previously, the validation of image analysis results has been a task of expert biologist, who has manually analyzed the images and provided the ground truth to which the proposed analysis results have been compared. The traditional validation approach, prone to errors and variation, is unfeasible in the emergence of high-throughput measurement systems which make human-based analysis excessively laborious. The systems biology approach for studying, e.g., cellular activity massively in parallel, often lending on high-throughput microscopy, further increases the need for efficient, validated computational methods. As a solution for the problem, we propose a computational framework for simulating fluorescence microscopy images of cell populations. The simulation framework allows generation of synthetic images with realistic characteristics including the ground truth for validation. Thus, the simulation enables validation and performance analysis for various analysis algorithms. By creating a parameterized model of cells based on a given population, the simulator is able to create different cell types. The proposed modular framework, combined with the ability to create high-throughput measurements, provides a powerful tool for validating image analysis methods in traditional microscopy as well as in high content screening. Moreover, we use experimental data to study the validity of the proposed modeling approach.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Pathology

Interobserver reproducibility of perineural invasion of prostatic adenocarcinoma in needle biopsies

Lars Egevad, Brett Delahunt, Hemamali Samaratunga, Toyonori Tsuzuki, Henrik Olsson, Peter Strom, Cecilia Lindskog, Tomi Hakkinen, Kimmo Kartasalo, Martin Eklund, Pekka Ruusuvuori

Summary: This study found significant variability in the assessment of perineural invasion in prostate biopsies, with good interobserver agreement but still room for improvement and standardization. Immunohistochemistry staining can help clarify the diagnosis of PNI.

VIRCHOWS ARCHIV (2021)

Article Biochemistry & Molecular Biology

Convolutional Neural Network-Based Artificial Intelligence for Classification of Protein Localization Patterns

Kaisa Liimatainen, Riku Huttunen, Leena Latonen, Pekka Ruusuvuori

Summary: This study explored the use of deep neural networks for classifying protein localizations in 13 cellular subcompartments. The results showed that the fully convolutional network outperformed the convolutional neural network in classifying images with multiple simultaneous protein localizations, demonstrating its potential for systematic protein localization assessment.

BIOMOLECULES (2021)

Article Computer Science, Information Systems

Generalized Fixation Invariant Nuclei Detection Through Domain Adaptation Based Deep Learning

Mira Valkonen, Gunilla Hognas, G. Steven Bova, Pekka Ruusuvuori

Summary: The study demonstrates the impact of histopathological sample fixation on the accuracy of a deep learning based nuclei detection model, highlighting the importance of considering the variability introduced during sample preparation when building accurate and robust algorithms. The dataset with over 67,000 annotated nuclei locations from 16 patients and three different sample fixation types provides a solid foundation for developing accurate and robust nuclei detection models and enables generalization to images from unseen domains through unsupervised domain adaptation.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2021)

Article Biochemistry & Molecular Biology

Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the PANDA challenge

Wouter Bulten, Kimmo Kartasalo, Po-Hsuan Cameron Chen, Peter Strom, Hans Pinckaers, Kunal Nagpal, Yuannan Cai, David F. Steiner, Hester van Boven, Robert Vink, Christina Hulsbergen-van de Kaa, Jeroen van der Laak, Mahul B. Amin, Andrew J. Evans, Theodorus van der Kwast, Robert Allan, Peter A. Humphrey, Henrik Gronberg, Hemamali Samaratunga, Brett Delahunt, Toyonori Tsuzuki, Tomi Hakkinen, Lars Egevad, Maggie Demkin, Sohier Dane, Fraser Tan, Masi Valkonen, Greg S. Corrado, Lily Peng, Craig H. Mermel, Pekka Ruusuvuori, Geert Litjens, Martin Eklund

Summary: The PANDA challenge is the largest histopathology competition to date, aiming to catalyze the development of reproducible AI algorithms for Gleason grading in prostate cancer. The submitted algorithms achieved pathologist-level performance and their diversity and generalization were validated through cross-continental cohorts.

NATURE MEDICINE (2022)

Article Multidisciplinary Sciences

Spatial analysis of histology in 3D: quantification and visualization of organ and tumor level tissue environment

Pekka Ruusuvuori, Masi Valkonen, Kimmo Kartasalo, Mira Valkonen, Tapio Visakorpi, Matti Nykter, Leena Latonen

Summary: This article introduces a computational method for visualizing and quantitatively assessing histopathological alterations in three dimensions. By reconstructing the 3D representation of the whole organ and analyzing histological characteristics and regions of interest, tumors can be quantitatively evaluated and characterized. The 3D visualization of tissue with computationally quantified features provides an intuitive way to observe tissue pathology.

HELIYON (2022)

Article Pathology

Detection of perineural invasion in prostate needle biopsies with deep neural networks

Kimmo Kartasalo, Peter Strom, Pekka Ruusuvuori, Hemamali Samaratunga, Brett Delahunt, Toyonori Tsuzuki, Martin Eklund, Lars Egevad

Summary: This study developed an artificial intelligence algorithm based on deep neural networks for detecting perineural invasion (PNI) in prostate biopsies. By digitizing and annotating a large number of biopsy samples, the algorithm achieved high accuracy in PNI detection, potentially providing valuable assistance to pathologists.

VIRCHOWS ARCHIV (2022)

Article Oncology

miR-32 promotes MYC-driven prostate cancer

Mauro Scaravilli, Sonja Koivukoski, Andrew Gillen, Aya Bouazza, Pekka Ruusuvuori, Tapio Visakorpi, Leena Latonen

Summary: The study demonstrates that miR-32 promotes MYC-induced prostate adenocarcinoma and identifies PDK4 as a PC-relevant metabolic target of miR-32-3p. Elevated expression of miR-32 influences prostate tumor growth and phenotype, and regulates the expression of prostate secretome and several PC-related target genes.

ONCOGENESIS (2022)

Article Chemistry, Multidisciplinary

H&E Multi-Laboratory Staining Variance Exploration with Machine Learning

Fabi Prezja, Ilkka Polonen, Sami Ayramo, Pekka Ruusuvuori, Teijo Kuopio

Summary: In this study, the staining variance between different laboratories on three tissue types was evaluated using machine learning. The results showed that both laboratory effects and tissue type bias contributed to the inter-laboratory staining variance.

APPLIED SCIENCES-BASEL (2022)

Article Pathology

Deep Learning-Based Image Analysis of Liver Steatosis in Mouse Models

Laura Mairinoja, Hanna Heikela, Sami Blom, Darshan Kumar, Anna Knuuttila, Sonja Boyd, Nelli Sjoblom, Eva-Maria Birkman, Petteri Rinne, Pekka Ruusuvuori, Leena Strauss, Matti Poutanen

Summary: The incidence of nonalcoholic fatty liver disease is increasing worldwide, and there is a need for new methods to study its manifestation and analyze drug efficacy in preclinical models. This study developed a deep neural network-based model to quantify different types of steatosis in the liver on stained whole slide images. The algorithm accurately detected liver parenchyma, excluded blood vessels and artifacts, differentiated microvesicular and macrovesicular steatosis, and quantified the recognized tissue area. The results correlated well with expert pathologists' evaluation and liver fat content measurements, demonstrating the reliability of the model.

AMERICAN JOURNAL OF PATHOLOGY (2023)

Article Multidisciplinary Sciences

Domain-specific transfer learning in the automated scoring of tumor-stroma ratio from histopathological images of colorectal cancer

Liisa Petainen, Juha P. Vayrynen, Pekka Ruusuvuori, Ilkka Polonen, Sami Ayramo, Teijo Kuopio

Summary: This study proposes an automated method for estimating tumor-stroma ratio (TSR) from histopathological images of colorectal cancer using convolutional neural networks. The models achieved high accuracy in classifying stroma, tumor, and other tissues, with the best model reaching 99.3% accuracy for tumor classification. The predicted TSR values showed moderate correlation with pathologist estimations (0.57).

PLOS ONE (2023)

Article Computer Science, Artificial Intelligence

The effect of neural network architecture on virtual H&E staining: Systematic assessment of histological feasibility

Umair Khan, Sonja Koivukoski, Mira Valkonen, Leena Latonen, Pekka Ruusuvuori

Summary: Conventional histopathology relies on chemical staining, which is a labor-intensive procedure that alters tissue irreversibly. Virtual staining using deep learning can overcome these drawbacks. In this study, we used unstained tissue sections and investigated the impact of increased network capacity on virtually stained images. By optimizing the network architecture, we achieved higher structural similarity, signal-to-noise ratio, and nuclei reproduction accuracy. Our findings demonstrate the potential of virtual staining in streamlining histopathological analysis.

PATTERNS (2023)

Article Computer Science, Artificial Intelligence

Deformation equivariant cross-modality image synthesis with paired non-aligned training data

Joel Honkamaa, Umair Khan, Sonja Koivukoski, Mira Valkonen, Leena Latonen, Pekka Ruusuvuori, Pekka Marttinen

Summary: This work proposes a generic solution for cross-modality image synthesis with paired but non-aligned data by introducing new deformation equivariance encouraging loss functions. The method involves joint training of an image synthesis network and separate registration networks, allowing adversarial training even with misaligned data. It lowers the barriers for training cross-modality image synthesis networks for more difficult data sets.

MEDICAL IMAGE ANALYSIS (2023)

Article Endocrinology & Metabolism

STAGETOOL, a Novel Automated Approach for Mouse Testis Histological Analysis

Oliver Meikar, Daniel Majoral, Olli Heikkinen, Eero Valkama, Sini Leskinen, Ana Rebane, Pekka Ruusuvuori, Jorma Toppari, Juho-Antti Makela, Noora Kotaja

Summary: Spermatogenesis is a complex differentiation process that occurs in the seminiferous tubules. A specific organization of spermatogenic cells within the seminiferous epithelium allows for synchronous progression of germ cells at certain stages of differentiation. To facilitate the analysis of spermatogenesis, researchers have developed a convolutional deep neural network-based approach called STAGETOOL. STAGETOOL accurately classifies histological images of DAPI-stained mouse testis cross-sections into different stage classes and cell categories. It has high classification accuracy and can be applied for analyzing spermatogenic defects in knockout mouse models and profiling protein expression patterns. STAGETOOL represents a major advancement in male reproductive biology research.

ENDOCRINOLOGY (2022)

Meeting Abstract Urology & Nephrology

A robust artificial intelligence approach for histopathological evaluation of prostate biopsies

N. Mulliqi, K. Kartasalo, X. Ji, K. Szolnoky, H. Olsson, A. Blilie, M. Braun, M. Gambacorta, K. Hotakainen, E. A. M. Janssen, S. R. Kjosavik, R. Lowicki, B. G. Pedersen, K. D. Sorensen, B. P. Ulhoi, P. Ruusuvuori, L. Egevad, M. Eklund

EUROPEAN UROLOGY (2022)

Meeting Abstract Urology & Nephrology

Crowdsourcing of artificial intelligence algorithms for diagnosis and Gleason grading of prostate cancer in biopsies

K. Kartasalo, W. Bulten, P-H. C. Chen, P. Strom, H. Pinckaers, K. Nagpal, P. Ruusuvuori, G. Litjens, M. Eklund

EUROPEAN UROLOGY (2022)

No Data Available