4.7 Article

Learning to Classify Structures in ALS-Derived Visualizations of Ancient Maya Settlements with CNN

Journal

REMOTE SENSING
Volume 12, Issue 14, Pages -

Publisher

MDPI
DOI: 10.3390/rs12142215

Keywords

relief mapping; visualization; archaeology; convolutional neural networks; deep learning; computer vision; airborne laser scanning; lidar; VAT; image classification

Funding

  1. Slovenian Research Agency [P2-0406, P2-0103, J6-9395]
  2. European Space Agency

Ask authors/readers for more resources

Archaeologists engaging with Airborne Laser Scanning (ALS) data rely heavily on manual inspection of various derived visualizations. However, manual inspection of ALS data is extremely time-consuming and as such presents a major bottleneck in the data analysis workflow. We have therefore set out to learn and test a deep neural network model for classifying from previously manually annotated ancient Maya structures of the Chactun archaeological site in Campeche, Mexico. We considered several variations of the VGG-19 Convolutional Neural Network (CNN) to solve the task of classifying visualized example structures from previously manually annotated ALS images of man-made aguadas, buildings and platforms, as well as images of surrounding terrain (four classes and over 12,000 anthropogenic structures). We investigated how various parameters impact model performance, using: (a) six different visualization blends, (b) two different edge buffer sizes, (c) additional data augmentation and (d) architectures with different numbers of untrainable, frozen layers at the beginning of the network. Many of the models learned under the different scenarios exceeded the overall classification accuracy of 95%. Using overall accuracy, terrain precision and recall (detection rate) per class of anthropogenic structure as criteria, we selected visualization with slope, sky-view factor and positive openness in separate bands; image samples with a two-pixels edge buffer; Keras data augmentation; and five frozen layers as the optimal combination of building blocks for learning our CNN model.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Explaining the performance of multilabel classification methods with data set properties

Jasmin Bogatinovski, Ljupco Todorovski, Saso Dzeroski, Dragi Kocev

Summary: In this study, a comprehensive meta-learning analysis of data sets and methods for multilabel classification was conducted. The results showed that meta features describing the label space were the most important, and meta features describing label relationships occurred more frequently than those describing label distributions. Furthermore, optimizing hyperparameters can improve predictive performance, although the extent of improvement may not always be justified by resource utilization.

INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS (2022)

Article Cell Biology

Wet-dry-wet drug screen leads to the synthesis of TS1, a novel compound reversing lung fibrosis through inhibition of myofibroblast differentiation

Nadja Anneliese Ruth Ring, Maria Concetta Volpe, Tomaz Stepisnik, Maria Grazia Mamolo, Pane Panov, Dragi Kocev, Simone Vodret, Sara Fortuna, Antonella Calabretti, Michael Rehman, Andrea Colliva, Pietro Marchesan, Luca Camparini, Thomas Marcuzzo, Rossana Bussani, Sara Scarabellotto, Marco Confalonieri, Tho X. Pham, Giovanni Ligresti, Nunzia Caporarello, Francesco S. Loffredo, Daniele Zampieri, Saso Dzeroski, Serena Zacchigna

Summary: This study used machine learning analysis to virtually screen millions of compounds and identified new anti-fibrotic drugs that inhibit myofibroblast differentiation. Dopamine and its derivative TS1 were found to be effective inhibitors of myofibroblast activation, acting through dopamine receptor 3 and the transforming growth factor beta pathway. TS1 also had a preventive and reversing effect on lung fibrosis.

CELL DEATH & DISEASE (2022)

Article Biotechnology & Applied Microbiology

A multidisciplinary study of biodeteriorated Celje Ceiling, a tempera painting on canvas

Katja Kavkler, Miha Humar, Davor Krzisnik, Martina Turk, Crtomir Tavzes, Cene Gostincar, Saso Dzeroski, Stefan Popov, Ana Penko, Nina Gunde-Cimerman, Polona Zalar

Summary: Interdisciplinary investigations were conducted to assess the damage of a 17th century tempera painting. The study found that the position of the painting and microclimatic conditions were the main factors influencing mold biodeterioration, while the presence of a coating layer, protein binders, and pigments also played important roles in mold development.

INTERNATIONAL BIODETERIORATION & BIODEGRADATION (2022)

Article Computer Science, Artificial Intelligence

Surrogate models of radiative transfer codes for atmospheric trace gas retrievals from satellite observations

Jure Brence, Jovan Tanevski, Jennifer Adams, Edward Malina, Saso Dzeroski

Summary: This study presents the development of surrogate models for two radiative transfer models (RTMs), which can speed up the simulation process and accurately emulate satellite observations. The surrogate models show good performance in simulating Sentinel 5P spectra and exhibit broad applicability in different parameter sets and applications.

MACHINE LEARNING (2023)

Article Microbiology

Occurrence, Diversity and Anti-Fungal Resistance of Fungi in Sand of an Urban Beach in Slovenia-Environmental Monitoring with Possible Health Risk Implications

Monika Novak Babic, Nina Gunde-Cimerman, Martin Breskvar, Saso Dzeroski, Joao Brandao

Summary: This study focuses on the fungal communities in beach sand and seawater, revealing the impact of environmental and seasonal changes on these communities. It also finds certain fungi with drug resistance and identifies pollution indicators for beach microbial regulation.

JOURNAL OF FUNGI (2022)

Article Engineering, Industrial

Analysis of hallux valgus angles automatically extracted from 3D foot scans taken in North America, Europe, and Asia

Yang Jiao, Saso Dzeroski, Ales Jurca

Summary: This study investigates the variation in toe shape, as measured by the hallux valgus angle, and finds that it has a normal distribution in the general population. Females have larger angles compared to males, and people from Asia have larger angles compared to those from North America and Europe.

ERGONOMICS (2023)

Article Environmental Sciences

Deep Network Architectures as Feature Extractors for Multi-Label Classification of Remote Sensing Images

Marjan Stoimchev, Dragi Kocev, Saso Dzeroski

Summary: Images are now being generated at an unprecedented rate, and remote sensing images have attracted considerable research attention in image classification. Recently, the task of assigning multiple semantic categories to an image, known as multi-label classification, has become increasingly complex. This work explores different strategies for model training using pre-trained convolutional neural network architectures and traditional tree ensemble methods for multi-label classification, and conducts extensive experimental analysis on publicly available remote sensing image datasets.

REMOTE SENSING (2023)

Article Chemistry, Analytical

Correlative Fluorescence and Raman Microscopy to Define Mitotic Stages at the Single-Cell Level: Opportunities and Limitations in the AI Era

Csaba Voros, David Bauer, Ede Migh, Istvan Grexa, Attila Gergely Vegh, Balazs Szalontai, Gastone Castellani, Tivadar Danka, Saso Dzeroski, Krisztian Koos, Filippo Piccinini, Peter Horvath

Summary: Nowadays, morphology and molecular analyses at the single-cell level have a fundamental role in understanding biology better. These methods are utilized for cell phenotyping and in-depth studies of cellular processes, such as mitosis. Fluorescence microscopy and Raman microscopy techniques provide detailed morphological information and spatial distribution of molecular fingerprints, respectively, enabling the study of cellular stages at the single-cell level. Artificial intelligence can characterize the molecular backgrounds of phenotypes and biological processes by analyzing spectral maps, making it a valuable solution for interpreting complex subcellular spectral maps.

BIOSENSORS-BASEL (2023)

Article Biology

On the Influence of Aging on Classification Performance in the Visual EEG Oddball Paradigm Using Statistical and Temporal Features

Nina Omejc, Manca Peskar, Aleksandar Miladinovic, Voyko Kavcic, Saso Dzeroski, Uros Marusic

Summary: The use of non-invasive EEG as an input sensor in brain-computer interfaces is common, but the collected EEG data face challenges, such as age-related variability of ERPs. To assess the effects of aging, a study was conducted with young and older individuals using EEG. Two types of EEG datasets were created for classifier training, and linear classifiers performed best. It was found that classification performance differs between dataset types, and using temporal features resulted in higher and more consistent performance scores. The effect of aging on classification performance depends on the classifier and its feature ranking, highlighting the importance of careful feature extraction and selection to avoid age-related performance degradation in practice.

LIFE-BASEL (2023)

Article Computer Science, Information Systems

Dimensionally-consistent equation discovery through probabilistic attribute grammars

Jure Brence, Saso Dzeroski, Ljupco Todorovski

Summary: This paper proposes using attribute grammars to ensure the dimensional consistency of the induced equations, which can combine cross-domain knowledge and domain-specific knowledge effectively. The study also demonstrates that attribute grammars can be transformed into probabilistic context-free grammars for equation discovery efficiently. Furthermore, empirical evidence shows that attribute grammars ensuring dimensional consistency of equations can significantly improve the performance of equation discovery on the standard set of a hundred Feynman benchmarks.

INFORMATION SCIENCES (2023)

Article Engineering, Aerospace

Data stream mining for predicting the thermal power consumption of the Mars Express spacecraft

Bozhidar Stevanoski, Dragi Kocev, Aljaz Osojnik, Ivica Dimitrovski, Saso Dzeroski

Summary: The Mars Express spacecraft, operated by the European Space Agency, has provided unprecedented scientific data about Mars but also needs accurate power modeling due to degradation. This pilot study predicts the thermal power consumption of the spacecraft using telemetry data, employing multi-target regression and considering both local and global approaches.

ACTA ASTRONAUTICA (2023)

Article Multidisciplinary Sciences

Machine learning-ready remote sensing data for Maya archaeology

Ziga Kokalj, Saso Dzeroski, Ivan Sprajc, Jasmina Stajdohar, Andrej Draksler, Maja Somrak

Summary: This study aims to collect a multimodal annotated dataset suitable for deep learning in remote sensing of Maya archaeology. The dataset covers the area around Chactun, one of the largest ancient Maya urban centres in the central Yucatan Peninsula. It includes raster visualisations and canopy height models from airborne laser scanning, satellite data from Sentinel-1 and Sentinel-2, as well as manual data annotations representing different types of ancient Maya structures.

SCIENTIFIC DATA (2023)

Article Microbiology

Effect of Location, Disinfection, and Building Materials on the Presence and Richness of Culturable Mycobiota through Oligotrophic Drinking Water Systems

Monika Novak Babic, Gregor Marolt, Jernej Imperl, Martin Breskvar, Saso Dzeroski, Nina Gunde-Cimerman

Summary: The presence and abundance of fungi in water are influenced by the source of water, water cleaning methods, and the materials in contact with water. Chlorination reduces fungal numbers, but its effect diminishes with longer water networks. Different fungi are observed on different materials, with plastic materials being more susceptible to colonization by basidiomycetous fungi.

JOURNAL OF FUNGI (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Algorithm Instance Footprint: Separating Easily Solvable and Challenging Problem Instances

Ana Nikolikj, Saso Dzeroski, Mario Andres Munoz, Carola Doerr, Peter Korosec, Tome Eftimov

Summary: In black-box optimization, understanding the behavior of an algorithm instance is crucial. We propose a methodology that formulates an algorithm instance footprint by identifying easy and difficult problem instances. This methodology uses meta-representations to link algorithm performance and landscape properties, and clustering to detect regions of poor and good algorithm performance.

PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023 (2023)

Article Computer Science, Artificial Intelligence

Survival analysis as semi-supervised multi-target regression for time-to-employment prediction using oblique predictive clustering trees

Viktor Andonovikj, Pavle Boskoski, Saso Dzeroski, Biljana Mileva Boshkoska

Summary: This study addresses the problem of estimating the time-to-employment of a jobseeker using survival analysis and oblique predictive clustering tree. The approach treats censored data as missing data and shows its effectiveness on jobseekers' personal and professional characteristics.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

No Data Available