4.2 Article

Ubiquitous Access to Digital Cultural Heritage

出版社

ASSOC COMPUTING MACHINERY
DOI: 10.1145/3012284

关键词

Search aggregation; user context detection; metadata harmonization

资金

  1. European Union Seventh Framework Programme FP7 [600601]

向作者/读者索取更多资源

The digitization initiatives in the past decades have led to a tremendous increase in digitized objects in the cultural heritage domain. Although digitally available, these objects are often not easily accessible for interested users because of the distributed allocation of the content in different repositories and the variety in data structure and standards. When users search for cultural content, they first need to identify the specific repository and then need to know how to search within this platform (e.g., usage of specific vocabulary). The goal of the EEXCESS project is to design and implement an infrastructure that enables ubiquitous access to digital cultural heritage content. Cultural content should be made available in the channels that users habitually visit and be tailored to their current context without the need to manually search multiple portals or content repositories. To realize this goal, open-source software components and services have been developed that can either be used as an integrated infrastructure or as modular components suitable to be integrated in other products and services. The EEXCESS modules and components comprise (i) Web-based context detection, (ii) information retrieval-based, federated content aggregation, (iii) meta-data definition and mapping, and (iv) a component responsible for privacy preservation. Various applications have been realized based on these components that bring cultural content to the user in content consumption and content creation scenarios. For example, content consumption is realized by a browser extension generating automatic search queries from the current page context and the focus paragraph and presenting related results aggregated from different data providers. A Google Docs add-on allows retrieval of relevant content aggregated from multiple data providers while collaboratively writing a document. These relevant resources then can be included in the current document either as citation, an image, or a link (with preview) without having to leave disrupt the current writing task for an explicit search in various content providers' portals.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.2
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Review Computer Science, Artificial Intelligence

How to keep text private? A systematic review of deep learning methods for privacy-preserving natural language processing

Samuel Sousa, Roman Kern

Summary: This article systematically reviews over sixty DL methods for privacy-preserving NLP published between 2016 and 2020, covering classification, privacy threats, metrics, and challenges in real-world scenarios.

ARTIFICIAL INTELLIGENCE REVIEW (2023)

Article Engineering, Biomedical

Channel Contribution in Deep Learning Based Automatic Sleep Scoring-How Many Channels Do We Need?

Changqing Lu, Shreyasi Pathak, Gwenn Englebienne, Christin Seifert

Summary: Machine learning based sleep scoring methods aim to automate the process of annotating polysomnograms with sleep stages. However, most multi-channel multi-modal models in the literature showed little performance improvement compared to single-channel EEG models. In this paper, we investigate the specific features in single-channel EEG models that contribute to their high performance and analyze the extent to which multi-channel multi-modal models utilize information from different channels. Our findings suggest that incorporating advanced methods for aggregating channel information may improve sleep scoring performance for multi-channel multi-modal models.

IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING (2023)

Article Engineering, Manufacturing

Solving multi-objective inverse problems of chained manufacturing processes

J. G. Hoffer, B. C. Geiger, R. Kern

Summary: This research presents a method that combines stacked Gaussian processes (stacked GP) with target vector Bayesian optimization (BO) to solve multi-objective inverse problems of chained manufacturing processes. Through stacked GPs, epistemic uncertainty can be propagated through all chained manufacturing processes. In the optimization of chained processes, there are options to use a single unified surrogate model for the entire joint chain or have a surrogate model for each individual process and cascade the optimization from the last to the first process. For improved target vector BO results of chained processes, the proposed approach combines methods that under- or overestimate uncertainties in an ensemble for rank aggregation. Thorough analysis and evaluation are conducted on artificial use cases and a typical manufacturing process chain.

CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY (2023)

Review Computer Science, Theory & Methods

From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI

Meike Nauta, Jan Trienes, Shreyasi Pathak, Elisa Nguyen, Michelle Peters, Yasmin Schmitt, Joerg Schloetterer, Maurice Van Keulen, Christin Seifert

Summary: The evaluation of explanations for machine learning models is a complex concept that should not be solely based on subjective validation. This study identifies 12 conceptual properties that should be considered for a comprehensive assessment of explanation quality. The evaluation practices of over 300 papers introducing explainable artificial intelligence (XAI) methods in the past 7 years were systematically reviewed, finding that one-third of the papers exclusively relied on anecdotal evidence and one-fifth evaluated with users. The study also provides an extensive overview of quantitative XAI evaluation methods, offering researchers and practitioners concrete tools for validation and benchmarking.

ACM COMPUTING SURVEYS (2023)

Review Computer Science, Information Systems

Reconsidering Read and Spontaneous Speech: Causal Perspectives on the Generation of Training Data for Automatic Speech Recognition

Philipp Gabler, Bernhard C. Geiger, Barbara Schuppler, Roman Kern

Summary: Superficially, read and spontaneous speech are two main types of training data in automatic speech recognition, but they are fundamentally different due to the way the audio signal is generated. This review introduces causal reasoning into automatic speech recognition, highlighting the impact of data generation processes on inference and performance. By applying a causal perspective, this work discusses the relationship between data generation mechanisms, learning, and prediction in speech data. Furthermore, the authors argue that a causal perspective can enhance the understanding of models in speech processing.

INFORMATION (2023)

Article Computer Science, Information Systems

Impact and development of an Open Web Index for open web search

Michael Granitzer, Stefan Voigt, Noor Afshan Fathima, Martin Golasowski, Christian Guetl, Tobias Hecking, Gijs Hendriksen, Djoerd Hiemstra, Jan Martinovic, Jelena Mitrovic, Izidor Mlakar, Stavros Moiras, Alexander Nussbaumer, Per oester, Martin Potthast, Marjana Sencar Srdic, Sharikadze Megi, Katerina Slaninova, Benno Stein, Arjen P. de Vries, Vit Vondrak, Andreas Wagner, Saber Zerhoudi

Summary: Web search is crucial for the digital economy, but the dominance of a few gatekeepers has resulted in a closed ecosystem and potential quality sacrifice. To encourage openness and choice, an Open Web Index (OWI) is proposed, based on open data principles, legal compliance, and collaborative technology development. The combination of an open index with declarative search engines will facilitate the development of vertical search engines and innovative web data products, creating a fair and open information space. The EU-funded project OpenWebSearch.EU marks the first step towards realizing an Open Web Index.

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY (2023)

Article Computer Science, Artificial Intelligence

A historical perspective of biomedical explainable AI research

Luca Malinverno, Vesna Barros, Francesco Ghisoni, Giovanni Visona, Roman Kern, Philip J. Nickel, Barbara Elvira Ventura, Ilija Simic, Sarah Stryeck, Francesca Manni, Cesar Ferri, Claire Jean-Quartier, Laura Genga, Gabriele Schweikert, Mario Lovri, Michal Rosen-Zvi

Summary: This study aimed to analyze the association between COVID-19 and the advancement of explainable artificial intelligence (XAI) research. By extracting relevant studies from the PubMed database and manual labeling, the study found that the emergence of COVID-19 may have driven the attention towards XAI and accelerated its development trends.

PATTERNS (2023)

Review Computer Science, Information Systems

Detecting Outliers in Non-IID Data: A Systematic Literature Review

Shafaq Siddiqi, Faiza Qureshi, Stefanie Lindstaedt, Roman Kern

Summary: This study aims to systematically review outlier detection methods for non-IID data published between 2015 and 2023. The study focuses on data characteristics, methods, and evaluation measures. It provides a comprehensive overview of the characteristics of non-IID data, recent methods for outlier detection, and evaluation metrics. A taxonomy is proposed for organizing these methods and open challenges in outlier detection for non-IID are discussed.

IEEE ACCESS (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Pooling Graph Convolutional Networks for Structural Performance Prediction

Lorenz Wendlinger, Michael Granitzer, Christofer Fellicious

Summary: Neural Architecture Search can find high-performance task specific neural network architectures. Using surrogate models as performance predictors can reduce the need for costly evaluations. Our deep graph learning approach achieves state-of-the-art performance in multiple NAS performance prediction benchmarks.

MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2022, PT II (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Taylor - Impersonation of AI for Audiovisual Content Documentation and Search

Victor Adriel de Jesus Oliveira, Gernot Rottermanner, Magdalena Boucher, Stefanie Groessbacher, Peter Judmaier, Werner Bailer, Georg Thallinger, Thomas Kurz, Jakob Frank, Christoph Bauer, Gabriele Froeschl, Michael Batlogg

Summary: While AI-based audiovisual analysis tools have made significant progress, integrating them into media production and archiving workflows remains challenging due to mismatched annotations, lack of alignment with existing workflows, and the need for accurate metadata. We propose a system that utilizes AI-based analysis methods for annotation and search in media archive applications. To enhance communication and gather feedback, Taylor, an artificial intelligence agent, is included in the user interface.

MULTIMEDIA MODELING, MMM 2023, PT II (2023)

Proceedings Paper Computer Science, Artificial Intelligence

People@Places and ToDY: Two Datasets for Scene Classification in Media Production and Archiving

Werner Bailer, Hannes Fassold

Summary: To support annotation tasks in visual media production and archiving, two datasets, People@Places and ToDY, are proposed. These datasets cover the annotation of scene bustle, shot cinematographic type, and shot time of day and season. Automatic annotations are created using a toolchain and manually verified and corrected. Baseline results using the EfficientNet-B3 model pretrained on Places365 dataset are provided.

MULTIMEDIA MODELING, MMM 2023, PT I (2023)

Article Computer Science, Artificial Intelligence

Cluster Purging: Efficient Outlier Detection Based on Rate-Distortion Theory

Maximilian B. Toller, Bernhard C. Geiger, Roman Kern

Summary: Rate-distortion theory-based outlier detection utilizes good data compression to encode outliers with unique symbols. We propose Cluster Purging as an extension of clustering-based outlier detection, allowing the assessment of clustering representivity and the identification of data best represented by individual unique clusters. We present two efficient algorithms for Cluster Purging, one parameter-free and the other allowing tuning in supervised setups.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Improving Query and Assessment Quality in Text-Based Interactive Video Retrieval Evaluation

Werner Bailer, Rahel Arnold, Vera Benz, Davide Alessandro Coccomini, Anastasios Gkagkas, Gylfi Thor Gudmundsson, Silvan Heller, Bjorn Thor Jonsson, Jakub Lokoc, Nicola Messina, Nick Pantelidis, Jiaxin Wu

Summary: This paper proposes a process for refining known-item and open-set type queries in interactive video retrieval evaluations. It emphasizes the importance of proper task interpretations.

PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023 (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Introduction to the Sixth Annual Lifelog Search Challenge, LSC'23

Cathal Gurrin, Liting Zhou, Graham Healy, Bjorn Thornor Jonsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Luca Rossetto, Minh-Triet Tran, Wolfgang Hurst, Werner Bailer, Klaus Schoeffmann

Summary: This article presents the background and goals of the sixth Lifelog Search Challenge (LSC), including the participating teams and the organization of the competition.

PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023 (2023)

暂无数据