4.7 Article

Artificial intelligence for the metaverse: A survey

Journal

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.engappai.2022.105581

Keywords

Artificial intelligence; Blockchain; Deep learning; Immersive experience; Machine learning; Machine vision; Metaverse; Metaverse applications; Networking; Virtual worlds

Ask authors/readers for more resources

With the massive growth of the Internet, virtual environments have become increasingly popular. The concept of metaverse has been introduced as a shared virtual world fueled by emerging technologies, with artificial intelligence (AI) playing a crucial role in enhancing immersive experiences. This survey explores the role of AI, including machine learning and deep learning, in the foundation and development of the metaverse, and discusses the potential of AI-based methods in building virtual worlds. It also studies AI-aided applications in various fields and concludes with the future research directions of AI for the metaverse.
Along with the massive growth of the Internet from the 1990s until now, various innovative technologies have been created to bring users breathtaking experiences with more virtual interactions in cyberspace. Many virtual environments have been developed with immersive experience and digital transformation, but most are incoherent instead of being integrated into a platform. In this context, metaverse has been introduced as a shared virtual world that is fueled by many emerging technologies. Among such technologies, artificial intelligence (AI) has shown the great importance of enhancing immersive experience and enabling human-like intelligence of virtual agents. In this survey, we make a beneficial effort to explore the role of AI, including machine learning algorithms and deep learning architectures, in the foundation and development of the meta -verse. As the main contributions, we convey a comprehensive investigation of AI-based methods concerning several technical aspects (e.g., natural language processing, machine vision, blockchain, networking, digital twin, and neural interface) that have potentials to build virtual worlds in the metaverse. Furthermore, several primary AI-aided applications, including healthcare, manufacturing, smart cities, and gaming, are studied to be promisingly deployed in the virtual worlds. Finally, we conclude the key contribution and open some future research directions of AI for the metaverse. Serving as a foundational survey, this work will help researchers, including experts and non-experts in related fields, in applying, developing, and optimizing AI techniques to polish the appearance of virtual worlds and improve the quality of applications built in the metaverse.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Towards designing a generic and comprehensive deep reinforcement learning framework

Ngoc Duy Nguyen, Thanh Thi Nguyen, Nhat Truong Pham, Hai Nguyen, Dang Tu Nguyen, Thanh Dang Nguyen, Chee Peng Lim, Michael Johnstone, Asim Bhatti, Douglas Creighton, Saeid Nahavandi

Summary: Reinforcement learning has become an effective approach for building intelligent systems, especially with the introduction of deep learning. This paper proposes a comprehensive software architecture that guides the design of deep reinforcement learning architectures and facilitates the development of realistic reinforcement learning applications.

APPLIED INTELLIGENCE (2023)

Article Computer Science, Information Systems

Towards 6G: Key technological directions

Chamitha De Alwis, Pardeep Kumar, Quoc-Viet Pham, Kapal Dev, Anshuman Kalla, Madhusanka Liyanage, Won-Joo Hwang

Summary: This paper discusses six technological directions for 6G and focuses on recent developments, applicability, and deployment challenges of each direction. It aims to facilitate research and developments related to 6G.

ICT EXPRESS (2023)

Article Engineering, Electrical & Electronic

Short-Packet Communications in Multihop Networks With WET: Performance Analysis and Deep Learning-Aided Optimization

Toan-Van Nguyen, Van-Dinh Nguyen, Daniel Benevides da Costa, Thien Huynh-The, Rose Qingyang Hu, Beongku An

Summary: In this paper, the authors propose a cooperative beamforming relay selection (CRS) scheme for achieving high-reliable transmission in short-packet communications in multi-hop networks with wireless energy transfer. They derive a closed-form expression for the average block error rate (BLER) of the CRS scheme and develop an algorithm to solve the channel allocation problem efficiently. They also design a deep convolutional neural network (CNN) to provide a sub-optimal solution to the problem in real-time settings. Numerical results demonstrate the performance improvements of the CRS scheme over benchmark ones in terms of BLER, reliability, latency, and throughput.

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (2023)

Article Engineering, Electrical & Electronic

Phase-difference measurement-based angle of arrival estimation using long-baseline interferometer

Van-Sang Doan, Thien Huynh-The, Van-Phuc Hoang, Jiri Vesely

Summary: This article presents a direction-finding method based on phase difference measurement for various electronic intelligence applications. The method obtains the actual phase shift of the longest baseline from measured phase differences with low computational cost. The performance of the method is analysed and evaluated using several interferometers, and an optimized array configuration of four antenna elements is considered for high accuracy. The proposed method outperforms existing methods in terms of angle of arrival estimation accuracy. Experimental measurements demonstrate high AOA determination performance with small average angle estimation error.

IET RADAR SONAR AND NAVIGATION (2023)

Article Computer Science, Information Systems

Energy-Efficient Multiprocessor-Based Computation and Communication Resource Allocation in Two-Tier Federated Learning Networks

Rukhsana Ruby, Hailiang Yang, Felipe A. P. de Figueiredo, Thien Huynh-The, Kaishun Wu

Summary: In traditional federated learning (FL), edge devices jointly train a machine learning model by communicating learning updates without exchanging data samples. In this study, a two-tier FL network is considered, where IoT nodes are the core clients, low altitude aerial platforms (UAVs) serve as model aggregators at the middle tier, and a high-altitude aerial platform (UAV with relatively high altitude) acts as the top-most layer aggregator. The energy-efficient computation and communication resource allocation in this network is addressed using an iterative algorithm that solves separate subproblems and then jointly solves the entire problem. Offline and online client scheduling schemes are proposed for optimal edge node selection and workload assignment based on data quality and workload constraints. Extensive simulations with real data verify the effectiveness of the proposed resource allocation scheme and highlight the importance of considering both computation, communication, and model divergence weight in FL performance.

IEEE INTERNET OF THINGS JOURNAL (2023)

Editorial Material Computer Science, Information Systems

Guest Editorial Special Issue on Aerial Computing for the Internet of Things (IoT)

Quoc-Viet Pham, Ming Zeng, Octavia A. Dobre, Zhiguo Ding, Lingyang Song

Summary: The Internet of Things (IoT) drives the development of sixth-generation (6G) wireless systems, as more data needs to be collected and transmitted due to the emergence of novel IoT applications. However, IoT devices are limited by battery life, transmit power, and processing capacity. Aerial access networks provide favorable communication links and better coverage for IoT devices, while edge computing (such as fog and mobile-edge computing) relocates computing and storage resources to the network edge to support computing-intensive and low-latency IoT applications. The integration of aerial access networks and edge computing, known as aerial computing, is expected to offer both traditional communication services and advanced services for IoT globally.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Computer Science, Hardware & Architecture

Secure-Enhanced Federated Learning for AI-Empowered Electric Vehicle Energy Prediction

Weizheng Wang, Fida Hussain Memon, Zhuotao Lian, Zhimeng Yin, Thippa Reddy Gadekallu, Quoc-Viet Pham, Kapal Dev, Chunhua Su

Summary: Although AI-empowered schemes offer reasonable energy distribution solutions between charging stations and CS providers, frequent data sharing may lead to security and privacy breaches. In this article, we propose a lightweight authentication FL-based energy demand prediction framework to defend against multiple FL attacks for electric vehicle infrastructures.

IEEE CONSUMER ELECTRONICS MAGAZINE (2023)

Article Computer Science, Hardware & Architecture

Distributed Cloud Computing: Architecture, Enabling Technologies, and Open Challenges

Xuan-Qui Pham, Thien Huynh-The, Dong-Seong Kim, Tien-Dung Nguyen, Eui-Nam Huh

Summary: Conventional cloud computing cannot meet the low latency requirements of new applications, leading to the emergence of distributed cloud computing model which provides geographically dispersed cloud computing services based on application needs. This article explains the concept of distributed cloud computing, describes the architecture and enabling technologies of distributed cloud, presents a case study on service deployment and discovery in a three-layer distributed cloud prototype, and discusses the open research challenges of distributed cloud.

IEEE CONSUMER ELECTRONICS MAGAZINE (2023)

Article Computer Science, Information Systems

mISO: Incentivizing Demand-Agnostic Microservices for Edge-Enabled IoT Networks

Amit Samanta, Quoc-Viet Pham, Nhu-Ngoc Dao, Ammar Muthanna, Sungrae Cho

Summary: The recent expansion of mobile IoT devices has led to the development of the mobile edge computing (MEC) platform, which is essential for processing computational microservices at the edge. To ensure fair resource allocation and incentivize the participation of mobile IoT devices, researchers have designed an incentive mechanism using a double auction approach. The proposed microservice Incentive Service Offloading (mISO) mechanism combines this incentive approach with a demand estimation scheme, providing improvements in latency and resource utilization compared to existing works.

IEEE TRANSACTIONS ON SERVICES COMPUTING (2023)

Article Computer Science, Information Systems

Federated Learning Framework With Straggling Mitigation and Privacy-Awareness for AI-Based Mobile Application Services

Yuris Mulya Saputra, Diep N. Nguyen, Dinh Thai Hoang, Quoc-Viet Pham, Eryk Dutkiewicz, Won-Joo Hwang

Summary: This article proposes a novel framework to address straggling and privacy issues in federated learning-based mobile application services. It takes into account limited computing/communications resources, privacy cost, rationality, and incentive competition among participating entities. The framework utilizes information provided by mobile users to determine the best participants and includes methods to mitigate straggling problems and protect privacy. Experimental results show significant improvements in training time, prediction accuracy, and network welfare compared to baseline methods.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2023)

Article Computer Science, Theory & Methods

Federated Learning for Smart Healthcare: A Survey

Dinh C Nguyen, Quoc-Viet Pham, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne, Zihuai Lin, Octavia Dobre, Won-Joo Hwang

Summary: Recent advances in communication technologies and the Internet-of-Medical-Things (IOMT) have enabled the use of artificial intelligence (AI) in smart healthcare. Federated Learning (FL), as a distributed collaborative AI paradigm, is particularly attractive for smart healthcare due to its ability to train AI models without sharing raw data. This survey provides a comprehensive overview of the recent advances in FL, its motivations, requirements, and applications in key healthcare domains.

ACM COMPUTING SURVEYS (2023)

Article Automation & Control Systems

Walk as you feel: Privacy preserving emotion recognition from gait patterns

Carmen Bisogni, Lucia Cimmino, Michele Nappi, Toni Pannese, Chiara Pero

Summary: This paper presents a gait-based emotion recognition method that does not rely on facial cues, achieving competitive performance on small and unbalanced datasets. The proposed approach utilizes advanced deep learning architecture and achieves high recognition and accuracy rates.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Satellite constellation method for ground targeting optimized with K-means clustering and genetic algorithm

Soung Sub Lee

Summary: This study proposed a satellite constellation method that utilizes machine learning and customized repeating ground track orbits to optimize satellite revisit performance for each target.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A method of user recruitment and adaptation degree improvement via community collaboration in sparse mobile crowdsensing systems

Jian Wang, Xiuying Zhan, Yuping Yan, Guosheng Zhao

Summary: This paper proposes a method of user recruitment and adaptation degree improvement via community collaboration to solve the task allocation problem in sparse mobile crowdsensing. By matching social relationships and perception task characteristics, the entire perceptual map can be accurately inferred.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Robotic assembly control reconfiguration based on transfer reinforcement learning for objects with different geometric features

Yuhang Gai, Bing Wang, Jiwen Zhang, Dan Wu, Ken Chen

Summary: This paper investigates how to reconfigure existing compliance controllers for new assembly objects with different geometric features. By using the proposed Equivalent Theory of Compliance Law (ETCL) and Weighted Dimensional Policy Distillation (WDPD) method, the learning cost can be reduced and better control performance can be achieved.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Progress and prospects of future urban health status prediction

Zhihao Xu, Zhiqiang Lv, Benjia Chu, Zhaoyu Sheng, Jianbo Li

Summary: Predicting future urban health status is crucial for identifying urban diseases and planning cities. By applying an improved meta-analysis approach and considering the complexity of cities as systems, this study selects eight urban factors and explores suitable prediction methods for these factors.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A localized decomposition evolutionary algorithm for imbalanced multi-objective optimization

Yulong Ye, Qiuzhen Lin, Ka-Chun Wong, Jianqiang Li, Zhong Ming, Carlos A. Coello Coello

Summary: This paper proposes a localized decomposition evolutionary algorithm (LDEA) to tackle imbalanced multi-objective optimization problems (MOPs). LDEA assigns a local region for each subproblem using a localized decomposition method and restricts the solution update within the region to maintain diversity. It also speeds up convergence by evolving only the best-associated solution in each subproblem while balancing the population's diversity.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

LDD-Net: Lightweight printed circuit board defect detection network fusing multi-scale features

Longxin Zhang, Jingsheng Chen, Jianguo Chen, Zhicheng Wen, Xusheng Zhou

Summary: This study proposes a lightweight PCB image defect detection network (LDD-Net) that achieves high accuracy by designing a novel lightweight feature extraction network, multi-scale aggregation network, and lightweight decoupling head. Experimental results show that LDD-Net outperforms state-of-the-art models in terms of accuracy, computation, and detection speed, making it suitable for edge systems or resource-constrained embedded devices.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Adaptive stable backstepping controller based on support vector regression for nonlinear systems

Kemal Ucak, Gulay Oke Gunel

Summary: This paper introduces a novel adaptive stable backstepping controller based on support vector regression for nonlinear dynamical systems. The controller utilizes SVR to identify the dynamics of the nonlinear system and integrates stable BSC behavior. The experimental results demonstrate successful control performance for both nonlinear systems.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A non-dominated sorting genetic algorithm III using competition crossover and opposition-based learning for the optimal dispatch of the combined cooling, heating, and power system with photovoltaic thermal collector

Dexuan Zou, Mengdi Li, Haibin Ouyang

Summary: In this study, a photovoltaic thermal collector is integrated into a combined cooling, heating, and power system to reduce primary energy consumption, operation cost, and carbon dioxide emission. By applying a novel genetic algorithm and constraint handling approach, it is found that the CCHP scenarios with PV/T are more efficient and achieve the lowest energy consumption.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Identification and optimization of material constitutive equations using genetic algorithms

Abhinav Pandey, Litton Bhandari, Vidit Gaur

Summary: This research proposes a novel model-agnostic framework based on genetic algorithms to identify and optimize the set of coefficients of the constitutive equations of engineering materials. The framework demonstrates solution convergence, scalability, and high explainability for a wide range of engineering materials. The experimental validation shows that the proposed framework outperforms commercially available software in terms of optimization efficiency.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A generalized visibility graph algorithm for analyzing biological time series having rotation in polar plane

Zahra Ramezanpoor, Adel Ghazikhani, Ghasem Sadeghi Bajestani

Summary: Time series analysis is a method used to analyze phenomena with temporal measurements. Visibility graphs are a technique for representing and analyzing time series, particularly when dealing with rotations in the polar plane. This research proposes a visibility graph algorithm that efficiently handles biological time series with rotation in the polar plane. Experimental results demonstrate the effectiveness of the proposed algorithm in both synthetic and real world time series.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Mutual dimensionless improved bearing fault diagnosis based on Bp-increment broad learning system in computer vision

ChunLi Li, Qintai Hu, Shuping Zhao, Jigang Wu, Jianbin Xiong

Summary: Efficient and accurate diagnosis of rotating machinery in the petrochemical industry is crucial. However, the nonlinear and non-stationary vibration signals generated in harsh environments pose challenges in distinguishing fault signals from normal ones. This paper proposes a BP-Incremental Broad Learning System (BP-INBLS) model to address these challenges. The effectiveness of the proposed method in fault diagnosis is demonstrated through validation and comparative analysis with a published method.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Influence of cost/loss functions on classification rate: A comparative study across diverse classifiers and domains

Fatemeh Chahkoutahi, Mehdi Khashei

Summary: The classification rate is the most important factor in selecting an appropriate classification approach. In this paper, the influence of different cost/loss functions on the classification rate of different classifiers is compared, and empirical results show that cost/loss functions significantly affect the classification rate.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A partition-based problem transformation algorithm for classifying imbalanced multi-label data

Jicong Duan, Xibei Yang, Shang Gao, Hualong Yu

Summary: The study proposes a novel partition-based imbalanced multi-label learning algorithm, MLHC, which divides the original label space into disconnected subspaces using hierarchical clustering. It successfully tackles the class imbalance problem in multi-label data and outperforms other class imbalance multi-label learning algorithms.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Review Automation & Control Systems

A review of retinal vessel segmentation for fundus image analysis

Qing Qin, Yuanyuan Chen

Summary: This paper offers a comprehensive review of retinal vessel automatic segmentation research, including both traditional methods and deep learning methods. In particular, supervised learning methods are summarized and analyzed based on CNN, GAN, and UNet. The advantages and disadvantages of existing segmentation methods are also outlined.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)