4.7 Article

AERO: AI-Enabled Remote Sensing Observation with Onboard Edge Computing in UAVs

Journal

REMOTE SENSING
Volume 15, Issue 7, Pages -

Publisher

MDPI
DOI: 10.3390/rs15071873

Keywords

unmanned aerial vehicles; object detection; object tracking; remote sensing; object localization; edge computing; inspection; YOLOv4; YOLOv7; DeepSORT

Ask authors/readers for more resources

Unmanned aerial vehicles (UAVs) with computer vision capabilities are widely used in remote sensing applications. However, commercial usage of these UAVs in such applications is mostly done manually or relies on cloud computation offloading, which can be unscalable and infeasible. To address these issues, this paper proposes a cloud-edge hybrid system architecture that enables extensive AI tasks to be processed onboard UAVs. The proposed system, AERO, combines object detection and tracking with TensorRT accelerators to maximize detection accuracy and achieves high inference speed.
Unmanned aerial vehicles (UAVs) equipped with computer vision capabilities have been widely utilized in several remote sensing applications, such as precision agriculture, environmental monitoring, and surveillance. However, the commercial usage of these UAVs in such applications is mostly performed manually, with humans being responsible for data observation or offline processing after data collection due to the lack of on board AI on edge. Other technical methods rely on the cloud computation offloading of AI applications, where inference is conducted on video streams, which can be unscalable and infeasible due to remote cloud servers' limited connectivity and high latency. To overcome these issues, this paper presents a new approach to using edge computing in drones to enable the processing of extensive AI tasks onboard UAVs for remote sensing. We propose a cloud-edge hybrid system architecture where the edge is responsible for processing AI tasks and the cloud is responsible for data storage, manipulation, and visualization. We designed AERO, a UAV brain system with onboard AI capability using GPU-enabled edge devices. AERO is a novel multi-stage deep learning module that combines object detection (YOLOv4 and YOLOv7) and tracking (DeepSort) with TensorRT accelerators to capture objects of interest with high accuracy and transmit data to the cloud in real time without redundancy. AERO processes the detected objects over multiple consecutive frames to maximize detection accuracy. The experiments show a reduced false positive rate (0.7%), a low percentage of tracking identity switches (1.6%), and an average inference speed of 15.5 FPS on a Jetson Xavier AGX edge device.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Chemistry, Analytical

Vision Transformers in Image Restoration: A Survey

Anas M. Ali, Bilel Benjdira, Anis Koubaa, Walid El-Shafai, Zahid Khan, Wadii Boulila

Summary: This study extensively investigates the efficiency of Vision Transformer (ViT) in image restoration. ViT architectures are classified for each task, and the outcomes, advantages, limitations, and possible areas for future research are detailed. Overall, incorporating ViT in new architectures for image restoration is becoming a rule due to its better efficiency, robustness in feature extraction, and improved feature learning approach. However, there are drawbacks such as the need for more data to demonstrate the benefits over CNN, increased computational cost, more challenging training process, and lack of interpretability.

SENSORS (2023)

Article Chemistry, Analytical

A Multi-Stage Deep-Learning-Based Vehicle and License Plate Recognition System with Real-Time Edge Inference

Adel Ammar, Anis Koubaa, Wadii Boulila, Bilel Benjdira, Yasser Alhabashi

Summary: This paper presents a novel real-time vehicle identification and license plate recognition system based on video streaming. The system integrates multiple algorithms, including object detectors, image classifiers, and a multi-object tracker, to recognize car models and license plates. By leveraging the information redundancy of Saudi license plates' characters, the system achieves high accuracy while ensuring real-time performance. Experimental results show that the system can achieve a frame rate of 17.1 FPS on a Jetson Xavier AGX edge device in real-world environments.

SENSORS (2023)

Article Environmental Sciences

TESR: Two-Stage Approach for Enhancement and Super-Resolution of Remote Sensing Images

Anas M. Ali, Bilel Benjdira, Anis Koubaa, Wadii Boulila, Walid El-Shafai

Summary: In this study, a new architecture called TESR was designed to enhance the resolution of remote sensing images using Vision Transformers (ViT) and Diffusion Model (DM). TESR outperformed state-of-the-art techniques on the UCMerced benchmark dataset, improving the image quality in terms of PSNR/SSIM metrics.

REMOTE SENSING (2023)

Article Green & Sustainable Science & Technology

Machine Learning Based Healthcare Service Dissemination Using Social Internet of Things and Cloud Architecture in Smart Cities

Vishnu Kumar Kaliappan, Sundharamurthy Gnanamurthy, Abid Yahya, Ravi Samikannu, Muhammad Babar, Basit Qureshi, Anis Koubaa

Summary: Smart healthcare utilizes cloud computing and the Internet of Things to achieve remote patient monitoring, real-time data collection, enhanced data security, and cost-effective storage and analysis of healthcare data. This paper presents an information-centric dissemination scheme (ICDS) designed for smart healthcare services in smart cities. The proposed scheme addresses the time sensitivity of healthcare data and aims to ensure consistent dissemination. The ICDS utilizes decision-tree learning to classify requests based on time-sensitive features, enabling access prioritization. The scheme also involves segregating sensitive information and distributing digital health data within the classified time to maintain time sensitivity and prioritize access. The learning is then adapted for the leaves based on data significance and minimum resources to reduce waiting times and enhance availability.

SUSTAINABILITY (2023)

Article Chemistry, Analytical

CERP: Cooperative and Efficient Routing Protocol for Wireless Sensor Networks

Nesrine Atitallah, Omar Cheikhrouhou, Khaleel Mershad, Anis Koubaa, Fahima Hajjej

Summary: This paper introduces a power-conscious routing approach for resource-restricted wireless sensor networks (WSNs), leveraging cooperative communications and innovative relay node selection techniques. The proposed cooperative and efficient routing protocol (CERP) enhances reliability and energy conservation, outperforming the standard RPL protocol by 10% in reliability and 18% in energy savings.

SENSORS (2023)

Article Mathematics, Interdisciplinary Applications

Numerical Solution of Advection-Diffusion Equation of Fractional Order Using Chebyshev Collocation Method

Farman Ali Shah, Wadii Boulila, Anis Koubaa, Nabil Mlaiki

Summary: This study presents a highly accurate numerical method for solving the advection-diffusion equation of fractional order. The proposed method uses the Laplace transform to handle the time-fractional derivative and utilizes the Chebyshev spectral collocation method for spatial discretization. The method shows high accuracy and stability, as demonstrated by solving various problems in two dimensions.

FRACTAL AND FRACTIONAL (2023)

Article Computer Science, Information Systems

Multi-Input Deep Learning Approach for Breast Cancer Screening Using Thermal Infrared Imaging and Clinical Data

Dennies Tsietso, Abid Yahya, Ravi Samikannu, Muhammad Usman Tariq, Muhammad Babar, Basit Qureshi, Anis Koubaa

Summary: Breast cancer is a leading cause of death among women worldwide, and early detection is crucial for reducing mortality. This paper proposes a novel computer-aided diagnosis (CADx) system that uses deep learning techniques and incorporates multiple breast thermogram views and patient clinical data to improve accuracy. The system outperforms single-input models and achieves an overall accuracy of 90.48%, a sensitivity of 93.33%, and an AUROC curve of 0.94. This approach could provide a more cost-effective and less hazardous screening option for breast cancer detection, particularly for diverse age groups.

IEEE ACCESS (2023)

Article Computer Science, Information Systems

MAGRU-IDS: A Multi-Head Attention-Based Gated Recurrent Unit for Intrusion Detection in IIoT Networks

Safi Ullah, Wadii Boulila, Anis Koubaa, Jawad Ahmad

Summary: The increasing prevalence of the Industrial Internet of Things (IIoT) in industrial environments amplifies the potential for security breaches. To address challenges in training intrusion detection systems (IDS) for IIoT networks, this paper proposes a method called multi-head attention-based gated recurrent unit (MAGRU) that utilizes machine learning and deep learning to detect malicious activities. The proposed MAGRU outperforms other models, achieving high precision, recall, F1-score, and accuracy in detecting intrusions in IIoT networks.

IEEE ACCESS (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Deep Neural Network based Secured Control of Flying Vehicle in Urban Environment

Adeel Zaidi, Muhammad Kazim, Lixian Zhang, Ahmad Taher Azar, Anis Koubaa, Bilel Benjdira, Adel Ammar, Mohammad Abdelkader

Summary: This research paper proposes a combination of a deep neural network algorithm and a cascaded PID+FF controller for safe and obstacle-free aerial transportation. The results show that this approach improves accuracy and ensures flight safety in highly dynamic environments.

2022 2ND INTERNATIONAL CONFERENCE OF SMART SYSTEMS AND EMERGING TECHNOLOGIES (SMARTTECH 2022) (2022)

Article Computer Science, Information Systems

Optimized Distributive Cross-Layer and Thermal-Aware Convergecast Protocol for Wireless Body Area Network

Yasir Shahzad, Huma Javed, Haleem Farman, Zahid Khan, Moustafa M. Nasralla, Anis Koubaa

Summary: This study proposes an optimal distributive cross-layer and thermal-aware convergecast protocol to address the limitations of current protocols in terms of convergence delays, communication and processing overheads. The proposed protocol accelerates the convergence process, improves energy efficiency and thermal control, and supports a distributive hierarchy.

IEEE ACCESS (2022)

No Data Available