4.7 Article

Bag-of-visual-phrases and hierarchical deep models for traffic sign detection and recognition in mobile laser scanning data

期刊

出版社

ELSEVIER
DOI: 10.1016/j.isprsjprs.2016.01.005

关键词

Bag-of-visual-phrases; Deep Boltzmann machine (DBM); Mobile laser scanning (MLS); Point cloud; Traffic sign detection; Traffic sign recognition (TSR)

资金

  1. National Natural Science Foundation of China [41471379]
  2. PAPD
  3. CICAEET

向作者/读者索取更多资源

This paper presents a novel algorithm for detection and recognition of traffic signs in mobile laser scanning (MIS) data for intelligent transportation-related applications. The traffic sign detection task is accomplished based on 3-D point clouds by using bag-of-visual-phrases representations; whereas the recognition task is achieved based on 2-D images by using a Gaussian-Bernoulli deep Boltzmann machine-based hierarchical classifier. To exploit high-order feature encodings of feature regions, a deep Boltzmann machine-based feature encoder is constructed. For detecting traffic signs in 3-D point clouds, the proposed algorithm achieves an average recall, precision, quality, and F-score of 0.956, 0.946, 0.907, and 0.951, respectively, on the four selected MLS datasets. For on-image traffic sign recognition, a recognition accuracy of 97.54% is achieved by using the proposed hierarchical classifier. Comparative studies with the existing traffic sign detection and recognition methods demonstrate that our algorithm obtains promising, reliable, and high performance in both detecting traffic signs in 3-D point clouds and recognizing traffic signs on 2-D images. (C) 2016 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS). Published by Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Geochemistry & Geophysics

Adaptive Pyramid Context Fusion for Point Cloud Perception

Haojia Lin, Zhipeng Luo, Wen Li, Yiping Chen, Cheng Wang, Jonathan Li

Summary: This paper introduces the research progress of deep learning for 3-D point cloud perception and proposes an adaptive pyramid context fusion (APCF) module to capture contextual information from the point cloud. A multiscale context-aware network called APCF-Net is proposed by applying APCF to the PointConv architecture. The experiments demonstrate that APCF-Net outperforms other methods on 3-D object classification and semantic segmentation tasks.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

A Supervoxel Approach to Road Boundary Enhancement From 3-D LiDAR Point Clouds

Zhengchuan Sha, Yiping Chen, Yangbin Lin, Cheng Wang, Jose Marcato, Jonathan Li

Summary: This paper proposes a novel supervoxel segmentation algorithm framework for enhancing road boundaries from 3-D point clouds. The method achieves good performance in road scenes by segmenting the point clouds using seed points and adjusting the centroids of supervoxels.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geochemistry & Geophysics

Detection of Individual Trees in UAV LiDAR Point Clouds Using a Deep Learning Framework Based on Multichannel Representation

Zhipeng Luo, Ziyue Zhang, Wen Li, Yiping Chen, Cheng Wang, Abdul Awal Md Nurunnabi, Jonathan Li

Summary: This study proposes a deep learning framework for individual tree detection in complex forests using UAV laser scanning point clouds. The framework consists of two stages: ground filtering and tree detection. The ground filtering stage utilizes a modified graph convolution network with a local topological information layer, while the tree detection stage employs a top-down slice module and a special multichannel representation. Experimental results show that the framework achieves excellent performance.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Engineering, Civil

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

Kun Zhao, Lingfei Ma, Yu Meng, Li Liu, Junbo Wang, Jose Marcato, Wesley Nunes Goncalves, Jonathan Li

Summary: This paper presents a multi-level fusion network for 3D vehicle detection from point clouds and images. Extensive experiments show that the proposed network has better detection performance on occluded and distant vehicles, and reduces the false detection of similarly shaped objects.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Civil

Robust Lane Extraction From MLS Point Clouds Towards HD Maps Especially in Curve Road

Chengming Ye, He Zhao, Lingfei Ma, Han Jiang, Hongfu Li, Ruisheng Wang, Michael A. Chapman, Jose Marcato Junior, Jonathan Li

Summary: This article presents a method to extract lane features from mobile laser scanning data, which shows strong feasibility and robustness, and achieves higher accuracy and robustness compared to most state-of-the-art methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Civil

Rapid Extraction of Urban Road Guardrails From Mobile LiDAR Point Clouds

Jianlan Gao, Yiping Chen, Jose Marcato, Cheng Wang, Jonathan Li

Summary: This paper proposes a novel method for rapidly extracting urban road guardrails from MLS point clouds, combining multi-level filtering and a modified DBSCAN clustering. The method is applicable to most types of guardrails and rough slope roads. Experimental results demonstrate that the proposed method outperforms the state-of-the-art method in extracting 3D guardrails from point clouds.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Remote Sensing

DeepUrbanDownscale: A physics informed deep learning framework for high-resolution urban surface temperature estimation via 3D point clouds

Linwei Chen, Bowen Fang, Lei Zhao, Yu Zang, Weiquan Liu, Yiping Chen, Cheng Wang, Jonathan Li

Summary: In this paper, a physics informed neural network (PINN) framework called DeepUrbanDownscale (DUD) is proposed for accurate high-resolution urban surface temperature estimation. The network uses high-precision 3D point clouds and atmospheric physics guidance to achieve accurate temperature estimation at an ultra-high spatial resolution. Experimental results show that the proposed DUD network outperforms traditional methods in predicting urban surface temperatures.

INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION (2022)

Article Environmental Sciences

GIS-based spatial prediction of landslide using road factors and random forest for Sichuan-Tibet Highway

Ye Cheng-ming, Wei Rui-long, Ge Yong-gang, Li Yao, Jose Marcato Junior, Jonathan Li

Summary: The research introduced road factors of aspect to road and road profile to improve the accuracy of landslide susceptibility mapping by considering the influence of landslide movement direction on road. Using the random forest method, landslide susceptibility maps were generated, and the performance of road factors was evaluated using AUC and Gini importance. The results showed that road profile and aspect to road made significant contributions to predicting landslides along the highway compared to primitive factors.

JOURNAL OF MOUNTAIN SCIENCE (2022)

Article Computer Science, Artificial Intelligence

Counting and locating high-density objects using convolutional neural network

Mauro dos Santos de Arruda, Lucas Prado Osco, Plabiany Rodrigo Acosta, Diogo Nunes Goncalves, Jose Marcato Junior, Ana Paula Marques Ramos, Edson Takashi Matsubara, Zhipeng Luo, Jonathan Li, Jonathan de Andrade Silva, Wesley Nunes Goncalves

Summary: This paper presents a Convolutional Neural Network (CNN) approach for counting and locating objects in high-density imagery. The proposed method utilizes a feature map enhancement and a multi-sigma refinement of the confidence map, achieving state-of-the-art performance in counting and locating objects.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Article Engineering, Civil

3D Multi-Object Tracking in Point Clouds Based on Prediction Confidence-Guided Data Association

Hai Wu, Wenkai Han, Chenglu Wen, Xin Li, Cheng Wang

Summary: This paper introduces a new 3D multi-object tracker that leverages a novel data association scheme and aggregated pairwise cost to robustly, quickly, and accurately track objects in point clouds. Extensive experiments show that the proposed method outperforms existing state-of-the-art methods in terms of tracking accuracy and speed on the KITTI tracking benchmark.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Civil

BoundaryNet: Extraction and Completion of Road Boundaries With Deep Learning Using Mobile Laser Scanning Point Clouds and Satellite Imagery

Lingfei Ma, Ying Li, Jonathan Li, Jose Marcato Junior, Wesley Nunes Goncalves, Michael A. Chapman

Summary: The paper introduces a novel deep learning framework called BoundaryNet, utilizing mobile laser scanning point clouds and high-resolution satellite imagery for road boundary extraction and completion. By employing various algorithms, it achieves more complete and accurate road boundaries, along with calculating the inherent road geometries.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Geochemistry & Geophysics

Building Instance Extraction Method Based on Improved Hybrid Task Cascade

Xiaoxue Liu, Yiping Chen, Mingqiang Wei, Cheng Wang, Wesley Nunes Goncalves, Jose Marcato, Jonathan Li

Summary: This letter proposes an automatic building instance extraction method based on an improved hybrid task cascade (HTC), which achieved significant improvements in bounding box branch and mask branch compared to the mainstream Mask R-CNN method, especially in terms of AP values in the two branches.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Remote Sensing

An intensity-enhanced method for handling mobile laser scanning point clouds

Lina Fang, Hao Chen, Huan Luo, Yingya Guo, Jonathon Li

Summary: This paper presents a new intensity-enhanced method for mobile laser scanning point clouds. The method corrects the inconsistent intensity caused by different scanning distances and introduces the dark channel prior to transform intensity information adaptively. Multiple filters are used to remove isolated intensity noises.

INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION (2022)

Article Remote Sensing

Road marking extraction in UAV imagery using attentive capsule feature pyramid network

Haiyan Guan, Xiangda Lei, Yongtao Yu, Haohao Zhao, Daifeng Peng, Jose Marcato Junior, Jonathan Li

Summary: This article introduces an attentive capsule feature pyramid network (ACapsFPN) for accurately extracting road markings from high-resolution UAV images. The ACapsFPN integrates capsule representations and attention mechanisms into the feature pyramid network to improve extraction accuracy. The network is capable of extracting multi-level and multi-scale capsule features and emphasizes informative features through attention modules, providing high-quality and semantically-strong abstractions. Evaluations show the effectiveness and superiority of the ACapsFPN in extracting road markings under complex conditions.

INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION (2022)

Article Remote Sensing

Combining spatial response features and machine learning classifiers for landslide susceptibility mapping

Ruilong Wei, Chengming Ye, Tianbo Sui, Yonggang Ge, Yao Li, Jonathan Li

Summary: This study develops a deep learning framework that integrates spatial response features and machine learning classifiers for reliable landslide susceptibility mapping. In practical application, the framework has certain advantages in prediction accuracy, and considering the scale of landslides can improve the performance of the assessment.

INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION (2022)

暂无数据