4.5 Article

Convolutional multi-grasp detection using grasp path for RGBD images

期刊

ROBOTICS AND AUTONOMOUS SYSTEMS
卷 113, 期 -, 页码 94-103

出版社

ELSEVIER
DOI: 10.1016/j.robot.2019.01.009

关键词

Multi-grasp detection; Grasp path; Convolutional neural network

资金

  1. National Natural Science Foundation of China [61725303, 91848205]

向作者/读者索取更多资源

Generally, most grasp detection models follow the similar frameworks as that in object detection, which use the convolutional neural network to regress the grasp parameters directly. However, grasp detection and object detection are actually different, for the ground truths in object detection are unique while that in grasp detection are not exhaustive. A predicted grasp could still be applicable despite it does not coincide well with ground truth. In this paper, a novel grasp detection model is constructed to make a fairer evaluation on grasp candidate. Instead of using isolated ground truths, the grasp path is introduced to reveal the possible consequent distribution of ground truths. The grasp candidate is first mapped to grasp path, generating the mapped grasp, and the bias between them works as the estimated error for back-propagation. Experiments deployed on grasping dataset as well as real-world scenarios show that our proposed method could improve the detection accuracy. In addition, it can be well-generalized to detect unseen objects. (C) 2019 Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Engineering, Aerospace

A non-cooperative target grasping position prediction model for tethered space robot

Lu Chen, Panfeng Huang, Jia Cai, Zhongjie Meng, Zhengxiong Liu

AEROSPACE SCIENCE AND TECHNOLOGY (2016)

Article Engineering, Aerospace

Autonomous Rendezvous and Docking with Nonfull Field of View for Tethered Space Robot

Panfeng Huang, Lu Chen, Bin Zhang, Zhongjie Meng, Zhengxiong Liu

INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING (2017)

Article Engineering, Aerospace

Line-Based Simultaneous Detection and Tracking of Triangles

Fan Zhang, Panfeng Huang, Lu Chen, Jia Cai

JOURNAL OF AEROSPACE ENGINEERING (2018)

Review Engineering, Mechanical

A review of space tether in new applications

Panfeng Huang, Fan Zhang, Lu Chen, Zhongjie Meng, Yizhai Zhang, Zhengxiong Liu, Yongxin Hu

NONLINEAR DYNAMICS (2018)

Article Automation & Control Systems

Refining object proposals using structured edge and superpixel contrast in robotic grasping

Lu Chen, Panfeng Huang, Zhou Zhao

ROBOTICS AND AUTONOMOUS SYSTEMS (2018)

Article Automation & Control Systems

A Context-Free Method for Robust Grasp Detection: Learning to Overcome Contextual Bias

Yuanhao Li, Panfeng Huang, Zhiqiang Ma, Lu Chen

Summary: The vision-based grasp detection method is important in researching the grasping task of robots. However, these research methods perform worse in practice compared to state-of-the-art accuracy on public datasets, mainly due to shifts in data distribution and the sensitivity of neural network-based methods to small data changes. The evaluation metrics of existing models do not reflect the actual robustness of the method. Therefore, a new solution is proposed, which includes a benchmark for verifying realistic robustness and a method for improving model robustness by transferring texture knowledge from other images.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Visual Tracking and Grasping of Moving Objects and Its Application to an Industrial Robot

Zhou Zhao, Panfeng Huang, Lu Chen

2017 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (RCAR) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Saliency based Proposal Refinement in Robotic Vision

Lu Chen, Panfeng Huang, Zhou Zhao

2017 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (RCAR) (2017)

Proceedings Paper Robotics

A fast detection method of arbitrary triangles for Tethered Space Robot

Jia Cai, Panfeng Huang, Lu Chen, Bin Zhang

2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO) (2015)

Proceedings Paper Robotics

Object Detection for Noncooperative Targets Using HOG-based Proposals

Lu Chen, Panfeng Huang, Jia Cai

2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO) (2015)

Article Automation & Control Systems

Mask-VRDet: A robust riverway panoptic perception model based on dual graph fusion of vision and 4D mmWave radar

Runwei Guan, Shanliang Yao, Lulu Liu, Xiaohui Zhu, Ka Lok Man, Yong Yue, Jeremy Smith, Eng Gee, Yutao Yue

Summary: With the development of Unmanned Surface Vehicles (USVs), the perception of inland waterways has become significant. Traditional RGB cameras cannot work effectively in adverse weather and at night, which has led to the emergence of 4D millimeter-wave radar as a new perception sensor. However, the radar suffers from water-surface clutter and irregular shape of point cloud. To address these issues, this paper proposes a high-performance panoptic perception model called Mask-VRDet, which fuses features of vision and radar using graph neural network.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Improving accuracy reconstruction of parts through a capability study: A methodology for X-ray Computed Tomography Robotic Cell

Adrien Le Reun, Kevin Subrin, Anthony Dubois, Sebastien Garnier

Summary: This study aims to evaluate the quality and health of aerospace parts using a high-dimensional robotic cell. By utilizing X-ray Computed Tomography devices, the interior of the parts can be reconstructed and anomalies can be detected. A methodology is proposed to assess both the raw process capability and the improved process capability, with three strategies developed to improve the robot behavior model and calibration.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

An analytical differential kinematics-based method for controlling tendon-driven continuum robots

Weiming Ba, Jung-Che Chang, Jing Liu, Xi Wang, Xin Dong, Dragos Axinte

Summary: This paper proposes a hybrid scheme for kinematic control of continuum robots, which avoids errors through tension supervision and accurate piecewise linear approximation. The effectiveness of the controller is verified on different continuum robotic systems.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Self-supervised prediction of the intention to interact with a service robot

Gabriele Abbate, Alessandro Giusti, Viktor Schmuck, Oya Celiktutan, Antonio Paolillo

Summary: In this study, a learning-based approach is proposed to predict the probability of human users interacting with a robot before the interaction begins. By considering the pose and motion of the user, the approach labels the robot's encounters with humans in a self-supervised manner. The method is validated and deployed in various scenarios, achieving high accuracy in predicting user intentions to interact with the robot.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Depth- and semantics-aware multi-modal domain translation: Generating 3D panoramic color images from LiDAR point clouds

Tiago Cortinhal, Eren Erdal Aksoy

Summary: This work presents a new depth-and semantics-aware conditional generative model, named TITAN-Next, for cross-domain image-to-image translation between LiDAR and camera sensors. The model is able to translate raw LiDAR point clouds to RGB-D camera images by solely relying on semantic scene segments, and it has practical applications in fields like autonomous vehicles.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Overcome the Fear Of Missing Out: Active sensing UAV scanning for precision agriculture

Marios Krestenitis, Emmanuel K. Raptis, Athanasios Ch. Kapoutsis, Konstantinos Ioannidis, Elias B. Kosmatopoulos, Stefanos Vrochidis

Summary: This paper addresses the issue of informative path planning for a UAV used in precision agriculture. By using a non-uniform scanning approach, the time spent in areas with minimal value is reduced, while maintaining high precision in information-dense regions. A novel active sensing and deep learning-based coverage path planning approach is proposed, which adjusts the UAV's speed based on the quantity and confidence level of identified plant classes.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Development and evaluation of fiber reinforced modular soft actuators and an individualized soft rehabilitation glove

Shota Kokubu, Pablo E. Tortos Vinocour, Wenwei Yu

Summary: In this study, a new modular soft actuator was proposed to improve the support performance of soft rehabilitation gloves (SRGs). Objective evaluations and clinical tests were conducted to demonstrate the effectiveness and functionality of the proposed actuator and SRG.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Design and experiment of a variable stiffness prosthetic knee joint using parallel elastic actuation

Jinliang Zhu, Yuanxi Sun, Jie Xiong, Yiyang Liu, Jia Zheng, Long Bai

Summary: This paper proposes an active prosthetic knee joint with a variable stiffness parallel elastic actuation mechanism. Numerical verifications and practical experiments demonstrate that the mechanism can reduce torque and power, thus reducing energy consumption and improving the endurance of the prosthetic knee joint.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Adaptive shift strategy of a novel power-cycling variable transmission for construction vehicles

Yong You, Jingtao Wu, Yunlong Meng, Dongye Sun, Datong Qin

Summary: A new power-cycling variable transmission (PCVT) is proposed and applied to construction vehicles to improve transmission efficiency. A shift correction strategy is developed based on identifying the changes in construction vehicles' mass and gradient. Simulation results show that the proposed method can correct shift points, improve operation efficiency, and ensure a safer operation process.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Base position and task assignment optimization concerning productivity and machining performance for multi-robot systems in aerospace manufacturing

Shaorui Liu, Wei Tian, Jianxin Shen, Bo Li, Pengcheng Li

Summary: This paper proposes a two-objective optimization technique for multi-robot systems, addressing the issue of balancing productivity and machining performance in high-quality machining tasks.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Identifying and approaching for obscured stairs

Pengchao Ding, Faben Zhu, Hongbiao Zhu, Gongcheng Wang, Hua Bai, Han Wang, Dongmei Wu, Zhijiang Du, Weidong Wang

Summary: We propose an autonomous approaching scheme for mobile robot traversing obstacle stairwells, which overcomes the restricted field of vision caused by obstacles. The scheme includes stair localization, structural parameter estimation, and optimization of the approaching process.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Comparative analysis of multiple YOLO-based target detectors and trackers for ADAS in edge devices

Pedro Azevedo, Vitor Santos

Summary: Accurate detection and tracking of vulnerable road users and traffic objects are vital tasks for autonomous driving and driving assistance systems. This paper proposes a solution for object detection and tracking in an autonomous driving scenario, comparing different object detectors and exploring the deployment on edge devices. The effectiveness of DeepStream technology and different object trackers is assessed using the KITTI tracking dataset.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Shared autonomy and positive power control for powered exoskeletons

Benjamin Beiter, Divya Srinivasan, Alexander Leonessa

Summary: Powered exoskeletons can significantly reduce physical workload and have great potential impact on future labor practices. To truly assist users in achieving task goals, a shared autonomy control framework is proposed to separate the control objectives of the human and exoskeleton. Positive Power control is introduced for the human-based controller, while 'acceptance' is used as a measure of matching the exoskeleton's control objective to the human's. Both control objectives are implemented in an optimization-based Whole-Body-Control structure. The results verify the effectiveness of the control framework and its potential for improving cooperative control for powered exoskeletons.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)