4.6 Article

Using 3D Convolutional Neural Networks for Tactile Object Recognition with Robotic Palpation

期刊

SENSORS
卷 19, 期 24, 页码 -

出版社

MDPI
DOI: 10.3390/s19245356

关键词

tactile perception; robotic palpation; underactuated grippers; deep learning

资金

  1. University of Malaga
  2. Ministerio de Ciencia, Innovacion y Universidades, Gobierno de Espana [DPI2015-65186-R, RTI2018-093421-B-I00]
  3. European Commission [BES-2016-078237]

向作者/读者索取更多资源

In this paper, a novel method of active tactile perception based on 3D neural networks and a high-resolution tactile sensor installed on a robot gripper is presented. A haptic exploratory procedure based on robotic palpation is performed to get pressure images at different grasping forces that provide information not only about the external shape of the object, but also about its internal features. The gripper consists of two underactuated fingers with a tactile sensor array in the thumb. A new representation of tactile information as 3D tactile tensors is described. During a squeeze-and-release process, the pressure images read from the tactile sensor are concatenated forming a tensor that contains information about the variation of pressure matrices along with the grasping forces. These tensors are used to feed a 3D Convolutional Neural Network (3D CNN) called 3D TactNet, which is able to classify the grasped object through active interaction. Results show that 3D CNN performs better, and provide better recognition rates with a lower number of training data.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Chemistry, Analytical

Walk-IT: An Open-Source Modular Low-Cost Smart Rollator

Manuel Fernandez-Carmona, Joaquin Ballesteros, Marta Diaz-Boladeras, Xavier Parra-Llanas, Cristina Urdiales, Jesus Manuel Gomez-de-Gabriel

Summary: Smart rollators can autonomously capture gait parameters and avoid complex setups, with the introduction of a low cost open-source modular rollator in this work. The system is based on commercial components and its software architecture runs over ROS2, allowing for further customization and expansion.

SENSORS (2022)

Article Chemistry, Analytical

Automatically Annotated Dataset of a Ground Mobile Robot in Natural Environments via Gazebo Simulations

Manuel Sanchez, Jesus Morales, Jorge L. Martinez, J. J. Fernandez-Lozano, Alfonso Garcia-Cerezo

Summary: This paper presents a new synthetic dataset obtained from Gazebo simulations of an Unmanned Ground Vehicle (UGV) moving on different natural environments. The dataset includes labeled points and pixels from LiDAR and camera scans, and also provides ground-truth 3D pose for benchmarking and supervised learning purposes.

SENSORS (2022)

Article Robotics

A Hybrid Learning and Optimization Framework to Achieve Physically Interactive Tasks With Mobile Manipulators

Jianzhuang Zhao, Alberto Giammarino, Edoardo Lamon, Juan M. Gandarias, Elena De Momi, Arash Ajoudani

Summary: This article proposes a hybrid learning and optimization framework for mobile manipulators, which can be applied to complex and physically interactive tasks. The framework utilizes a physical interface, GMM/GMR, and quadratic programming to achieve passivity in the controlled system.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

MOCA-S: A Sensitive Mobile Collaborative Robotic Assistant Exploiting Low-Cost Capacitive Tactile Cover and Whole-Body Control

Mattia Leonori, Juan M. Gandarias, Arash Ajoudani

Summary: This paper presents MOCA-S, a mobile collaborative robotic assistant with a low-cost capacitive tactile cover for measuring interaction forces on the robot base. Two expanded whole-body controllers are proposed and tested, demonstrating the potential for safe physical Human-Robot Interaction (pHRI).

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

A Self-Tuning Impedance-Based Interaction Planner for Robotic Haptic Exploration

Yasuhiro Kato, Pietro Balatti, Juan M. Gandarias, Mattia Leonori, Toshiaki Tsuji, Arash Ajoudani

Summary: This letter presents a novel interaction planning method that uses impedance tuning techniques to respond to environmental uncertainties and unpredictable conditions using haptic information only. The proposed algorithm plans the robot's trajectory based on haptic interaction with the environment and adapts planning strategies as needed. Experimental results show that the method can successfully autonomously plan the robot's trajectory and achieve compliant interaction with an unknown environment.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

Autonomous Wristband Placement in a Moving Hand for Victims in Search and Rescue Scenarios With a Mobile Manipulator

Francisco Pastor, Francisco J. Ruiz-Ruiz, Jesus M. Gomez-de-Gabriel, Alfonso J. Garcia-Cerezo

Summary: This letter presents an autonomous method for placing a sensorized wristband on victims in a search-and-rescue scenario. The method includes a two-phase process of visual hand tracking and haptic force control, and the wristband design is also discussed. Experimental results demonstrate the success of the wristband placement and the overall performance of the system in a large-scale disaster exercise.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Chemistry, Analytical

Enabling Remote Responder Bio-Signal Monitoring in a Cooperative Human-Robot Architecture for Search and Rescue

Pablo Vera-Ortega, Ricardo Vazquez-Martin, J. J. Fernandez-Lozano, Alfonso Garcia-Cerezo, Anthony Mandow

Summary: This article addresses the importance of real-time bio-signal sensor monitoring for emergency responders in disaster scenarios. It proposes the integration of health monitoring sensors in an Internet of Cooperative Agents architecture for search and rescue missions. The article presents experiments, surveys, and a wearable sensor suite design to enhance emergency worker activity.

SENSORS (2023)

Article Chemistry, Analytical

Dataset with Tactile and Kinesthetic Information from a Human Forearm and Its Application to Deep Learning

Francisco Pastor, Da-Hui Lin-Yang, Jesus M. Gomez-de-Gabriel, Alfonso J. Garcia-Cerezo

Summary: This paper presents a dataset of tactile and kinesthetic data obtained from a robot gripper that grabs a human forearm. A fusion approach is used to estimate the actual grasped forearm section, which achieves good results.

SENSORS (2022)

Article Computer Science, Information Systems

Analysis of Tread ICRs for Wheeled Skid-Steer Vehicles on Inclined Terrain

Jorge L. Martinez, Jesus Morales, Jesus M. Garcia, Alfonso Garcia-Cerezo

Summary: The kinematic relationship between the instantaneous centers of rotation (ICRs) and differential-drive locomotion in skid-steer vehicles on level terrain has not yet been analyzed on sloped ground. This paper presents a dynamic simulation of a skid-steer vehicle on level ground, where pitch and roll are kept constant by substituting gravity with an equivalent external force. The variations in tread ICRs on inclined ground have been deduced and experimentally corroborated with a four-wheeled mobile robot.

IEEE ACCESS (2023)

Article Automation & Control Systems

DEM-AIA: Asymmetric inclination-aware trajectory planner for off-road vehicles with digital elevation models

Manuel Toscano-Moreno, Anthony Mandow, Maria Alcazar Martinez, Alfonso Garcia-Cerezo

Summary: In this article, a new DEM-based asymmetric inclination-aware trajectory planner for ground vehicles is proposed. The planner considers path slopes and defines a non-linear velocity constraints function to optimize travel time. Extensive experimental analysis and comparison with state-of-the-art path planners show the performance of the proposed planner in inclination-aware trajectory planning.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2023)

Article Education & Educational Research

Design and Assessment of Survey in a 360-Degree Feedback Environment for Student Satisfaction Analysis Applied to Industrial Engineering Degrees in Spain

Francisco-Javier Granados-Ortiz, Ana Isabel Gomez-Merino, Jesus Javier Jimenez-Galea, Isidro Maria Santos-Raez, Juan Jesus Fernandez-Lozano, Jesus Manuel Gomez-de-Gabriel, Joaquin Ortega-Casanova

Summary: The number of students enrolled in engineering studies in Spain is declining due to the difficulty in passing subjects and a lack of active student participation. This study aims to provide a feedback tool and survey to assess student satisfaction with scientific-technological activities in industrial engineering. The assessment process involves peer-assessment, self-assessment, and hetero-assessment, followed by a validated survey. Results show that while students found the evaluation experience objective, only a minority considered it advantageous for their learning and self-training, suggesting a need for complementary improvements to the evaluation system.

EDUCATION SCIENCES (2023)

Article Computer Science, Information Systems

Combined Path and Motion Planning for Workspace Restricted Mobile Manipulators in Planetary Exploration

Gonzalo J. J. Paz-Delgado, J. Ricardo Sanchez-Ibanez, Raul Dominguez, Carlos J. J. Perez-Del-Pulgar, Frank Kirchner, Alfonso Garcia-Cerezo

Summary: A coupled path and motion planner for mobile manipulation is proposed to ensure mission safety and high efficiency. The path planner generates a safe trajectory to reach the goal vicinity and control the final rover orientation. The motion planner generates the arm joints motion profile using a 3D tunnel-like cost volume to ensure self-collision avoidance.

IEEE ACCESS (2023)

Article Engineering, Electrical & Electronic

Estimation of the Interaction Forces in a Compliant pHRI Gripper

Francisco J. Ruiz-Ruiz, Cristina Urdiales, Jesus M. Gomez-de-Gabriel

Summary: Physical human-robot interaction (pHRI) is an essential skill for robots expected to work with humans. This study proposes a new analytical model that utilizes the inherent compliance of a gripper to calculate external interaction forces, enabling adaptive and compliant grasping.

MACHINES (2022)

Article Computer Science, Cybernetics

A Directional Vibrotactile Feedback Interface for Ergonomic Postural Adjustment

Wansoo Kim, Virginia Ruiz Garate, Juan M. Gandarias, Marta Lorenzini, Arash Ajoudani

Summary: The objective of this paper is to develop and evaluate a directional vibrotactile feedback interface as a guidance tool for postural adjustments during work. A vibrotactile device called ErgoTac is employed to develop different feedback modalities, and the most suitable one is evaluated through experiments. The results show strong evidence and intuitiveness of the developed feedback modality in providing guidance towards ergonomic working conditions.

IEEE TRANSACTIONS ON HAPTICS (2022)

Article Ergonomics

Improving the prevention of fall from height on construction sites through the combination of technologies

Maria del Carmen Rey-Merchan, Jesus M. Gomez-de-Gabriel, Juan-Antonio Fernandez-Madrigal, Antonio Lopez-Arquillos

Summary: This article examines the limitations of monitoring safety harness usage in the workplace using Bluetooth Low Energy devices and proposes integrating other technologies to improve effectiveness.

INTERNATIONAL JOURNAL OF OCCUPATIONAL SAFETY AND ERGONOMICS (2022)

暂无数据