4.7 Article

A geometric approach for kinematic identification of an industrial robot using a monocular camera

Journal

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING
Volume 57, Issue -, Pages 329-346

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.rcim.2018.11.008

Keywords

Kinematic identification; Singular value decomposition; Joint axes vector; Monocular vision; Pose measurement

Funding

  1. Bhabha Atomic Research Centre/Board of Research in Nuclear Sciences India [2009/36/111]

Ask authors/readers for more resources

We propose a generic formulation to identify the kinematic parameters of an industrial robot using a geometric approach when no prior information about the robot's kinematics is available. The joint axes were estimated using the singular value decomposition applied to the pose data of the robot's end-effector. These data were obtained by actuating one joint of the robot at a time. The approach is first illustrated using the CAD model of the robot. Next, a simulation study was performed to decide on the number of data points and angular actuation required by a revolute joint to estimate the kinematic parameters. This was done considering the fact that there exist noise in the measurements from the sensors. In this paper, we used a monocular camera mounted on the end-effector of an industrial robot KUKA KR5 Arc as the measurement sensor. We used ArUco Marker maps instead of a single calibration grid to enhance the range of actuation for each joint that was otherwise restricted due to the Field of View of the camera. The robot's kinematic parameters were then identified using the proposed approach. The identified parameters using the monocular camera were compared with those obtained using other measurement devices, namely, a total station and a laser tracker.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Civil

Simplified Drag Modeling for the Dynamics of an Underwater Manipulator

Anil Kumar Sharma, Subir Kumar Saha

Summary: This article presents a simplified modeling of drag forces for underwater manipulators, using velocity distribution over the body's surface to determine drag. The method was found to be in good agreement with experimental results when simulating a two-link manipulator. Compared to strip theory, this approach eliminates the need for numerical integration or discretization, providing a more efficient alternative.

IEEE JOURNAL OF OCEANIC ENGINEERING (2021)

Article Chemistry, Analytical

Locomotion with Pedestrian Aware from Perception Sensor by Pavement Sweeping Reconfigurable Robot

Lim Yi, Anh Vu Le, Balakrishnan Ramalingam, Abdullah Aamir Hayat, Mohan Rajesh Elara, Tran Hoang Quang Minh, Braulio Felix Gomez, Lum Kai Wen

Summary: The article describes a self-reconfigurable pavement sweeping robot named Panthera, which can adapt to various pavement environments by reconfiguring its width while avoiding pedestrians during movement.

SENSORS (2021)

Article Chemistry, Analytical

Deep Learning Based Pavement Inspection Using Self-Reconfigurable Robot

Balakrishnan Ramalingam, Abdullah Aamir Hayat, Mohan Rajesh Elara, Braulio Felix Gomez, Lim Yi, Thejus Pathmakumar, Madan Mohan Rayguru, Selvasundari Subramanian

Summary: A deep learning-based pavement inspection framework is proposed in this study for detecting and localizing pavement defects and garbage. Experimental results show that this technique can accurately identify pavement issues and is suitable for real-time garbage detection and cleaning tasks.

SENSORS (2021)

Article Computer Science, Artificial Intelligence

Measurement of End-effector Pose Errors and the Cable Profile of Cable-Driven Robot using Monocular Camera

Riby Abraham Boby, Alexander Maloletov, Alexandr Klimchik

Summary: A method for measuring the performance metrics of an under-actuated cable-driven robot using a monocular camera was proposed, with comparisons made to a laser tracker. Suitable camera positions for measuring throughout the entire workspace were determined, showing that the camera could be located in four feasible regions.

JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS (2021)

Article Chemistry, Analytical

AI Enabled IoRT Framework for Rodent Activity Monitoring in a False Ceiling Environment

Balakrishnan Ramalingam, Thein Tun, Rajesh Elara Mohan, Braulio Felix Gomez, Ruoxi Cheng, Selvasundari Balakrishnan, Madan Mohan Rayaguru, Abdullah Aamir Hayat

Summary: A study introduces an AI-enabled IoRT framework for rodent activity monitoring in false ceilings, using a robot named Falcon. The algorithm is tested in a real-world environment, showing good detection accuracy for rodent signs and 3D-printed rodents.

SENSORS (2021)

Article Automation & Control Systems

Kinematic Identification of Industrial Robot Using End-Effector Mounted Monocular Camera Bypassing Measurement of 3-D Pose

Riby Abraham Boby

Summary: This article proposes a new method for kinematic identification of an industrial robot using a monocular camera mounted on its end-effector. By measuring solely in 2-D image space, the need for 3-D poses input in this process is eliminated, allowing for estimation of parameter corrections in a single stage. The use of camera enables a combination of geometric and parametric techniques of identification, providing a well-defined experimental strategy and identification of externally defined coordinate frames.

IEEE-ASME TRANSACTIONS ON MECHATRONICS (2022)

Article Engineering, Mechanical

Reconfigurable Robotic System Design With Application to Cleaning and Maintenance

A. A. Hayat, Lim Yi, M. Kalimuthu, M. R. Elara, K. L. Wood

Summary: This paper proposes a heuristic framework for designing reconfigurable robots, applying established transformation principles to system and subsystem design for innovation. Experiments demonstrate that this design method enables high performance in multiple modalities.

JOURNAL OF MECHANICAL DESIGN (2022)

Article Computer Science, Interdisciplinary Applications

Combination of geometric and parametric approaches for kinematic identification of an industrial robot

Riby Abraham Boby, Alexandr Klimchik

Summary: The combination of geometric and parametric approaches in kinematic identification is proposed in the study. The experimental strategy is similar to the geometric approach, activating each axis one by one. Estimation and correction processes are carried out step by step for improved accuracy.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2021)

Article Robotics

S-Sacrr: A Staircase and Slope Accessing Reconfigurable Cleaning Robot and its Validation

Prabakaran Veerajagadheswar, Shi Yuyao, Prathap Kandasamy, Mohan R. Elara, Abdullah A. Hayat

Summary: This letter introduces a novel robotic platform called s-Sacrr, which can change its morphology to traverse different surfaces for cleaning tasks on staircases and slopes. The robot has a reconfiguring feature that allows it to perform area coverage on various structures. Experimental results demonstrate the robot's ability to smoothly traverse and cover staircases and inclined surfaces.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Computer Science, Interdisciplinary Applications

Identification of elasto-static parameters of an industrial robot using monocular camera

Riby Abraham Boby

Summary: This study discusses the identification of elasto-static parameters of an industrial robot using measurements from a monocular camera, proposing an effective method for identification. Experimental results show that initial estimation of kinematic parameters on the robot is more accurate compared to other methods when considering positioning errors. Additionally, the proposed method can effectively reduce errors in the end-effector by compensating for errors due to kinematic and elasto-static parameters.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2022)

Proceedings Paper Automation & Control Systems

Multi-sensor Fusion Incorporating Adaptive Transformation for Reconfigurable Pavement Sweeping Robot

A. P. Povendhan, Lim Yi, A. A. Hayat, Anh Vu Le, K. L. J. Kai, B. Ramalingam, M. R. Elara

Summary: Efficient sensor fusion framework is necessary for autonomous robots. Our research proposes an adaptive sensor fusion framework that can be implemented on any reconfigurable robot and has been tested on a real robot.

2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2021)

Proceedings Paper Automation & Control Systems

Modeling and Control of PANTHERA Self-Reconfigurable Pavement Sweeping Robot under Actuator Constraints

Madan Mohan Rayguru, M. R. Elara, A. A. Hayat, B. Ramalingana, Spandan Roy

Summary: This paper presents a dynamic model and robust controller design for the self-reconfigurable pavement sweeping robot PANTHERA to tackle uncertainties arising from the reconfiguration process, external disturbances, and actuator saturation, which is validated through experiments.

2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2021)

Article Nutrition & Dietetics

Demographic trends and global assessment functioning of intellectually disabled patients admitted in rehabiltaions centre majmaah

Tabassum Alvi, Aalia Akhtar Hayat, Waqas Sami, Saira Farhan

Summary: A study was conducted in Majmaah, Saudi Arabia, to investigate the trends of 147 patients with intellectual disability. The findings revealed a balanced gender distribution, with most individuals aged between 11 and 44 years old, and a large proportion bedridden. The study also demonstrated a significant association between GAF scores and the severity of intellectual disability.

PROGRESS IN NUTRITION (2021)

Article Computer Science, Information Systems

Design of a Self-Reconfigurable Drain Mapping Robot With Level-Shifting Capability

Rizuwana Parween, Abdullah Aamir Hayat, Karthikeyan Elangovan, Koppaka Ganesh Sai Apuroop, Manuel Vega Heredia, Mohan Rajesh Elara

IEEE ACCESS (2020)

Article Computer Science, Information Systems

A Framework for Taxonomy and Evaluation of Self-Reconfigurable Robotic Systems

Ning Tan, Abdullah Aamir Hayat, Mohan Rajesh Elara, Kristin L. Wood

IEEE ACCESS (2020)

Article Computer Science, Interdisciplinary Applications

A deep learning-enhanced Digital Twin framework for improving safety and reliability in human-robot collaborative manufacturing

Shenglin Wang, Jingqiong Zhang, Peng Wang, James Law, Radu Calinescu, Lyudmila Mihaylova

Summary: In Industry 5.0, Digital Twins provide flexibility and efficiency for smart manufacturing. Deep learning techniques are used to enhance the Digital Twin framework, enabling the detection and classification of human operators and robots during the manufacturing process. The framework shows promising results in accurately detecting and classifying actions of human operators and robots in various scenarios.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

An iterative path compensation method for double-sided robotic roller forming of compact thin-walled profiles

Yi Liu, Junpeng Qiu, Jincheng Wang, Junhe Lian, Zeran Hou, Junying Min

Summary: In this study, a double-sided robotic roller forming process was developed to form ultrahigh strength steels to thin-walled profiles. Synchronized laser heating and iterative path compensation method were used to reduce forming forces and achieve high-precision forming.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Enabling collaborative assembly between humans and robots using a digital twin system

Zequn Zhang, Yuchen Ji, Dunbing Tang, Jie Chen, Changchun Liu

Summary: This paper proposes a digital twin system for human-robot collaboration (HRC) that overcomes the limitations of current methods and improves the overall performance. The system includes a human mesh recovery algorithm and uncertainty estimation to enhance the system's capabilities. Experimental results demonstrate the superiority of the proposed methods over baseline methods. The feasibility and effectiveness of the HRC system are validated through a case study involving component assembly.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Dynamic collision estimator for collaborative robots: A dynamic Bayesian network with Markov model for highly reliable collision detection

Junmin Park, Taehoon Kim, Chengyan Gu, Yun Kang, Joono Cheong

Summary: This paper proposes a highly reliable and accurate collision estimator for robot manipulators in human-robot collaborative environments using the Bayesian approach. By assuming robot collisions as dynamic Markov processes, the estimator can integrate prior beliefs and measurements to produce current beliefs in a recursive form. The method achieves compelling performance in collision estimation with high accuracy and no false alarms.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Teleoperation mode and control strategy for the machining of large casting parts

Meng Wang, Kaixuan Chen, Panfeng Wang, Yimin Song, Tao Sun

Summary: In this study, a novel teleoperation machining mode and control strategy were proposed to improve efficiency and accuracy in small batch production of large casting parts. By using variable motion mapping and elastic compensation, constant cutting force was achieved, and the workpiece was protected by employing forbidden virtual fixtures and movement constraints on the slave robot.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Efficient five-axis scanning-inspection path planning for complex freeform surfaces

Zhaoyu Li, Dong He, Xiangyu Li, Xiaoke Deng, Pengcheng Hu, Jiancheng Hao, Yue Hou, Hongyu Yu, Kai Tang

Summary: This paper presents a novel algorithm for planning a five-axis inspection path for arbitrary freeform surfaces. By converting the inspection path planning problem into a set-covering problem, the algorithm generates a near-minimum set of inspection paths that satisfy necessary constraints. Both computer simulation and physical inspection experiments confirm the effectiveness and advantages of the proposed method.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

A novel method based on deep reinforcement learning for machining process route planning

Hang Zhang, Wenhu Wang, Shusheng Zhang, Yajun Zhang, Jingtao Zhou, Zhen Wang, Bo Huang, Rui Huang

Summary: This paper introduces a novel framework based on deep reinforcement learning for generating machining process routes for designated parts. The framework utilizes graph representations of parts and employs convolutional graph neural networks for effective processing. Experimental results demonstrate the ability of the proposed method to generate efficient machining process routes and overcome limitations of traditional methods.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Human-Robot Shared Assembly Taxonomy: A step toward seamless human-robot knowledge transfer

Regina Kyung-Jin Lee, Hao Zheng, Yuqian Lu

Summary: Future manufacturing will witness a shift towards collaboration and compassion in human-robot relationships. To enable seamless knowledge transfer, a unified knowledge representation system that can be shared by humans and robots is essential. The Human-Robot Shared Assembly Taxonomy (HR-SAT) proposed in this study allows comprehensive assembly tasks to be represented as a knowledge graph that is understandable by both humans and robots. HR-SAT incorporates rich assembly information and has diverse applications in process planning, quality checking, and human-robot collaboration.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

A local POE-based self-calibration method using position and distance constraints for collaborative robots

Jianhui He, Lefeng Gu, Guilin Yang, Yiyang Feng, Silu Chen, Zaojun Fang

Summary: This paper presents a new modular kinematic error model for collaborative robots and proposes a portable self-calibration device to improve their positioning accuracy.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

A novel tool path smoothing algorithm of 6R manipulator considering pose-dependent dynamics by designing asymmetrical FIR filters

Hongwei Sun, Jixiang Yang, Han Ding

Summary: This paper proposes an asymmetrical FIR filter-based tool path smoothing algorithm to fully utilize the joint drive capability of robot manipulators. The algorithm considers the pose-dependent dynamics and constraints of the robot and improves motion efficiency by over 10% compared to traditional methods.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Learning compliant dynamical system from human demonstrations for stable force control in unknown environments

Dongsheng Ge, Huan Zhao, Yiwei Wang, Dianxi Li, Xiangfei Li, Han Ding

Summary: This paper focuses on learning a stable force control policy from human demonstration during contact transients. Based on the analysis of human demonstration data, a novel human-inspired force control strategy called compliant dynamical system (CDS) is proposed. The effectiveness of the proposed method is validated through simulation and real-world experiments.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Research on the modification of the tool influence function for robotic bonnet polishing with stiffness modeling

Xuepeng Huang, Zhenzhong Wang, Lucheng Li, Qi Luo

Summary: This study models the stiffness of a robot and modifies the tool influence function (TIF) with the Preston equation in order to achieve uniform surface quality in robotic bonnet polishing (RBP) of optical components. Experimental results validate the accuracy of the modified model.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

A general constraint-based programming framework for multi-robot applications

Mario D. Fiore, Felix Allmendinger, Ciro Natale

Summary: This paper presents a constraint-based programming framework for task specification and motion optimization. The framework can handle constraints on robot joint and Cartesian coordinates, as well as time dependency. It also compares with existing methods and provides numerical support through illustrative examples and case studies.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

Toolpath Generation for Robotic Flank Milling via Smoothness and Stiffness Optimization

Yongxue Chen, Yaoan Lu, Ye Ding

Summary: This paper presents an optimization method for directly generating a six-degree-of-freedom toolpath for robotic flank milling. By optimizing the smoothness of the toolpath and the stiffness of the robot, the efficiency, accuracy, and finish of the machining are improved.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)

Article Computer Science, Interdisciplinary Applications

AttentionVote: A coarse-to-fine voting network of anchor-free 6D pose estimation on point cloud for robotic bin-picking application

Chungang Zhuang, Haoyu Wang, Han Ding

Summary: This article proposes an end-to-end pipeline for synchronously regressing potential object poses from an unsegmented point cloud. It extracts point pair features and uses a voting architecture for instance feature extraction, along with a 3D heatmap for clustering votes and generating center seeds. An attention voting module is also employed to adaptively fuse point-wise features into instance-wise features. The network demonstrates robustness and improved performance in pose estimation.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2024)