4.7 Article

Segmentation and 3D reconstruction of rose plants from stereoscopic images

期刊

出版社

ELSEVIER SCI LTD
DOI: 10.1016/j.compag.2020.105296

关键词

Computer vision; Stereo vision; Semantic segmentation; 3D modelling; Automated agriculture

资金

  1. European Horizon 2020 program, under the project TrimBot2020 [688007]

向作者/读者索取更多资源

The method proposed in this paper is part of the vision module of a garden robot capable of navigating towards rose bushes and clip them according to a set of pruning rules. The method is responsible for performing the segmentation of the branches and recovering their morphology in 3D. The obtained reconstruction allows the manipulator of the robot to select the candidate branches to be pruned. This method first obtains a stereo pair of images and calculates the disparity image using block matching and the segmentation of the branches using a Fully Convolutional Neuronal Network modified to return a map with the probability at the pixel level of the presence of a branch. A post-processing step combines the segmentation and the disparity in order to improve the results. Then, the skeleton of the plant and the branching structure are calculated, and finally, the 3D reconstruction is obtained. The proposed approach is evaluated with five different datasets, three of them compiled by the authors and two from the state of the art, including indoor and outdoor scenes with uncontrolled environments. The different steps of the proposed pipeline are evaluated and compared with other state-of-the-art methods, showing that the accuracy of the segmentation improves other methods for this task, even with variable lighting, and also that the skeletonization and the reconstruction processes obtain robust results.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Ensemble classification from deep predictions with test data augmentation

Jorge Calvo-Zaragoza, Juan R. Rico-Juan, Antonio-Javier Gallego

SOFT COMPUTING (2020)

Article Computer Science, Artificial Intelligence

A multimodal approach for regional GDP prediction using social media activity and historical information

Javier Ortega-Bastida, Antonio Javier Gallego, Juan Ramon Rico-Juan, Pedro Albarran

Summary: This study proposes a multimodal method to predict regional GDP by combining historical GDP values with information from Twitter messages. The method, based on a two-stage architecture, successfully provides early forecasts of regional GDP and identifies the most influential opinions on the prediction.

APPLIED SOFT COMPUTING (2021)

Article Computer Science, Artificial Intelligence

Unsupervised neural domain adaptation for document image binarization

Francisco J. Castellanos, Antonio-Javier Gallego, Jorge Calvo-Zaragoza

Summary: Binarization is a common image processing task to separate foreground and background, particularly useful for preprocessing document images. This paper proposes a method combining neural networks and Domain Adaptation to achieve unsupervised document binarization, successfully dealing with new document domains without the need for labeled data. Innovative measurement of domain similarity is used to determine the appropriateness of the adaptation process.

PATTERN RECOGNITION (2021)

Article Computer Science, Artificial Intelligence

Efficient k -nearest neighbor search based on clustering and adaptive k values

Antonio Javier Gallego, Juan Ramon Rico-Juan, Jose J. Valero-Mas

Summary: The paper introduces the caKD+ algorithm which combines various techniques to improve the efficiency of kNN search, outperforming 16 state-of-the-art methods on 10 datasets.

PATTERN RECOGNITION (2022)

Article Computer Science, Artificial Intelligence

Incremental Unsupervised Domain-Adversarial Training of Neural Networks

Antonio-Javier Gallego, Jorge Calvo-Zaragoza, Robert B. Fisher

Summary: In the context of supervised statistical learning, the study explored the issue of inconsistent distributions between training and test sets, presenting an incremental approach to address it. By utilizing an unsupervised domain adaptation algorithm to identify target samples and iteratively adapting the model through self-labeling, an adversarial training strategy was proposed to enhance the performance of domain adaptation algorithms.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Automation & Control Systems

Efficient gesture recognition for the assistance of visually impaired people using multi-head neural networks

Samer Alashhab, Antonio Javier Gallego, Miguel Angel Lozano

Summary: This research proposes an interactive system for visually impaired individuals to control mobile devices using hand gestures, allowing them to perform multiple tasks without switching applications. The system utilizes a multi-head neural network and a dataset of images to detect and classify hand gestures, achieving competitive results compared to state-of-the-art methods.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Domain adaptation for staff-region retrieval of music score images

Francisco J. Castellanos, Antonio Javier Gallego, Jorge Calvo-Zaragoza, Ichiro Fujinaga

Summary: Optical music recognition (OMR) is the study of automatically reading music notation from score images. Staff-region retrieval is a crucial step in the OMR workflow, but the lack of ground-truth data poses challenges. To address this, researchers propose a domain adaptation technique called Domain-Adversarial Neural Network (DANN), which shows significant improvements in F-score through experiments.

INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION (2022)

Article Computer Science, Artificial Intelligence

An experimental study on marine debris location and recognition using object detection

Alejandro Sanchez-Ferrer, Jose J. Valero-Mas, Antonio Javier Gallego, Jorge Calvo-Zaragoza

Summary: The large amount of debris in the oceans has a significant impact on marine life. Efforts to tackle this problem through human-based campaigns have been insufficient due to the overwhelming amount of litter. Autonomous underwater vehicles (AUVs) have gained interest as a potential solution for locating and collecting garbage. This study explores the use of Mask Region-based Convolutional Neural Networks for automatic marine debris location and classification with limited data availability, achieving state-of-the-art results and suggesting room for further improvement.

PATTERN RECOGNITION LETTERS (2023)

Article Computer Science, Artificial Intelligence

Kurcuma: a kitchen utensil recognition collection for unsupervised domain adaptation

Adrian Rosello, Jose J. Valero-Mas, Antonio Javier Gallego, Javier Saez-Perez, Jorge Calvo-Zaragoza

Summary: The use of deep learning in computer vision tasks can achieve remarkable results, but it depends on the availability of training data and its relationship with the application scenario. Domain adaptation techniques are crucial in robotics, where there is limited access to targeted environment data. To facilitate research in this area, Kurcuma provides a collection of datasets for kitchen utensil recognition, along with a baseline using domain-adversarial training.

PATTERN ANALYSIS AND APPLICATIONS (2023)

Article Computer Science, Artificial Intelligence

Multilabel Prototype Generation for data reduction in K-Nearest Neighbour classification

Jose J. Valero-Mas, Antonio Javier Gallego, Pablo Alonso-Jimenez, Xavier Serra

Summary: This study adapts multiclass prototype generation strategies to the multilabel case and demonstrates through experiments that they significantly improve efficiency and classification performance, especially showing stronger robustness in noisy scenarios.

PATTERN RECOGNITION (2023)

Article Computer Science, Information Systems

An overview of ensemble and feature learning in few-shot image classification using siamese networks

Jose J. Valero-Mas, Antonio Javier Gallego, Juan Ramon Rico-Juan

Summary: SNNs are a representative approach for Few-Shot Image Classification, utilizing weight sharing CNN models to reduce parameters and overfitting. This study assesses the representation capabilities of SNN architectures, introduces techniques such as data augmentation and transfer learning, and achieves high classification rates with limited prototypes per class.

MULTIMEDIA TOOLS AND APPLICATIONS (2023)

Proceedings Paper Automation & Control Systems

Real-time Stereo Visual Servoing for Rose Pruning with Robotic Arm

Hanz Cuevas-Velasquez, Antonio-Javier Gallego, Radim Tylecek, Jochen Hemming, Bart van Tuijl, Angelo Mencarelli, Robert B. Fisher

2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2020)

Article Computer Science, Artificial Intelligence

Automatic scale estimation for music score images

Francisco J. Castellanos, Antonio-Javier Gallego, Jorge Calvo-Zaragoza

EXPERT SYSTEMS WITH APPLICATIONS (2020)

Article Computer Science, Information Systems

Insights Into Efficient k-Nearest Neighbor Classification With Convolutional Neural Codes

Antonio-Javier Gallego, Jorge Calvo-Zaragoza, Juan Ramon Rico-Juan

IEEE ACCESS (2020)

暂无数据