4.8 Article

Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight

期刊

SCIENCE ROBOTICS
卷 7, 期 67, 页码 -

出版社

AMER ASSOC ADVANCEMENT SCIENCE
DOI: 10.1126/scirobotics.abl6259

关键词

-

类别

资金

  1. National Centre of Competence in Research (NCCR) Robotics through the Swiss National Science Foundation (SNSF)
  2. European Union [871479]
  3. European Research Council (ERC) [864042]
  4. European Research Council (ERC) [864042] Funding Source: European Research Council (ERC)

向作者/读者索取更多资源

Agilicious is a hardware and software framework designed for autonomous, agile quadrotor flight, supporting both model-based and neural network-based controllers. It offers a combination of high-performance hardware and flexible software stack, making it suitable for various tasks and environments, as well as hardware-in-the-loop simulation.
Autonomous, agile quadrotor flight raises fundamental challenges for robotics research in terms of perception, planning, learning, and control. A versatile and standardized platform is needed to accelerate research and let practitioners focus on the core problems. To this end, we present Agilicious, a codesigned hardware and software framework tailored to autonomous, agile quadrotor flight. It is completely open source and open hardware and supports both model-based and neural network-based controllers. Also, it provides high thrust-to-weight and torque-to-inertia ratios for agility, onboard vision sensors, graphics processing unit (GPU)-accelerated compute hardware for real-time perception and neural network inference, a real-time flight controller, and a versatile software stack. In contrast to existing frameworks, Agilicious offers a unique combination of flexible software stack and high-performance hardware. We compare Agilicious with prior works and demonstrate it on different agile tasks, using both model-based and neural network-based controllers. Our demonstrators include trajectory tracking at up to 5g and 70 kilometers per hour in a motion capture system, and vision-based acrobatic flight and obstacle avoidance in both structured and unstructured environments using solely onboard perception. Last, we demonstrate its use for hardware-in-the-loop simulation in virtual reality environments. Because of its versatility, we believe that Agilicious supports the next generation of scientific and industrial quadrotor research.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.8
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Multidisciplinary Sciences

Visual attention prediction improves performance of autonomous drone racing agents

Christian Pfeiffer, Simon Wengeler, Antonio Loquercio, Davide Scaramuzza

Summary: This study investigates whether neural networks can imitate human eye gaze behavior and attention to improve performance in drone racing tasks, and the experimental results demonstrate that human visual attention prediction can enhance the performance of autonomous drone racing.

PLOS ONE (2022)

Article Robotics

Perception-Aware Perching on Powerlines With Multirotors

Julio L. Paneque, Jose Ramiro Martinez-de Dios, Anibal Ollero, Drew Hanover, Sihao Sun, Angel Romero, Davide Scaramuzza

Summary: This letter presents a novel perching trajectory generation framework that computes perception-aware, collision-free, and dynamically-feasible maneuvers to guide the robot to perch on powerlines. The method considers the robot's dynamic model, collision avoidance, and maximizing the visibility of the powerline, and enables online execution on resource-constrained hardware.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

Minimum-Time Quadrotor Waypoint Flight in Cluttered Environments

Robert Penicka, Davide Scaramuzza

Summary: The method utilizes a hierarchical, sampling-based approach with increasingly complex quadrotor models to plan the minimum-time trajectory for a quadrotor over specified waypoints in the presence of obstacles. It first finds paths in different topologies and then uses an asymptotically-optimal, kinodynamic sampling-based method to find a time-optimal feasible trajectory based on the full quadrotor model.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

Time-Optimal Online Replanning for Agile Quadrotor Flight

Angel Romero, Robert Penicka, Davide Scaramuzza

Summary: In this letter, the challenge of flying a quadrotor using time-optimal control policies is addressed. The authors propose a sampling-based method for efficient generation of time-optimal paths and a Model Predictive Contouring Control approach for tracking the paths in real-time, ensuring adaptation to changes and unknown disturbances.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

Learning Minimum-Time Flight in Cluttered Environments

Robert Penicka, Yunlong Song, Elia Kaufmann, Davide Scaramuzza

Summary: This study addresses the problem of minimum-time flight for a quadrotor through a sequence of waypoints in the presence of obstacles. By leveraging deep reinforcement learning and classical topological path planning, a robust neural-network controller is trained to achieve better performance and higher robustness compared to state-of-the-art methods.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Robotics

A Comparative Study of Nonlinear MPC and Differential-Flatness-Based Control for Quadrotor Agile Flight

Sihao Sun, Angel Romero, Philipp Foehn, Elia Kaufmann, Davide Scaramuzza

Summary: This article compares two state-of-the-art control frameworks for accurate trajectory-tracking control of quadrotors. The study evaluates the nonlinear-model-predictive controller (NMPC) and the differential-flatness-based controller (DFBC) through simulations and real-world experiments. The findings demonstrate that the NMPC performs better in tracking dynamically infeasible trajectories, but at the expense of longer computation time and the risk of numerical convergence issues. The experiments also highlight the necessity of using an inner loop controller and aerodynamic drag model for agile trajectory tracking.

IEEE TRANSACTIONS ON ROBOTICS (2022)

Article Robotics

Hilti-Oxford Dataset: A Millimeter-Accurate Benchmark for Simultaneous Localization and Mapping

Lintong Zhang, Michael Helmberger, Lanke Frank Tarimo Fu, David Wisth, Marco Camurri, Davide Scaramuzza, Maurice Fallon

Summary: To drive the advancement of SLAM systems, we created the Hilti-Oxford Dataset, which includes various challenges to test the performance of SLAM algorithms in different scenarios. We implemented a novel ground truth collection method to accurately measure pose errors with millimeter accuracy. The dataset attracted a large number of researchers to participate in the Hilti SLAM challenge.

IEEE ROBOTICS AND AUTOMATION LETTERS (2023)

Article Automation & Control Systems

Autonomous cooperative wall building by a team of Unmanned Aerial Vehicles in the MBZIRC 2020 competition

Tomas Baca, Robert Penicka, Petr Stepan, Matej Petrlik, Vojtech Spurny, Daniel Hert, Martin Saska

Summary: This paper presents a system for autonomous cooperative wall building with a team of Unmanned Aerial Vehicles (UAVs). The system uses initial scanning to find the locations of bricks and wall structure, assigns UAVs to place bricks, and coordinates multiple UAVs for precise grasping and placement. The developed CTU-UPenn-NYU approach achieved the best performance in the MBZIRC competition by correctly placing a high number of bricks to collect the highest number of points.

ROBOTICS AND AUTONOMOUS SYSTEMS (2023)

Article Robotics

Real-Time Neural MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms

Tim Salzmann, Elia Kaufmann, Jon Arrizabalaga, Marco Pavone, Davide Scaramuzza, Markus Ryll

Summary: Model Predictive Control (MPC) is a popular framework in embedded control for high-performance autonomous systems. However, the use of accurate dynamics models is crucial for achieving good control performance. This study presents Real-time Neural MPC, a framework that efficiently integrates large neural network architectures as dynamics models within a model-predictive control pipeline. The experiments conducted in simulation and on a quadrotor platform show the capabilities of the system to run learned models with large modeling capacity using gradient-based online optimization MPC, resulting in significant improvements compared to state-of-the-art MPC approaches.

IEEE ROBOTICS AND AUTOMATION LETTERS (2023)

Article Robotics

Learned Inertial Odometry for Autonomous Drone Racing

Giovanni Cioffi, Leonard Bauersfeld, Elia Kaufmann, Davide Scaramuzza

Summary: Inertial odometry is a promising solution for state estimation in agile quadrotor flight. However, relying solely on inertial measurements leads to drift in pose estimates. This study proposes a learning-based odometry algorithm using an IMU as the only sensor for autonomous drone racing. The algorithm combines a model-based filter driven by inertial measurements with a learning-based module that uses thrust measurements. The results show the superiority of this inertial odometry algorithm in pose estimation compared to other visual-inertial odometry methods, indicating its potential in agile quadrotor flight.

IEEE ROBOTICS AND AUTOMATION LETTERS (2023)

Article Construction & Building Technology

Metaheuristic planner for cooperative multi-agent wall construction with UAVs

Basel Elkhapery, Robert Penicka, Michal Nemec, Mohsin Siddiqui

Summary: This paper presents a wall construction planner for UAVs that utilizes a GRASP metaheuristic to generate near-optimal building plans quickly. It addresses the time-consuming and labor-intensive task of wall construction while reducing safety risks. The planner outperforms other planning approaches and demonstrates the potential of UAVs and optimization algorithms in improving construction efficiency and safety.

AUTOMATION IN CONSTRUCTION (2023)

Article Computer Science, Artificial Intelligence

MRS Drone: A Modular Platform for Real-World Deployment of Aerial Multi-Robot Systems

Daniel Hert, Tomas Baca, Pavel Petracek, Vit Kratky, Robert Penicka, Vojtech Spurny, Matej Petrlik, Matous Vrba, David Zaitlik, Pavel Stoudek, Viktor Walter, Petr Stepan, Jiri Horyna, Vaclav Pritzl, Martin Sramek, Afzal Ahmad, Giuseppe Silano, Daniel Bonilla Licea, Petr Stibinger, Tiago Nascimento, Martin Saska

Summary: This paper introduces a modular autonomous UAV platform called the Multi-robot System (MRS) Drone that is suitable for indoor and outdoor applications. The MRS Drone features unique modular changes in actuators, frames, and sensory configuration, allowing smooth deployment of multiple aerial robots and outperforming other platforms. The platform is easy to assemble and modify, and it includes a realistic simulator for pre-flight testing and real-world experiments. The manuscript presents mechanical and electrical designs, software architecture, and technical specifications to build a fully autonomous multi UAV system, and demonstrates the full capabilities and unique modularity of the MRS Drone in various real-world applications.

JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS (2023)

Review Multidisciplinary Sciences

Cracking double-blind review: Authorship attribution with deep learning

Leonard Bauersfeld, Angel Romero, Manasi Muglikar, Davide Scaramuzza

Summary: In this study, a transformer-based neural network architecture is proposed to attribute an anonymous manuscript to an author using only the text content and author names. The largest authorship-identification dataset to date was created by leveraging over 2 million publicly available research papers on arXiv. The method achieves an unprecedented authorship attribution accuracy, correctly attributing up to 73% of papers in subsets with up to 2,000 different authors.

PLOS ONE (2023)

暂无数据