2023 – 2025 ROS2UnityCoverage Control3D Reconstruction

Real-time Map Feedback Coverage Control for 3D Reconstruction

Coverage control for drone networks that feeds an evolving 3D mesh back into the controller, so the fleet flies where the reconstruction still needs data.

Real-time Map Feedback Coverage Control for 3D Reconstruction

Short Summary

This work introduces a real-time map feedback coverage control algorithm designed for drone networks. By integrating feedback from an evolving 3D mesh, the algorithm dynamically adjusts the importance density of the coverage control, ensuring efficient and accurate 3D map reconstruction. Simulations in Unity and ROS2 confirm its superiority over conventional methods, offering enhanced reconstruction quality and adaptability in complex environments.

Methodology

The algorithm uses NeuralRecon to process aerial images into a real-time 3D mesh, which informs the drones’ trajectories via a QP-based controller, enabling optimal coverage while prioritizing areas with significant mesh changes.

Publication: Muhammad Hanif, Takumi Sumino, Kuniaki Uto, Daisuke Ichihashi, Kelvin Cheng, and Takeshi Hatanaka. (2025). “Impact of Real-time Map Feedback on Coordinated Image Sampling for 3D Reconstruction.” European Control Conference 2025, submitted.

Video: Simulation Results: