Interactive Generation of Virtual Environments Using MUAVs

Sven Strothoff, Dirk Feldmann, Frank Steinicke, Tom Vierjahn, Sina Mostafawy

In Proceedings: International Symposium on VR innovation 2011


In this paper we introduce a novel approach to interactively generate a virtual environment (VE) as reconstruction of the real world by using a swarm of autonomously flying miniature unmanned aerial vehicles (MUAVs). In our system each of the MUAVs is equipped with advanced network as well as different sensor technologies, which allow to capture images from low altitudes and to transfer those to a ground station, where the captured environment is reconstructed. At the ground station, the virtual 3D reconstruction is displayed in different virtual reality (VR) environments in which operators can not only explore the VE, but also interactively control the 3D reconstruction process. Therefore, virtual representations of the real MUAVs are visually integrated in the VE according to their real world position and orientation. The operator can manually steer these virtual MUAVs leading to corresponding movements of their real world counterparts.

In this paper we introduce the AVIGLE project. In particular, we describe the 3D reconstruction process as well as the rendering of the large amount of data collected by the MUAVs. Furthermore, we outline the VR setup, and explain in detail how operators can inter- act with the virtual 3D reconstruction and the visual representation of the MUAVs.

  author    = {Strothoff, Sven and 
               Feldmann, Dirk and 
               Steinicke, Frank and 
               Vierjahn, Tom and 
               Mostafawy, Sina},
  title     = {{Interactive Generation of Virtual Environments Using MUAVs}},
  booktitle = {Proc. Int'l Symp. VR innovation},
  editors   = {Park, Jong-Il and 
               Wan, Waggen and 
               Kajimoto, Hiroyuki and 
               Nii, Hideaki},
  series    = {ISVRI'11},
  pages     = {89--96},
  year      = {2011},
  ISBN      = {978-1-4577-0055-2},
  DOI       = {10.1109/ISVRI.2011.5759608}