Abstract
At present, in some real-time occasion like as stage performances, mixed reality effects are often generated by a mechanical means, or only between physical objects and virtual objects. This will lead to many uncontrollable shortcomings. in order to overcome the above disadvantage, the authors developed a mixed reality system for physical interaction. The experiment unfolds between the experiencer and the controllable Four-axis unmanned aerial vehicle with some performance props. The first step of the study is to build the stereoscopic scene through the camera calibration, the target coordinates in image are obtained by infrared sensors deployed on the experimenter and the aircraft respectively by Camshift algorithm and it can be transformed into the spatial coordinates by projection transformation. And the second step is based on different preset working modes and the coordinate relationship expressions between them that have been configured, with the action of the experimenter, Ant Colony Algorithm is used to move the Four-axis UAV to a certain position, thereby realizing this kind of precisely controllable interaction between entities. The final experiment in this paper has proven that our work provided a great mixed reality effect for occasions such as stage performances.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chatman, S.B.: Story and Discourse: Narrative Structure in Fiction and Film. Cornell University Press, Ithaca (1980)
Zhang, Y., Ma, P.F., Zhu, Z.Q.: Integrating performer into a real-time augmented reality performance spatially by using a multi-sensory prop. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, p. 66. ACM (2017)
Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92(1), 1–31 (2011)
Allen, J.G., Xu, R.Y.D., Jin, J.S.: Object tracking using camshift algorithm and multiple quantized feature spaces. In: Proceedings of the Pan-Sydney area workshop on Visual information processing, pp. 3–7. Australian Computer Society, Inc. (2004)
Yimin, L., Naiguang, L., Xiaoping, L., Peng, S.: A novel approach to sub-pixel corner detection of the grid in camera calibration. In: 2010 International Conference on Computer Application and System Modeling (ICCASM), vol. 5, pp. V5–18. IEEE (2010)
Li, J., Wan, H., Zhang, H., Tian, M.: Current applications of molecular imaging and luminescence-based techniques in traditional Chinese medicine. J. Ethnopharmacol. 137(1), 16–26 (2011)
Wen, Z., Cai, Z.: Global path planning approach based on ant colony optimization algorithm. J. Central South Univ. Technol. 13(6), 707–712 (2006)
Bouguet, J.-Y.: Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation 5(1–10), 4 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, Y., Ma, P., Gulfraz, A.R., Kong, L., Sun, X. (2019). Application of Physical Interactive Mixed Reality System Based on MLAT in the Field of Stage Performance. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science(), vol 11614. Springer, Cham. https://doi.org/10.1007/978-3-030-25999-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-25999-0_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25998-3
Online ISBN: 978-3-030-25999-0
eBook Packages: Computer ScienceComputer Science (R0)