Command and Control Collaboration Sand Table (C2-CST)

  • Bryan L. CroftEmail author
  • Crisrael LuceroEmail author
  • David NeurnbergerEmail author
  • Fred GreeneEmail author
  • Allen QiuEmail author
  • Roni HigginsEmail author
  • Eric GustafsonEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10910)


A Command and Control (C2) display system using the Microsoft HoloLens and the Intelligent Multi-UxV Planner with Adaptive Collaborative Control Technologies (IMPACT) has been developed as a demonstration of a new advanced user interface. This allows for human-to-human-to-machine collaboration for situational awareness, decision making, and C2 planning and execution of simulated multi-unmanned heterogeneous autonomous vehicles. The advanced user interface allows multiple operators to collaborate across a shared holographic sand table and control multiple vehicles. Multiple networking frameworks were used to offload the computation of vehicle autonomy and planning algorithms to allow the HoloLens to run efficiently for an improved user experience. Additionally, the concept of pseudo-classified information filtering allows for tiers of classification levels for each HoloLens user derived from a ‘need-to-know’ classification basis.


Command and Control Augmented reality Mixed reality Microsoft Hololens User interfaces Natural user interface Gaze Gesture Voice Unity3D Collaboration Classification filtering 


  1. 1.
    Coronado, B., Gustafson, E., Reader, J., Lange, D.S.: Mixing formal methods, machine learning, and human interaction through an autonomics framework. In: Proceedings of the 2016 AAAI Fall Symposium Series (2016)Google Scholar
  2. 2.
    Rosenberg, L.B.: The use of virtual fixtures as perceptual overlays to enhance operator performance in remote environments. Technical report AL-TR-0089, USAF Armstrong Laboratory (1992)Google Scholar
  3. 3.
    Zyda, M.J., Pratt, D.R., Monaham, J.G., Wilson, K.P.: NPSNET: constructing a 3-D virtual world. In: Proceedings of the 1992 Symposium on Interactive 3-D Graphics, March 1992Google Scholar
  4. 4.
    Cohen, P.R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J.: QuickSet: multimodal interaction for simulation set-up and control. Report from center for human computer communication, Oregon Graduate Institute of Science and Technology (1997)Google Scholar
  5. 5.
    Clarkson, J.D., Yi, J.,: LeatherNet: a synthetic forces tactical training system for the USMC commander. In: Proceedings of the Sixth Conference on Representation. Institute for Simulation and Training Technical report IST-TR-96-18, pp. 275–281 (1996)Google Scholar
  6. 6.
    Smalley, D.: BEMR: A New Reality for the Future Force. Armed with Science The Official US Defense Department Science Blog, December 2015Google Scholar
  7. 7.
  8. 8.
    Furlan, R.: The future of augmented reality. IEEE Spectr. 5(6), 21 (2016)CrossRefGoogle Scholar
  9. 9.
    Gutzwiller, R.S., Lange, D.S., Reeder, J., Morris, R.L., Rodas, O.: Human-computer collaboration in adaptive supervisory control and function allocation of autonomous system teams. In: Shumaker, R., Lackey, S. (eds.) VAMR 2015. LNCS, vol. 9179, pp. 447–456. Springer, Cham (2015). Scholar
  10. 10.
    Lange, D.S., Verbancsics, P., Gutzwiller, R., Reeder, J.: Command and control of teams of autonomous units. In: 17th International Command and Control Research and Technology Symposium (2012)Google Scholar
  11. 11.
    Cummings, M.L.: Operator interaction with centralized versus decentralized UAV architectures. In: Valavanis, K.P., Vachtsevanos, G.J. (eds.) Handbook of Unmanned Aerial Vehicles, pp. 977–992. Springer, Dordrecht (2015). Scholar
  12. 12.
    Distributed Messaging.
  13. 13.
    Photon Unity 3D Networking Framework SDKs and Game Backend.
  14. 14.
  15. 15.

Copyright information

© This is a U.S. government work and its text is not subject to copyright protection in the United States; however, its text may be subject to foreign copyright protection 2018

Authors and Affiliations

  1. 1.Space and Naval Warfare Systems Center PacificSan DiegoUSA

Personalised recommendations