Home

Mobile Augmented Reality Application (MARA) for Navigation in a Building

Current Students: Sri Teja Bodempudi

Past Students: Usha Govindaraju, Pranay Rajeev, Dexter Ballerda and Diliorah Arah

Status: Current

Augmented Reality (AR) is a relatively new technology that blends real-world data and computer-generated graphics in real time, blurring the line between reality and virtual by enhancing what we perceive. It opens a whole lot of possibilities in many fields, from medical to engineering, including evacuation, navigation, network security, and learning.

  Marker 1 Marker 2 Marker 3 Floor 1 Floor 2 Floor 3
 

Project 1: M-Evac: MARA emergency response system for CS Building Navigation, Evacuation and Campus Safety

 

M-Evac is a AR application that allows you to view the 3D augmented reality scenes. 3D models are overlaid on the real world as seen through a mobile or computer’s webcam, making them appear to part of the surrounding real environment. M-Evac uses marker-based camera tracking such that the 3D models appear attached to physical printed markers. We show how the application is able to display a 3D model of the building using markers and web camera. The system gives a visual representation of a building in 3D space, allowing people to see where exits are in the building through the use of a smart phone. M-Evac is a Mobile Augmented Reality Application (MARA). The MARA will enale enable policymakers and first-responders to evaluate evacuation strategies and mobile device usage during evacuations. Thus, the MARA was built as an alternative to live evacuation drills using Unity3d along with the Vuforia AR Toolkit and the Android SDK. M-Evac will supports the following features:

• scaling models
• loading 3d models in the android mobile
• positioning models relative to real markers
• user customizable tracking patterns
• windowed or full screen viewing model
• support for a variety of camera image resolutions

Phase 1: Building Evacuation using Tablet Video

Phase 1: Building Evacuation using Phone Video


     
 
  CS building in AR with buttons to toggle for text and directions CS building floor plan with smoke and fire
 
  CS building floor plan with smoke, fire, and arrows to show the exit. Arrows to shortest path to exit.
 
  Evacuation AR app on Sansung galaxy Note 9. Arrows to shortest path to exit on Sansung Galaxy Note 9.
     
  Marker 1 Marker 2 Marker 3  
 

Project 2: M-Evac: Using ARToolkit to create an emergency response system for library evacuation

  Animation of people evacuating from the BSU Library 3D display of people evacuating the Library using marker and android tablet or phone (samsung GIII)
 
 

Fire and smoke while people are evacuating the BSU library building

 
  Android App Android App in development for Bowie State University Campus
     

Project 3: Augmented Reality Sytem for Navigation and Learning for Campus Safety

Area: Network Middleware, Location Based System, Mobile network, Security and Privacy for AR Systems

The proposed systems will use GPS data to generate a geo-spatial representation of the university campus environment that can be navigated and manipulated through augmented reality. Users can manipulate ARToolKit markers augmented by 3D BSU campus map with tagged locations containing images, 3d models, video, audio, and text. Our proposed solution would include putting the markers at key spots in the building, such that the user can use their smart phones to view the 3D representation of the building and exits. We are integrating GPS, google maps, video to be integrated into the system. We propose to do the following:

  • Developing a network middleware for Mobile Augmented Reality Application (MARA) that can be applied to the area of large scale campus safety application.
  • Developing a Location Based Augmenetd Reality System (LBARS) for navigation and learning on campus. The proposed location based surveillance system will provide customized real-time information by incorporating decision-making strategies to guide people during emergencies. Incorporate special instructions based on external threat condition like smoke, biohazard for the safety of occupants.
  • Develop Security and Privacy for the MARA Systems. Devices providing immersive feedback can be used by malicious applications to deceive users about the real world.
  • Decision Support System: The proposed tool will recommend occupants regarding the various safety measures to avoid the threat and give customized real-time evacuation communication plan for the course of action to be taken by each user to reach a safe location.
 
     
 
     
    BSU Map
 

[Acknowledgement:This study is supported, in part, by National Science Foundation, Award HRD‐1137541 and Award Number: HRD-1238784]

Publications

  1. Stigall, J., Bodempudi, S.T., Sharma, S, Scribner, D., Grynovicki, J., Grazaitis, P., "Use of Microsoft HoloLens in indoor evacuation", International Journal of Computers and their Applications, IJCA, Vol. 26, No. 1, March 2019.
  2. Stigall, J., Sharma, S, "Evaluation of Mobile Augmented Reality Application for Building Evacuation", Proceedings of 28th International Conference on Software Engineering and Data Engineering (SEDE 2019) in San Diego, CA, USA on September 30 - October 2, 2019.
  3. Sharma, S, Bodempudi, S.T., Scribner, D., Grynovicki, J., Grazaitis, P., "Emergency response using HoloLens for building evacuation", Proceeding of 21st International Conference on Human-Computer Interaction, Orlando, Florida, USA, 26-31 July 2019.
  4. Sharma, S, Bodempudi, S.T., Scribner, D., Grynovicki, J., Grazaitis, P., "Emergency response using HoloLens for building evacuation", Proceeding of 21st International Conference on Human-Computer Interaction, DOI: https://doi.org/10.1007/978-3-030-21607-8_23 , Online ISBN 978-3-030-21607-8, Orlando, Florida, USA, 26-31 July, HCII 2019, Lecture Notes in Computer Science, vol 11574, pp. 299–311, 2019.
  5. Stigall, J., Bodempudi, S.T., Sharma, S, Scribner, D., Grynovicki, J., Grazaitis, P., "Building Evacuation using Microsoft HoloLens", Proceedings of 27th International Conference on Software Engineering and Data Engineering (SEDE 2018), New Orleans, Louisiana, USA, pp. 20-25, October 8-10, 2018. [Best paper award finalist]
  6. James Stigall and Dr. Sharad Sharma, "Mobile augmented reality application for building evacuation" , Poster Presentation, 11th Annual Grant Expo and Research day, Office of Research and Sponsored Programs (ORSP), Bowie State University, April 10, 2018.
  7. Stigall, J., Sharma, S, "Mobile Augmented Reality Application for Building Evacuation Using Intelligent Signs", proceedings of ISCA 26th International Conference on Software Engineering and Data Engineering (SEDE-2017), pp. 19-24, San Diego,CA, USA, October 2-4, 2017.
  8. Sharma, S, Jerripothula, S., "An indoor augmented reality mobile application for simulation of building evacuation", proceedings of SPIE conference on the Engineering Reality of Virtual Reality 2015, paper 9392-7, San Francisco, CA, USA, 9 - 10 February 2015.


VR LABORATORY (C) 2011-2019, ALL RIGHTS RESERVED