INFO 5777: Virtual Reality and its Applications

Instructor: Dr. Sharad Sharma

---

Project Proposal Report

2-3 students in each group

( Students are free to choose their own project & team members. But it should follow the below guidelines)

Guidelines for Project Proposal Report:

• Proposal: font size 10. Arial or times new roman. Submit a hardcopy.
• A header should provide: - Project title - Names of all group members - Course and term
• GOAL AND OBJECTIVES: List out the goals of the project. [For example evacuation behavior simulation, plane take-off simulation, hazardous events, reconstruction or remodeling of a building, etc.
• MODELING: Describe the envisioned virtual environment (building, trees, people, furniture, landscaping elements, etc.) [3ds Max or Google Sketchup]
• Planned geometry, use of textures, animations, behavior and functionality, etc.
• Describe how the application will be used. (envisioned users, navigation, interactions, etc.)
• List software and hardware equipment that is required or desired for the implementation.
  • Choose between Vizard, Unity or Unreal
• The proposal should explain how the following will be implemented: (Give examples of how the functionality will be incorporated)
  1. Vision: Use of textures and 3D models to provide detailed information in the project.
  2. Sound: Use speech, music or ambient sounds to help provide information about this place.
  3. Animation: Use at least three animated object in the project.
  4. Interactivity: Use at least three user-triggered events in the project.
  5. Characters Behaviors: Have animated agents (Inbuilt behavior such as path following behavior) in the environment.
  6. Sensors: Use at least three different types of sensors (Proximity, Time, Touch, and Visibility) in the project. (use at least three trigger events)
  7. Player: Add a Player Controller to the Scene: First Person Controller or 3rd Person Controller
  8. AI Implementation: AI functionality depending upon the project (navigation, behaviors, shortest path, etc.), implement different behaviors (selfish, altruistic, learning, adaptive, etc.) in the environment through a user menu (number of agent’s assignment), Integration with Chat GPT, NPC AI Engine, voice interaction, etc.
  9. Interface elements: Design the interface that include menu items such as buttons, etc.
  10. Multi-User Environment OR Hardware Integration OR CUSTOM avatar/character (Mixamo) OR Mobile Version (with Joystick for navigation): More than two people to be present in the same environment. Hardware can be metaquest, htc vive, HoloLens, smart phone, etc.
• Incorporate the above functionalities and explain how/where it will be implemented.
• Who will be using this VR Application (Target audience)?
• Software and hardware used: Unity 3D or Vizard or Unreal.

1. Management Plan: Describe each individual group member's role and responsibility
2. Individual Contributions and Cross-Evaluation (WILL BE DONE AT THE END OF PROJECT)

RECOMENDED PROJECTS by Instructors/Mentors/Faculty

2025

1. A VR environment to understand anxiety and stress management in an academic environment. Example: Here, Sample

2. VR Glucose Monitoring System or Instruction System: Help people undertsand Type 1 and Type 2 diabates. Create a VR version of DDS17 screening scale Example: Here, Sample

2.1 Create VR-learning tool to explore Diabetes distress. OR or tool might help a recently diagnosed person with Type 2 diabetes living anywhere in Texas cope with one or more of the following challenges associated with diabetes distress. (Check with Dr. Sharma for more details)

3. Create a Virtual Instrcutor to interact with realtime user for training. Checck asset - NPC AI Engine - Dialog, actions, voice and lipsync - Convai for voice and lip sync. The Virtual Instrcutor can be for a museum, tour guide, campus tour guide, virtual classroom, etc.

4. Create AI behaviors for NPCs to interact with user controlled agents in a multi-user environment for different tasks. For example. Check the megacity project where the policeman can escort blue people to a safe zone during emeregncies.

5. Training in multi-user environment: Create a VR instructor to interact with AI-powered training for public speaking, leadership, sales,interview, etc. Practice in a wide range of self-paced VR scenarios, from a press conference to a meeting room. Check Virtual Speech, for training, roleplay, skill development, lip synch, etc.

6. Digital Twin: Fire and Smoke (UNITY)
https://github.com/urbaninfolab/FireIncidentFrontend
https://github.com/urbaninfolab/AustinDigitalTwin

2024

1. Digital Twin VR Project: A digital twin is a dynamic virtual copy of a physical asset, process, system or environment that looks like and behaves identically to its real-world counterpart: https://unity.com/solutions/digital-twins, https://www.youtube.com/watch?v=yX06te3zMOU, Creating Digital Twins with Unity, realvirtual.io and ChatGPT, Connect IoT data to HoloLens 2 with Azure Digital Twins and Unity, Connecting your Digital Twin to the Unity Game Engine,

2. Create a Virtual Instrcutor to interact with realtime user for training. A "hybrid" meeting scenario where some will be sitting face-to-face in a room and other will be on a large screen via zoom having a group discussion. Many buttons and features can be created to navigate in face-to-face room or in the virtual participant's virtual environment. They can create tired faces for virtual participants and happy faces for the face-to-face ones. Exploring developing an AI instructor with Chat GPT integration/interaction. Example: DE&I Training in VR: Micro-aggressions, Allyship, Exclusion, and More (virtualspeech.com), Managing Workplace Stress: Online Course with Practice (virtualspeech.com)

3. A bullying scenario: Children or high school kids are playing together in the playground, or at a party or in the school hallway. There will be a perpetrator, a victim and bystanders. All the functionalities listed in the project description can be used here. Can be helpful in bullying prevention program especially in perspective taking.

4. A decision-making game: The creation of the Virtual Moon Survival game or Lost at Sea game. A ship got lost in the ocean (or a spaceship got lost in the space) and they are left with 15 important items. They have to choose the most important items from the ship and rank order the items from the most important to the least important for survival. The items include a mirror, mosquito net, floating seat, radio, etc. Those who can order them correctly can get the full points.

5. A domestic violence environment with a perpetrator, a victim and witness. The response and creation of each person. This can be used in a prevention program especially in perspective taking. All the functionalities listed in the project description can be used here.

6. A virtual campus tour for a university for navigation, evacuation, and virtual tours. Without going into much detail, one can create buildings, cafeteria, a gym, a stadium, trees, statues, etc.

PROJECT IDEAS

1.2. Course curriculum modules: Create with more inquiry based problem-solving activities and hand-on experiences based on Virtual and Augmented Reality educational modules.

Create Gaming Instructional Modules to Enhance Student Learning in Lower Level Core Computer Science Courses

3. Traffic Simulation

4. Virtual Museum

5. Crowd Simulation and Evacuation Simulation

6. Online class room in client server network

7. Military simulations, combat situation, battlefield simulations

8. Airport Simulation

---