COSC
477/590: Virtual Reality and its Principles
Topics
Covered
All the
lecture slides are at blackboard
1)
Lecture 1: INTRODUCTION
-
-
The Three I's of Virtual Reality
-
A Short History of Early Virtual Reality
-
Augmented Reality & Telepresence
-
Early Commercial VR Technology
-
PowerGlove, Data glove, Mattel Power Glove, HMD
-
-
The Five Classic Components of a VR System
2) Lecture 2: INPUT DEVICES:
TRACKERS, NAVIGATION, AND GESTURE INTERFACES
-
Degrees of freedom, Tracker characteristics
-
Three-Dimensional Position Trackers
-
Tracker Performance Parameters
-
-
-
-
-
-
Navigation and Manipulation Interfaces
-
Tracker-Based Navigation/Manipulation Interfaces
-
-
-
3)Lecture 3: OUTPUT DEVICES:
GRAPHICS DISPLAYS
- Graphics Displays
- The Human Visual System
- Personal Graphics Displays
- Personal Displays
- Head Mounted Displays
- 3-D Binoculars (hand supported)
- Booms (floor supported)
- Virtual windows (floor supported)
- Auto-stereoscopic displays (desk supported)
- Large-Volume Displays
- Active glasses vs. FMDs
- Passive glasses vs. active glasses
- Tiled monitors-based display
- Projector-based Large-Volume Displays
- RAVE
- Wall-type displays
- Pano-Wall display
- Portable Wall display
- Wall and Dome-type displays
4)Lecture 4: OUTPUT DEVICES:
THREE-DIMENSIONAL SOUND AND HAPTIC DISPLAYS
-
Sound Displays
- The Human Auditory System
- 3-D audio vs stereo sound
- Human hearing model
- HRTF-based 3-D sound
- 3-D sound cards
- Speaker-Based Three-Dimensional Sound
- Haptic Feedback
- The Human Haptic System
- Tactile Feedback Interfaces
- Force Feedback Interfaces
- Haptic Interfaces
- Human touch sensing mechanism
- Sensorial adaptation
- Haptic feedback actuators
- Touch Feedback Interfaces
- Temperature feedback
5)Lecture 5: MODELING PRINCIPLES
OF VIRTUAL REALITY
- Geometric Modeling
- Virtual Object Shape
- Object Visual Appearance
- Kinematics Modeling
- Homogeneous Transformation Matrices
- Object Position
- Transformation Invariants
- Object Hierarchies
- Viewing the Three-Dimensional World
- Physical Modeling
- Collision Detection
- Surface Deformation
- Force Computation
- Force Smoothing and Mapping
- Haptic Texturing
- Behavior Modeling
- Interactive objects
- Agent behavior
- Reflex behavior
- Object behavior
- Emotional behavior
- Crowds behavior
- Model Management
- Level-of-Detail Management
- Cell Segmentation
6)Lecture 6: COMPUTER GRAPHICS
PRINCIPLES OF VIRTUAL REALITY
- -- Raster Scan Devices
- CRT Output Devices
- Raster Scan Device
- Bitmap and Bitplanes
- Antialiasing
- Fill Area
- -- Color
- The RGB Color Model
- Location of Selected Colors
- Color Selectors
- Selected Planes in RGB Cube
- Color Interpolation
- Hardware Presentation
- -- 3D Viewing
- Projection Systems
- Perspective Projection
Parallel Projection
- View Plane and View Volume
- 3D Viewing System
- Hidden Surface Removal
- Culling: Back-Face Removal
- Viewing Pipeline
- -- Illumination and Shading
- Illumination and Shading - Principles
- Light Sources
- Reflection Models
- VRML Reflection Models
- Shading Algorithms
- Surface Normals
- Texture Mapping
- Texture Samples
7)Lecture 7: VR PROGRAMMING
And Python Programming
- Introduction
- A VRML File & Python script
- RGB Color System
- File Components
- Coordinate System
- Looping logic
- If-then logic
- Functions
- Transform
- Viewpoints
- Scripting
- Examples: Snowman, etc.
8)Lecture 8: VIZARD
- Vizard - Introduction, GUI.
- 3D models
- Hierarchical models and coordinate systems
- Text nodes
- Flow control
- Tutorial: Action objects
- Tutorial: Tasks
- Avatars
- Tutorial: Animating bones
- Attaching a new head
- Animating avatars
- Appearnace amd texturing
- Applying Textures
- Multi-texturing
- Environmental mapping
- 360 panoramas
- Physics engine
- Physics
- Tutorial: Forces & material properties
- Tutorial: Callbacks & complex shapes
- Proximity sensor
- Multimendia
- Viewpoint and windows
- Tutorial: Windows & views
- Tutorial: Viewpoint collision
- Tutorial: Viewpoint control
- Picking objects off the screen
- Networking
8)Lecture 9: HUMAN FACTORS IN
VR
- Human factors vocabulary
- HF study,Experimental protocol, Trial,Session,Rest period, Experimental database,IRB, PI, Subject,Experimental group,Control group,controlled study,Case study, Consent form,Baseline test
- Stages of human factors studies
- Human Factor Areas
- Human Performance Efficiency
- Health and Safety
- Societal Implications
- Methodology and Terminology
- Data Collection and Analysis
- Usability Engineering Methodology
- User Performance Studies
- Testbed Evaluation of Universal VR Tasks
- Influence of System Responsiveness on User Performance
- Influence of Feedback Multimodality
- VR Health and Safety Issues
- Direct Effects of VR Simulations on Users
- Cybersickness
- Adaptation and Aftereffects
- Guidelines for Proper VR Usage
- VR and Society
- Impact on Professional Life
- Impact on Private Life
- Impact on Public Life
- Conclusion
9)Lecture 10: TRADITIONAL VR
APPLICATIONS
- Medical Applications of VR
- Virtual Anatomy
- Triage and Diagnostic
- Surgery
- Rehabilitation
- Education, Arts, and Entertainment
- VR in Education
- VR and the Arts
- Entertainment Applications of VR
- Military VR Applications
- Army Use of VR
- VR Applications in the Navy
- Air Force Use of VR
- Conclusion
10)Lecture 11: EMERGING APPLICATIONS
OF VR
- VR Applications in Manufacturing
- Virtual Prototyping
- Other VR Applications in Manufacturing
- Applications of VR in Robotics
- Robot Programming
- Robot Teleoperation
- Information Visualization
- Oil Exploration and Well Management
- Volumetric Data Visualization
- Conclusion
10)Lecture 12: 3D Interaction Techiniques: selection, travel
- Introduction
- 3D Manipulation Tasks
- Canonical Manipulation Tasks
- Application-Specific Manipulation Tasks
- Manipulation Techniques and Input Devices
- Control Dimensions and Integrated Control in 3D Manipulation
- Force versus Position Control
- Device Placement and Form-Factor in 3D Manipulation
- Interaction Techniques for 3D Manipulation
- Classifications of Manipulation Techniques
- Interacting by Pointing
- Direct Manipulation: Virtual Hand Techniques
- World-in-Miniature
- Combining Techniques
- Nonisomorphic 3D Rotation
- Desktop 3D Manipulation
- Travel
- Introduction
- 3D Travel Tasks
- Exploration
- Search
- Maneuvering
- Additional Travel Task Characteristics
- Travel Techniques
- Technique Classifications
- Physical Locomotion Techniques
- Steering Techniques
- Route-Planning Techniques
- Target-Based Techniques
- Manual Manipulation Techniques
- Travel-by-Scaling Techniques
- Viewpoint Orientation Techniques
- Velocity Specification Techniques
- Integrated Camera Controls for Desktop 3D Environments
11)Lecture 13: 3D Interaction Techiniques: wayfinding
- Theoretical Foundations
- Wayfinding Tasks
- Types of Spatial Knowledge
- Egocentric and Exocentric Reference Frames
- User-Centered Wayfinding Support
- Field of View
- Motion Cues
- Multisensory Output
- Presence
- Search Strategies
- Environment-Centered Wayfinding Support
- Environment Design
- Artificial Cues
- Evaluating Wayfinding Aids