AR/VR Visualization of Data

Members: Alexander Kim, Amanda Lau, Catzby Paul, Samhitha Sangaraju, Vir Vaidya, David Zhao

Faculty advisors: Wade Trappe, Jennifer Shane, Ivan Seskar

PROJECT OVERVIEW

Protein Visualization

Visualizing the structures from the Research Collaboratory for Structural Bioinformatics Protein Data Bank (RCSB PDB) in AR/VR using Unity

Ocean Graphic Data

Visualizing sensor data from the Rutgers-deployed Slocum glider using the Meta Quest 3 and Unity

PROGRESS LOG

Week 1 (5/28 - 5/30)

• Installed and familiarized ourselves with the Unity Engine
• Successfully connected the Hololens to the Unity engine and created a simple test program

Week 2 (6/03 - 6/06)

• Created sample AR apps that are compatible with both IOS and Android devices
• Finalized two datasets which we will be working on data visualization for.
  • Protein Folding Data: ​https://www.rcsb.org/
  • Ocean and atmospheric data: ​https://rucool.marine.rutgers.edu/integrated-ocean-technology/ocean-radar/
• Wrote scripts to facilitate resizing and rotation of objects in preparation for interacting with proteins and other target objects
• Migrated our progress to the new computers

Week 3 (6/10 - 6/13)

General

• Developed scripts for comprehensive manipulation of game objects for the Meta Quest 3, including movement (grab and hold), rotation, and resizing, to allow users to better interact with areas of interest

RCSB PDB

• Successfully visualized proteins through PyMol and imported models into Unity
• Began work on direct conversion of PDB files into Unity without use of external program

RUCOOL

• Wrote a Python script to access, search, download, and preprocess relevant datasets from Rutgers' ERDDAP database
• Successfully imported and visualized these datasets in Unity with human assistance

Week 4 (6/17 - 6/20)

RCSB PDB

• Visualized and refined assets of proteins in Unity, streamlining code and procedures

RUCOOL

• Automated the process of downloading, cleaning, and visualizing glider data by pulling directly from ERDDAP into Unity
• Added navigational functionality and toggle to accommodate for multiple variables of interest

Week 5 (6/24 - 6/27)

RCSB PDB

• Optimized protein generation to improve performance
• Implemented voice commands for viewing options
  • Toggle different structures
  • Isolate specific elements
  • Rescale the protein
  • Summon the protein in front of user

RUCOOL

• Connected plot points by interpolating color
• Implemented a basic GUI with a minimap and a variable readout
  • Began implementation of gauge to go along with variable readout
• Added a toggle to "follow" the path of the glider