Interactive Application

Design & Development

The utilization of digital technologies, including digital applications and extended reality, has demonstrated a transformative impact on scientific and medical education in the modern era. In this section, I will present several interactive visual projects that I have either independently undertaken or participated in. These projects were developed using the Unity game engine for programming, Autodesk 3dsMax for 3D asset creation, and Adobe Illustrator for 2D asset creation.

Digital Application - Uncovering COPD

This standalone application is designed to educate patients about Chronic Obstructive Pulmonary Disease (COPD), a chronic lung condition characterized by obstructed airflow. Through the utilization of a combination of 2D and 3D visual elements, the application vividly demonstrates the symptoms, anatomical changes, and risk factors associated with COPD. In this collaborative project, I made significant contributions by identifying learning objectives, crafting prototypes aligned with educational goals, programming essential modules such as 'Home,' 'Symptoms,' 'Airway Structure,' and 'Anatomical Changes,' and designing various UI elements.

Software: Unity, Adobe Illustrator
Group assignment for BVIS 536 - Interactive Visualization
Team members: Jer Weann Ang, Regan Falin, Siwen Wang

mini Augmented Reality - Meatlas

This mini Augmented Reality project was inspired by my experience while browsing the meat section at a grocery store. I found myself distracted by the variety of meat from different parts and felt confused about what to purchase for certain types of dishes. As a solution, I developed an AR prototype that enables users to scan and recognize specific information from meat labels. This functionality allows users to obtain further details about the meat cut along with corresponding recipe suggestions.

Software: Unity, Adobe Illustrator
Individual assignment for BVIS 537 - Immersive Interactive Visualization

Virtual Reality - PCR Lab

The Polymerase Chain Reaction (PCR) is a commonly used biological laboratory technique for amplifying a specific segment of DNA into billions of copies, enabling detailed study. This Virtual Reality project aims to demonstrate the application of PCR reactions and provide hands-on experience in preparing PCR reactions and analyzing PCR electrophoresis results. Recognizing the target audience as undergraduate students new to molecular biology, I have proposed an immersive forensic scenario to enhance engagement, allowing learners to actively participate in simulated criminal investigations. This project is a collaborative effort, with my responsibilities including instructional design, virtual environment design and development, and 3D asset creation.

Software: Unity, Autodesk 3dsMax, Adobe Illustrator
Group assignment for BVIS 537 - Immersive Interactive Visualization
Team members: Jer Weann Ang, Ben Colvin, Michelle Sheena, Siwen Wang

  • Virtual Environment

To captivate the participants, I chose a futuristic sci-fi theme for our instructional approach, especially within the context of a criminal investigation scene. As a result, I incorporated numerous high-tech and futuristic elements throughout the environment to enhance the experience.

SS5.png
SS2.png
SS3.png
SS1.png
SS4.png

  • Tutorial Scene

At the start of the game, a tutorial scene is presented to guide users on utilizing a VR controller to operate virtual pipettes. This tutorial includes an overview of the pipette, instructions for adjusting pipetting volume, techniques for withdrawing solutions, and demonstrations on changing pipette tips.

Programming: Ben Colvin, Michelle Sheena; UI design: Jer Weann Ang

  • Main Game

As a forensic investigator, the player is presented with a crime scenario and tasked with comparing the DNA of two suspects to that found at the crime scene. This objective can be accomplished through conducting a PCR reaction, which is instrumental in identifying discrepancies in DNA fingerprints between individuals.

Within the main gameplay, players are equipped with all requisite PCR reagents and granted the freedom to explore each element by interacting with individual reagent tubes. By interacting with these tubes, they can engage with animated demonstrations elucidating the function of each component, while also accessing detailed instructions displayed on-screen. Following these instructions, players can proceed to set up a PCR reaction, starting from the preparation of a master mix to the addition of DNA samples. Subsequently, they will run a PCR cycle in the thermocycler and perform electrophoresis on agarose gel. Ultimately, players will analyze the results to determine whether either suspect's DNA matches that recovered from the crime scene.

Programming: Ben Colvin, Michelle Sheena; UI design: Jer Weann Ang

mini Virtual Reality - An Interactive Virtual Room

In an effort to apply the diverse VR functionalities acquired in the Immersive Interactive Visualization class, I have recreated my workspace within a virtual environment. This project entails crafting 3D assets and programming various VR functionalities. Within this virtual environment, users can freely explore and interact with items such as a desk lamp, tablets, a drawing pen, books on shelves, and even the door.

Software: Unity, Autodesk 3dsMax
Individual assignment for BVIS 537 - Immersive Interactive Visualization