CCF Organ VR Gallery

Overview

The CCF Organ VR Gallery is an immersive application that allows users to view, explore, and analyze 3D reference organs, anatomical structures, and cell types, in an integrated virtual reality (VR) environment[1], see Figure 1.

Image showing user interaction with data visualization in the VR Organ Gallery

Figure 1. Three stages. Top left: the whole body is visible. Top right: a gallery of individual organs. Bottom left and center: A user explodes an organ into individual anatomical structures. Bottom right: a user explores cells around a kidney in a virtual box.

Background The Human Reference Atlas (HRA), developed by the Human Biomolecular Atlas Program (HuBMAP)[2] in close collaboration with 17 international consortia, aims to create a spatial reference of the healthy adult human body at single-cell resolution. Anatomical Structures and Cell Types plus Biomarkers (ASCT+B) tables are compiled by experts to detail the cell types typically found in structures in human organs [3]. As of April 2022, there exist 50 3D reference organs [4], modeled after the Visible Human Project data [5], that can be used to register human tissue into a common coordinate framework (CCF) across diverse individual donors spanning different age ranges, sexes, and BMIs. The resulting spatial, specimen, and biological structure data define the HRA.

Why VR? If viewed in desktop applications, the spatiality and dimensionality of the 3D reference organs is lost while viewing the biological structure and specimen data is easily possible via information visualization. However, virtual reality (VR) provides a unique method of visualizing and interacting with these diverse types of data in a unified environment. In addition, if viewed in VR, the spatiality of the organs is preserved and empowered through immersion, see Figure 2. The CCF Organ VR Gallery also builds on and implements Bowman et al.'s concept of Information-Rich Virtual Environments (IRVEs)[2].

Image showing a 3D model of a heart in the VR Organ Gallery

Figure 2. 3D heart model in the CCF Organ VR Gallery.

Data Visualizations (planned) The CCF Organ VR Gallery will feature interactive stacked bar graphs, which users will be able to use to view tissue blocks in their spatial and anatomical context, select cell types across anatomical structures, and get cell type distributions, see Figure 3. Techniques such as brush-and-linking, highlighting, and hovering will be implemented for VR controllers to allow users to interact with the data. The CCF Organ VR Gallery presents a tested implementation of classic 2D visualizations within a 3D virtual environment, ultimately enriching the analysis experience with presence and immersion while preserving the spatiality of biological data.

Image showing an example of a bar graph in the VR Organ Gallery

Figure 3. Example of a data visualization, specifically a bar graph comparing skin tissue blocks, that is displayed in the Organ VR gallery. This series of bar graphs showing cell type counts for tissue blocks of the human body can be explored at https://hubmapconsortium.github.io/tissue-bar-graphs/.

User Testing and Feedback

The CCF Organ VR Gallery application is not yet available for public download. However, if you would like to experience the gallery for yourself, please email abueckle@iu.edu. For more information and guidance on getting started with the application, click here to view the documentation. After using the app, please take a couple of minutes to complete this brief feedback form. We will take your feedback into consideration when improving and iterating on the app.

Video Demo

Please view the video below for a demo of the CCF Organ VR Gallery.

References