Scene reconstruction explorations

Tools:

Swift

Interfaces:

Apple Vision Pro

Areas:

Spatial computing

Spring 2024

Stanford, California USA

Spatial computing devices collect and make available to developers real-time data regarding the user's physical surroundings. Both generating a 3D mesh of the user's immediate environment and detecting various surfaces in it e.g., floors, tables, walls, and ceilings, this offers the potential to create highly interactive, immersive experiences that build on these environmental cues. These mini projects explore several ways such data can be used to create novel user experiences. In each case, the type of scene reconstruction data collected, and how it is used in the interface, must be matched carefully and thoughtfully to the design concept and desired user experience.