Description: Volumetric 3D data is fast becoming the gold standard in 3D interactive entertainment. Advances in Volumetric capture technology have enabled entirely new digital experiences that include Sport Replay, Music Videos, Gaming and Advertising. Yet despite the technological advances in 3D content creation, the most common way to view 3D is still on a 2D screen. VR and AR has partially addressed this shortcoming, but the need to wear goggles or headgear creates a barrier between the user and the 3D experience. Voxon is seeking to remove that barrier, and in doing so is enabling human-centric 3D digital experiences that can be viewed from any direction with the naked eye. Using a unique volumetric rendering technology the Voxon display can bringing 3D digital assets into the physical world, and in doing so, enable a new type of shared visual experience. To make this display technology a reality Voxon had to develop the world’s fastest real-time light engine, which is capable of rendering over 3 Billion points of light per second. Ben Weatherall, Voxon’s Unity Lead Programmer will talk about Voxon’s core technology, how to create content, and some of the unique aspects of volumetric imagery that set it apart from other types of media. He will also discuss important areas for future research in the volumetric display space.

Description: The Oculus Space Sharing Demo “Together from Wherever” allows two users to interact in VR inside a photo-realistic re-creation of a real environment. Real world places (such as your living room) have meaning and lead to a greater sense of presence. With this demo, we can glimpse a future where it should be possible to experience that profound sense of presence with someone important in your life in virtual reality irrespective of physical distance. Contributors: John Abad, Matthew Banks, Justin Blosch, Anders Bond, Milton Cadogan, Christopher Dotson, Francesco Georg, Simon Green, Shiva Halan, Heath Liles, James Lin, Steven Lovegrove, Jeffrey Mancebo, Alessia Mara, Christopher Ocampo, Luis Pesqueira, Vyacheslav Rakityanskey, Sarthak Ray, Thomas Rubalcava, Ryan Rutherford, Christina Tanouye, Andrew Welch, Benjamin Wulfe, Mingfei Yan, Stefano Zanetti Facebook

Description: Pushing mobile computing to bold new limits that were not possible as recently as March this year, we have designed an end-to-end pipeline for reconstruction, compression and streaming that generates 3D assets for a mixed reality opera experience rendered in real time on high end mobile phones.

Description: Come to the Table! employs an extended reality interface, centred around a domestic kitchen table, as a first step towards overcoming racial tensions by inviting indigenous Māori, people from migrant backgrounds and all others to join viewers, thereby fostering intercultural relationship building.

Description: What if we can make sound with physical objects using supernatural powers? We propose a multiparticipant audiovisual art experience using XR. In the experience, participants can fire virtual bullets or virtual beams at physical objects which then create a sound and a corresponding virtual visual effect.

Description: In this exhibition, we demonstrate the mapping method between facial expressions and wearable robot arm commands in virtual reality environment. By acquiring reflection intensity information with a number of optical sensors embedded in head-mounted display and training a machine learning system, our system is able to recognize intermediate facial expressions.

Description: FreeMo gets rid of interaction area and pre-defined workspace limitations for both desktop and VR hand tracking all in a single device. Both users and developers can now enjoy drastically improved interaction freedom as demonstrated by our featured games, thus getting us closer to the full potential of hand tracking.

Description: Redirected interaction enables many virtual buttons to be mapped to one physical button. This paper addresses some limitations with redirected interaction through application of head gaze to enable users to determine the interaction sequence and a new physical-virtual mapping using multiple physical targets to remove the required reset button.

Description: HyperDrum, which is about leveraging this cognitive synchronization to create a collaborative music production experience with immersive visualization in virtual reality. Participants will wear an electroencephalography (EEG) head-mounted display to create music and VR space together using a physical drum.

Description: We introduce a short virtual reality experience highlighting a use-case scenario of distance relocation technique in Redirected Jumping to reduce the size requirements for tracked working space of spatial applications. In our demo, the player traverses a virtual factory by jumping between moving platforms with jump distance scaled by gain.

Description: We propose a new compact projector-camera system (ProCam) composed of off-the-self devices that achieves dynamic facial projection mapping. A mini projector and a depth sensor camera are coupled together to project dynamic content such as makeup on a user's face. Our technology is eye safe and requires no initialization step.

Description: We propose a light-weight 6DoF video production pipeline using only one stereo camera as input. The subject can move freely in any direction (lateral and depth) as the camera follows to keep the subject within the frame. The processing runs in real time to provide 6DoF live viewing experience.

Description: Lost City of Mer is a virtual reality experience combined with a smartphone app that immerses players in a fantasy undersea civilization devastated by ecological disaster caused by global warming. Harnessing the empathetic potential of VR players are given agency regarding their personal carbon footprint in combating climate change.

Description: M-Hair is a novel method for providing tactile feedback by stimulating only body hair. By applying passive magnetic materials to the body hair, these become responsive to external magnetic forces/fields, creating a new opportunity for interactions, such as enriching media experiences and evoking emotional responses through this subtle stimulation.

Description: "PhantomTouch" is a wearable forearm augmentation that enables the recreation of natural touch sensation by applying shear forces onto the skin using a matrix of Shape Memory Alloy based plasters.

Description: This study is one of the physical e-sports that improves through physical training. xR without HMD. It is a combat shooting in which guns and bow-shaped devices are mixed. It requires the same sense of operation and physical ability as the real thing, and realizes e-sports more like conventional sports.

Description: We present Pumping Life, a dynamic flow system for enhancing the virtual companion with multisensory feedback, which utilizes water pumps and heater to provide shape deformation and thermal feedback. To show the interactive gameplay with our system, we deploy the system into a teddy bear in a VR game.

Description: We present SceneCam, a prototype with which we use AR to explore different techniques for improving the usability of multi-camera remote collaboration by making optimal camera selection easier and faster.

Description: We developed a riding simulation system for immersive virtual reality. Our system mainly consists of a wheelchair for vibration and vestibular sensation, and a pedestal with a curve-shape surface for the wheelchair running on. It is low cost and simple in mechanism.

Description: The player will take on the role of an overweight superhero trying to save the day. In order to do so, the player who is wearing a tracked fat-suit has to use his belly in order to prevent a bank robbing.

Description: A TouchVR haptic interface provides cutaneous feedback on the palm by DeltaTouch haptic display and vibrotactile feedback on the fingertips by vibration motors. The developed haptic interface can potentially bring a new level of immersion of the user in VR and make it more interactive and tangible.

Description: Imagine that upload process can see a virtual object in real space. When you see the virtual object and feel the influence (wind and vibration), after passing through the upwardly extending tunnel, the screen enters the completely virtual space, but you don't know whether the upload is completed.

Description: This virtual reality story lets the viewers experience the narrative from different perspectives of different characters. The story revolves around a family dispute between a couple who has an unfortunate son who can do little to stop his father leaving the house but tries his best.