[CURATED] An Integrated 6DoF Video Camera and System Design

Speaker(s):

Description: Designing a fully integrated 360◦ video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our demo is the first to show a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering.

360Drops: Mixed Reality Remote Collaboration using 360 Panorama in 3D Scene

Speaker(s): Theophilus Teo, University of South Australia, Australia
Gun A. Lee, University of South Australia, Australia
Mark Billinghurst, University of South Australia, Australia
Matt Adcock, CSIRO's Data61, Australia

Theophilus Teo is a Ph.D. candidate with particular interests in Augmented Reality safety and awareness and remote collaboration. Before he commenced his Ph.D study, he graduated with a first-class Honours from Bachelor of Software Engineering in University of South Australia. On year 2016, he participated in an ICT (Information and Communications Technology) project titled “VR for Big Data analytics” sponsored by CSIRO. Currently, he is doing his research degree under the supervision of Prof. Mark Billinghurst and Dr. Gun Lee in Empathic Computing Lab at University of South Australia.

Dr. Gun Lee is a Senior Research Fellow at the University of South Australia (UniSA) investigating interaction and visualization methods for sharing virtual experiences in Augmented Reality (AR), Mixed Reality (MR), and immersive 3D environments. Recently, using AR and wearable interfaces to improve remote collaborative experience has been one of his main research themes. Extending this research into sharing richer communication cues and scaling up to a larger group of participants are the next steps he is working on.

Mark Billinghurst is Professor of Human Computer Interaction at the University of South Australia in Adelaide, Australia. He earned a PhD in 2002 from the University of Washington and researches innovative computer interfaces that explore how virtual and real worlds can be merged, publishing over 300 papers in topics such as wearable computing, Augmented Reality and mobile interfaces. He was Director of the HIT Lab NZ at the University of Canterbury and he has previously worked at British Telecom, Nokia, Google and the MIT Media Laboratory.

Dr Matt Adcock is a Research Engineer, Experimental Scientist and Director of the CSIRO Data61 Immersive Environments Lab. He uses Interactive Computer Graphics, Computational Imaging and User Experience Innovation to build systems that enable new connections between the digital and physical worlds. Dr Adcock has published over 50 research papers and holds degrees from the Australian National University (ANU), the University of South Australia (UniSA) and the Massachusetts Institute of Technology (MIT). He is also an adjunct researcher at ANU.

Description: Mixed Reality Remote Collaboration that enables a remote user to create multiple 360 panoramas in a 3D scene that can be accessed and interacted in different ways to communicate with a local user. This research is intended to investigate enchantment in terms of performance and technique for remote collaboration.

AlteredWind: Manipulating Perceived Direction of the Wind by Cross-Modal presentation of Visual, Audio and Wind Stimuli

Speaker(s): Kenichi Ito, The University of Tokyo, Japan
Yuki Ban, The University of Tokyo, Japan
Shin'ichi Warisawa, The University of Tokyo, Japan

Kenichi Ito received his bachelor of engineering degree from the Faculty of Engineering, the University of Tokyo in 2019. He is a master course student of the Graduate School of Frontier Sciences, the University of Tokyo now. His research interest is improving presence and immersion of virtual reality by presenting the feelings of wind.

Yuki Ban received the M.S. degree and the Ph.D. degree in Information Science and Technology from the University of Tokyo, Tokyo, Japan, in 2013 and 2016, respectively. He was a researcher at Xcoo inc. research from 2016 to 2017. He is currently an Assistant Professor of Graduate School of Frontier Sciences at the University of Tokyo. His current research interests focus on modifying spatial perception using the visuo-haptic interaction.

Prof. Warisawa is a professor of Department of Human and Engineered Environmental Studies at the University of Tokyo. From April of 1994 to March of 2000, he served as an Assistant Professor of Tokyo Institute of Technology, from April of 2000 has been working at the University of Tokyo. He was a visiting researcher at Massachusetts Institute of Technology from 2010 to 2011, and a visiting professor at Université Jean Monnet in 2016. His current research focuses on wearable/ambient human health monitoring. Research cores are nano/micro sensing devices fabrication and sensing information technology application for human well-being.

Description: We developed AlteredWind, a multisensory wind display system that manipulates users' perception of wind by the integration of visual, audio, and wind stimuli. AlteredWind present images of flowing particles and three-dimensional (3D) sounds of wind together with the wind to induce the visuo-haptic and audio-haptic cross-modal effect.

Biofeedback Interactive VR System Using Biological Information Measurement HMD

Speaker(s): Masahiro Inazawa, The University of Tokyo, Japan
Xianyin Hu, The University of Tokyo, Japan
Yuki Ban, The University of Tokyo, Japan

Masahiro Inazawa received the M.S. degree in Human environment from the University of Tokyo, Tokyo, Japan, in 2017. His current research interests focus on stress sensing and biological information sensing during virtual reality.

Xianyin Hu received her bachelor degree of computer science in digital media technology from Hunan University, China in 2017. Her undergraduate research with Dr. Gao focused on applications of deep learning in graphics. After graduation, She spent 1 year in University of Tokyo as a research student. She is currently a student in the Graduate School of Frontier Sciences at the University of Tokyo. Her current research interests focus on biological signals processing.

Yuki Ban received the M.S. degree and the Ph.D. degree in Information Science and Technology from the University of Tokyo, Tokyo, Japan, in 2013 and 2016, respectively. He was a researcher at Xcoo inc. research from 2016 to 2017. He is currently an Assistant Professor of Graduate School of Frontier Sciences at the University of Tokyo. His current research interests focus on modifying spatial perception using the visuo-haptic interaction.

Description: We proposed biofeedback interactive VR system. In this system, VR experiences are interactively changed according to user's biological information or emotion estimated by it. To realize this system, we developed the respiration and pulse wave measurement device that can be easily attached to various HMDs.

Brobdingnagian Glass: A Micro-Stereoscopic Telexistence System

Speaker(s): Ryo Ito, The University of Tokyo, Japan
Leo Miyashita, The University of Tokyo, Japan
Masatoshi Ishikawa, The University of Tokyo, Japan

Master course student at the Department of Creative Informatics, Graduate School of Information Science and Technology, University of Tokyo. Research themes include the extension of VR/AR interaction with high-speed vision.

Project assistant professor at the Department of Information Physics and Computing Graduate School of Information Science and Technology, The University of Tokyo. Member of ACM/SIGGRAPH. Research themes include high-speed sensors and high-speed displays.

Masatoshi Ishikawa received the B.E., M.E., and Dr. Eng. degrees in mathematical engineering and information physics from the University of Tokyo, Japan, in 1977, 1979, and 1988, respectively. 　After he worked at Industrial Products Research Institute, Tsukuba, Japan, he moved to the University of Tokyo in 1989. He was a vice-president and an executive vice-president of University of Tokyo, from 2004 to 2005, and from 2005 to 2006, respectively. Now he is a professor of information physics and computing and the dean of graduate school of information science and technology at the University of Tokyo.

Description: We propose a system that realizes the binocular perspective of a miniature human using a vibrating hemispherical mirror and a camera in order to remove the lower limit of realizable scale. We reproduced the binocular stereovision at 1.72 mm as the interpupillary distance, about a 1/38 scale of human.

Co-Limbs: An Intuitive Collaborative Control for Wearable Robotic Arms

Speaker(s): Guillaume GOURMELEN, CNRS/LIRMM; Laboratoire d’Informatique, de Robotique et deMicroelectronique de Montpellier (LIRMM), France
Adrien Verhulst, The University of Tokyo, Japan
Benjamin Navarro, CNRS/LIRMM, France
Tomoya Sasaki, The University of Tokyo, Japan
Gowrishankar Ganesh, CNRS/LIRMM, France
Masahiko Inami, The University of Tokyo, Japan

Guillaume Gourmelen graduated as an Engineer in France in Electronics, Automatics and Robotics. He is currently a 2nd year PhD student in France, Montpellier, LIRMM, funded by Japan’s ERATO (JST) project. His thesis is about working on robotics, co-botics and Embodiements on Robots in order to achieve Embodied Teleoperation and Learning from Human to Robot.

Adrien Verhulst is a researcher currently working on human augmentation in Virtual Reality at The University of Tokyo, Japan. He obtained a Software engineering at Polytech Angers, France, in 2014, and a PhD in Computer Science at Ecole Centrale de Nantes, France, in 2018. His work interest focuses on human interaction and simulation in Virtual Reality as well as visualization in Computer Graphics.

Benjamin Navarro received a Ph.D. in robotics in 2017 and is now a research engineer in the IDH group at LIRMM. He is working mainly on safe human-robot collaborations and open-source software for robotics.

He is a doctoral student in Research Center for Advanced Science and Technology, the University of Tokyo, Japan. He completed his Master’s Degree in Media Design from Keio University Graduate School of Media Design, Japan. His research interests include Robotics, Haptics, Wearable Technologies, and Virtual Reality. His current works focus on augmentation of human abilities by using cybernetic technologies such as additional limbs or a levitated stick.

Gowrishankar Ganesh received his Bachelor degree from the Delhi College of Engineering, India and his Master degree from the National University of Singapore, both in Mechanical Engineering. He received his Ph.D. in Bioengineering from Imperial College London in 2010. He is currently a Senior Researcher at the Centre National de la Recherché Scientifique (CNRS), and is located at the Laboratoire d'Informatique, de Robotique et de Microélectronique de Montpellier (LIRMM). He is a visiting researcher at the University of Tokyo, AIST in Tsukuba, and ATR in Kyoto. His research interests include robot control, human sensori-motor control/learning, cognitive neuroscience and robot-human interactions.

Masahiko (Masa) Inami is a Professor in the Research Center for Advanced Science and Technology at the University of Tokyo, Japan. He is also directing Inami JIZAI Body Project, JST ERATO. His research interests are in Augmented Human, human I/O enhancement technologies including perception, HCI and robotics. He joined the Faculty of Engineering of the University of Tokyo, and in 1999, he moved to the University of Electro-Communications. In April 2008, he joined Keio University, where he served as a Professor of the Graduate School of Media Design till October 2015. In November 2015, he rejoined the University of Tokyo.

Description: ’Co-limbs’ user interface for wearable robot arms.

Demonstration of ThermAirGlove: A Pneumatic Glove for Material Perception in Virtual Reality through Thermal and Force Feedback

Speaker(s): Shaoyu Cai, City University of Hong Kong, Hong Kong
Pingchuan Ke, City University of Hong Kong, Hong Kong
Shanshan Jiang, City University of Hong Kong, Hong Kong
Takuji Narumi, University of Tokyo, Japan
Kening Zhu, City University of Hong Kong, Hong Kong

Shaoyu CAI is a PhD student at City University of Hong Kong, School of Creative Media. His research is focusing on Robotics, Virtual Reality(VR) and Human-Computer Interaction(HCI).

Pingchuan Ke is a research assistant at City University of Hong Kong, School of Creative Media. His research interests is Human-Computer Interaction(HCI) and Design.

Shanshan Jiang is a research assistant at City University of Hong Kong, School of Creative Media. His research interests is Human-Computer Interaction(HCI).

Dr. Takuji Narumi is an associate professor at the Graduate School of Information Science and Technology, the University of Tokyo. His research interests broadly include perceptual modification and human augmentation with virtual reality and augmented reality technologies.

Kening Zhu is an assistant professor in School of Creative Media, City Unversity of Hong Kong.His research interest lies in the field of Human-Computer Interaction (HCI). He is now particularly working on mobile gesture interaction, tangible interfaces (for STEM & Coding education), multimodal VR/AR, digital fabrication with smart materials.

Description: We demonstrate ThermAirGlove(TAGlove), a pneumatic glove which provides concurrent on-hand thermal and force feedback by controlling the volume and temperature of the air pumped into airbags embedded in the glove. TAGlove could generate the thermal cues of different materials (e.g., copper, glass, urethane), and support users’ material identification in VR.

Enhancing Suspension Activities in Virtual Reality with Body-Scale Kinesthetic Force Feedbacks

Speaker(s): Yuan-Syun Ye, National Chiao Tung University, Institute of Multimedia Engineering, Taiwan
Hsin-Yu Chen, National Chiao Tung University, Taiwan
Liwei Chan, National Chiao Tung University, Taiwan

Yuan-Syun Ye is a graduate student at National Chiao Tung University Institute of Multimedia Engineering Multimedia Engineering Institute in Taiwan. His research field is on Human-Computer Interaction and his research topic is to design haptic feedback sport for virtual reality.

Hsin-Yu Chen is a graduate student at National Chiao Tung University Institute of Multimedia Engineering Multimedia Engineering Institute in Taiwan. His research field is on Human-Computer Interaction and his research topic is to design haptic feedback sport for virtual reality.

Liwei Chan is an Assistant Professor of National Chiao Tung University in Taiwan. After receiving his Ph.D. from National Taiwan University, he had been an Assistant Professor in Keio Media Design, Keio University. His main research area is Human-Computer Interaction.

Description: This work presents a suspension kit that can suggest a range of body postures and thus enables various exercise styles of users in virtual reality. Users immersed in an exercise experience perceive active kinesthetic force feedback produced by the kit via suspending their weight with arm exertion.

Hanger Drive: Driver Manipulation System for Self-balancingTransporter Using the Hanger Reflex Haptic Illusion

Speaker(s): Masato Kobayashi, The University of Electro-Communications, Japan
Yuki Kon, The University of Electro-Communications, Japan
Jianyao Zhang, The University of Electro-Communications, Japan
Hiroyuki Kajimoto, The University of Electro-Communications, Japan

Masato Kobayashi received the A.S. degree from National Institute of Technology, Ishikawa College, in 2016, and the B.S. degree in engineering from the University of Electro-Communications, in 2018. He is a graduate student at the University of Electro-Communications. His research interests include haptic interface, human computer interaction, locomotion interface and virtual reality.

Yuki Kon received the master's degree in engineering from the University of Electro-Communications, in 2018. He is a PhD student at the University of Electro-Communications in 2019. His research interests include haptic interface, human computer interaction, wearable device and virtual reality.

Zhang Jianyao received the Bachelor's degree in engineering from Lanzhou University, in 2018. He is a research student at the University of Electro-Communications. His research interests include haptic interface, human computer interaction, virtual reality and augmented reality.

Hiroyuki Kajimoto received a PhD in information science and technology from The University of Tokyo in 2006. He is currently a professor in the Department of Informatics at the University of Electro-Communications, Japan. His research interests are tactile displays, tactile sensors, human interface and virtual reality. He is a member of IEEE and ACM.

Description: Self-balancing transporter are becoming popular as medium-distance transportation means such as police patrols and sightseeing tours, and are expected to further gain prevalence. In this study, we control the driving direction of self-balancing transporter indirectly by controlling the motion of user who is riding the vehicles.

Hapballoon: Wearable Haptic Balloon-Based Feedback Device

Speaker(s): Masahiro Miyakami, The University of Electro-Communications, Japan
Karen. A. Murata, The University of Electro-Communications, Japan
Hiroyuki Kajimoto, The University of Electro-Communications, Japan

Masahiro Miyakami recieved the B.S. degree in engineering from the University of Electro-Communications, in 2018. He is a graduate student at the University of Electro-Communications. His research interests include haptic interface, human computer interaction, locomotion interface and virtual reality.

Karen Anastasia Murata recieved the B.S. degree in engineering from the University of Electro-Communications, in 2018. She is a graduate student at the University of Electro-Communications. Her research interests are haptic interface, human computer interaction and augmented reality.

Hiroyuki Kajimoto received a PhD in information science and technology from The University of Tokyo in 2006. He is currently a professor in the Department of Informatics at the University of Electro-Communications, Japan. His research interests are tactile displays, tactile sensors, human interface and virtual reality. He is a member of IEEE and ACM.

Description: The Hapballoon is a lightwearable device that can be used to present various haptic sensations. It is possible to present force feedback, especially with respect to pinching and gripping of objects, as well as temperature and vibration information to enhance the material feeling of the VR world.

Haptiple: A Wearable, Modular and Multiple Haptic Feedback System for Embodied Interaction

Speaker(s): Tomosuke Maeda, Toyota Central R&D Labs., Inc., Japan
Tetsuo Kurahashi, Toyota Central R&D Labs., Inc., Japan

Tomosuke Maeda is a researcher at Toyota Central R&D Labs., Inc, Human Science Research Domain, Sensory Integration Modeling Program. He received a Master of Media Design from Keio University in 2017. His current research interests focus on the wearable haptic device and embodied interactions. He received the Dean's list from Keio University of Master's Degree and Augmented Human 2019 3rd best paper award.

Dr. Tetsuo Kurahashi is a program manager at Toyota Central R&D Labs., Inc., Human Science Research Domain, Sensory Integration Modeling Program. He completed a Dr. Engineer at Nagoya University in 2009. He is interested in human behavior, perception and cognition and phycological response under natural environment.

Description: We propose a multiple haptic feedback system called Haptiple, which is a wearable and modular system for embodied interactions based on a wireless platform. The system consists of vibro-tactile, pressure, and thermal/wind that can be placed on multiple body parts such as the hand, wrist, ankle, and chest.

IlluminatedFocus: Vision Augmentation using Spatial Defocusing

Speaker(s): Tatsuyuki Ueda, Osaka University, Japan
Daisuke Iwai, Osaka University, Japan
Kosuke Sato, Osaka University, Japan

Tatsuyuki Ueda received the B.S. degree from Osaka University, Japan, in 2018. His research interests include spatial augmented reality and human-computer interaction. He is a student member of the ACM.

Daisuke Iwai received his B.S., M.S., and Ph.D. degrees from Osaka University, Japan, in 2003, 2005, and 2007, respectively. He was a visiting scientist at Bauhaus-University Weimar, Germany, from 2007 to 2008, and a visiting Associate Professor at ETH, Switzerland, in 2011. He is currently an Associate Professor at the Graduate School of Engineering Science, Osaka University. His research interests include spatial augmented reality and projector-camera systems. He is a member of the IEEE.

Kosuke Sato received his B.S., M.S., and Ph.D. degrees from Osaka University, Japan, in 1983, 1985, and 1988, respectively. He was a visiting scientist at the Robotics Institute, Carnegie Mellon University, from 1988 to 1990. He is currently a Professor at the Graduate School of Engineering Science, Osaka University. His research interests include image sensing, 3D image processing, digital archiving, and virtual reality. He is a member of ACM and IEEE.

Description: We propose IlluminatedFocus, AR glasses enabling depth-independent spatial defocusing of a human vision. We show a system that switches focused and defocused views independently in each area. We realize various vision augmentation applications based on our method to show its potential to expand the application field of optical see-through AR.

Inclination Manipulator : Pitch Redirected Walking using Haptic Cues

Speaker(s): Nariaki Sugamoto, The University of Electro-Communications, Japan
Yusuke Ujitoko, Hitachi, Ltd.; The University of Electro-Communications, Japan
Sho Sakurai, The University of Electro-Communications, Japan

Nariaki Sugamoto a graduate student at the University of Electro-Communications.

Yusuke Ujitoko is a researcher at Hitachi, Ltd., Japan and is also a Ph.D. student at the University of Electro-Communications from 2019. He received a B.E. degree in mechanical engineering and M.A.E. degree in inter-disciplinary information studies from the University of Tokyo, Japan, in 2014 and 2016. His research interests include applied haptic perception and haptic interfaces. He is a member of the IEEE.

Sho Sakurai received a B.E. degree in social and information studies from Gunma University in 2007, a M.A.E. degree in inter-disciplinary information studies in 2010 and a PhD degree in Engineering in 2014 from the University of Tokyo. Currently, she is a project assistant professor in Graduate School of Information Systems, the University of Electro-Communications. Her research interests are multi-modal/cross-modal interfaces, human-computer interaction and Perceptual/Cognitive psychology. She is also active as a manga artist for introduction of the latest research on virtual reality, human interface and artificial Intelligence.

Description: “Inclination Manipulator” manipulates the perception of spatial inclination by complementing the gap between the senses in real world (somatosensory) and VR space (vision) using haptic cue for generating rotational force component of the body. This enables to virtual walking up a slope on a flat surface in the real world.

Levitar: Real Space Interaction through Mid-Air CG Avatar

Speaker(s): Kei Tsuchiya, The University of Electro-Communications, Japan
Naoya Koizumi, The University of Electro-Communications, JST PRESTO, Japan

Kei Tsuchiya is a graduate student from the University of Electro- Communications.

Dr. Naoya Koizumi is an assistant professor of the Graduate School of Informatics and Engineering at the University of Electro-Communications and a researcher of PRSTO program in Japan Science and Technology Agency (2016-2020). He received his BE (2004) and ME (2006) from the University of Electro-Communications, and PhD (2013) in Media Design from Keio University (KMD). He was a JSPS Postdoctoral Researcher at Keio University (2013) and project researcher at the University of Tokyo (2013-2016).

Description: We propose a system to be a CG avatars in real space by using mid-air imaging technology. The video captured from the mid-air image position is presented to the user via the HMD and the camera gaze direction synchronized with the user's head movement.

Licker: A Tongue Robot for Representing Realistic Tongue Motions

Speaker(s): Ryota Shijo, The University of Electro-Communications, Japan
Izumi Mizoguchi, The University of Electro-Communications, Japan

Ryota SHIJO is a first year PhD course student at University of electro-communications(UEC). He is researching Virtual Reality and Human Augmentation. He obtained Master of Engineering at UEC in 2018, and Bachelor of Engineering at UEC in 2016. He researched computer vision for mobile robot in Bachelor, and augmented sports in Master.

Izumi MIZOGUCHI is a second year PhD course student at University of electro-communications(UEC). He is researching Virtual Reality and Human Augmentation. He obtained Master of Engineering at UEC in 2018, and Bachelor of Computer Science at Tokyo University of Technology(TUT) in 2016. He researched Smart Shoes and foot movement for Human augmentation in Bachelor to Master.

Description: We present Licker, a flexible tongue robot that is capable of mimicking a human tongue motion. The aim of this robot is to grow social bonding, regardless of species by licking.

Light'em: A Multiplexed Lighting System

Speaker(s): Koichi Ota, The University of Tokyo, Japan
Yuki Ban, The University of Tokyo, Japan
Rui Fukui, The University of Tokyo, Japan
Shin'ichi Warisawa, The University of Tokyo, Japan

He received bachelor degree of engineering (2017) and master degree of environmental studies (2019) from The University of Tokyo. His research focuses on improving indoor environment particularly from aspects of visual environments.

Yuki Ban received the M.S. degree and the Ph.D. degree in Information Science and Technology from the University of Tokyo, Tokyo, Japan, in 2013 and 2016, respectively. He was a researcher at Xcoo inc. research from 2016 to 2017. He is currently an Assistant Professor of Graduate School of Frontier Sciences at the University of Tokyo. His current research interests focus on modifying spatial perception using the visuo-haptic interaction.

He received bachelor (2002), master (2004) and Ph. D. (Information Science and Technology) degrees from the University of Tokyo (UTokyo). He was an engineer of Mitsubishi Heavy Industries, Ltd (2004–2006). He was a (Project) Assistant Professor of Department of Mechano-Informatics, UTokyo (2009–2013), was an Assistant Professor (full-time lecturer) in Department of mechanical engineering, UTokyo (2013–2016), and has been an Associate Professor in Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, UTokyo. He works on human symbiotic robot system and mechanism design. He is a member of IEEE and the Robotics Society of Japan.

Prof. Warisawa is a professor of Department of Human and Engineered Environmental Studies at the University of Tokyo. From April of 1994 to March of 2000, he served as an Assistant Professor of Tokyo Institute of Technology, from April of 2000 has been working at the University of Tokyo. He was a visiting researcher at Massachusetts Institute of Technology from 2010 to 2011, and a visiting professor at Université Jean Monnet in 2016. His current research focuses on wearable/ambient human health monitoring. Research cores are nano/micro sensing devices fabrication and sensing information technology application for human well-being.

Description: "Light'em" realizes multiplexing of the lighting environments using an active shutter system. The effect of visual stimuli on indoor environment desirability varies for each individual. However, different desired environments collide between individuals in one space. We propose a lighting environment multiplexing system simultaneously making independently controllable multiple different lighting environments.

NavigaTorch: Projection-based Robot Control Interface using High-speed Handheld Projector

Speaker(s): Takefumi Hiraki, Osaka University, The University of Tokyo, Japan
Shogo Fukushima, The University of Tokyo, Japan
Yoshihiro Kawahara, The University of Tokyo, Japan
Takeshi Naemura, The University of Tokyo, Japan

He received a Ph.D. in Infomation and Communication Engineering from the University of Tokyo, Japan, in 2019. He is currently a Japan Society for Promotion of Science (JSPS) research fellow at the Graduate School of Engineering Science, Osaka University. His research interests lie in the areas of augmented reality, human-computer interaction, and ubiquitous computing.

He received the Ph.D. in engineering from the University of Electro-Communications, Japan, in 2013. He is currently an Assistant Professor with the Interfaculty Initiative in Information Studies, the University of Tokyo. He was a visiting student with the Camera Culture Group, MIT Media Lab supported by the ``Japan Society for Promotion of Science (JSPS) Research Fellowships for Research Abroad,'' and a Project Researcher with the Graduate School of Information Science and Technology, the University of Tokyo. His research interests include intelligence amplification (IA), virtual reality, entertainment computing, and human emotions.

He received the B.S., M.S., and Ph.D. degrees in Information and Communication Engineering from the University of Tokyo, Japan, in 2000, 2002, and 2005, respectively. Currently, he is a Professor in the Department of Electrical Engineering and Information Systems, the University of Tokyo. He joined the faculty in 2005. From 2011 to 2013, he was a Visiting Scholar at the Georgia Institute of Technology, USA. Further, he was a Visiting Assistant Professor at the Massachusetts Institute of Technology, USA, in 2013. His research interests lie in the areas of computer networks and ubiquitous and mobile computing.

He received a Ph.D. in Electrical Engineering from the University of Tokyo, Japan, in 1997. Currently, he is a Professor in the Interfaculty Initiative in Information Studies, the University of Tokyo. He was a visiting assistant professor of computer science at Stanford University, USA, supported by ``Japan Society for Promotion of Science (JSPS) Postdoctoral Fellowships for Research Abroad" from 2000 to 2002. His research interests include virtual reality and human interface.

Description: We propose ``NavigaTorch'', a projection-based robot control interface that enables the user to operate a robot quickly and intuitively. The user can control and navigate a robot from the third-person viewpoint using the projected video as visual feedback by using a handheld pixel-level visible light communication (PVLC) projector.

PinpointFly: An Egocentric Position-pointing Drone Interface using Mobile AR

Speaker(s): Linfeng Chen, Tohoku University, Japan
Akiyuki Ebi, Tohoku University, Japan
Kazuki Takashima, Tohoku University, Japan
Kazuyuki Fujita, Tohoku University, Japan
Yoshifumi Kitamura, Tohoku University, Japan

Linfeng Chen is a graduate student in ICD lab, Tohoku University. He received his bachelor from Jilin University in China. His research interests are drone, user interface and augmented reality.

Akiyuki Ebi is a master student in ICD lab. He received his bachelor from National Institute of Technology, Toyama College in Japan. His research interests are drone, user interface.

Dr. Takashima received his Ph.D from the Graduate School of Information Science and Technology at Osaka University in 2008. He then worked as an assistant professor at Osaka University, and joined Tohoku University's Research Institute of Electrical Communication as an assistant professor in 2011. Dr. Takashima was promoted to the rank of associate professor at Tohoku University in 2018.

Dr. Kazuyuki Fujita is an Assistant Professor at Tohoku University. He received his Ph.D. in Information Science and Technology from Osaka University in 2013. His research interests are spatial user interface and virtual reality.

Dr. Yoshifumi Kitamura has been Professor in the Research Institute of Electrical Communication, Tohoku University, since 2010. His research interests include interactive content design, human computer interactions, 3D user interfaces, virtual reality, and related fields. He serves in positions such as the Japan Liaison of IFIP TC-13, Japan Liaison and Chair of ACM SIGCHI Asian Development Committee, Chair of Japan ACM SIGCHI Chapter, Steering Committee Chair of ACM VRST, and Conference Chair of ACM SIGGRAPH Asia 2015, General Chair of CHI 2021. His formal education was obtained at Osaka University, B.Sc. (1985); M.Sc. (1987); and Ph.D. (1996).

Description: We proposed PinpointFly, a novel AR-based egocentric drone manipulation interface that increases spatial perception and manipulation accuracy by overlaying a cast shadow on the ground. We designed and implemented a proof-of-concept prototype using a motion tracking system, see-through AR techniques and a programmable drone.

Polyvision: 4D Space Manipulation through Multiple Projections

Speaker(s): Keigo Matsumoto, The University of Tokyo, Japan
Nami Ogawa, The University of Tokyo, Japan
Hiroyuki Inou, Kyoto University, Japan
Shizuo Kaji, Kyushu University, Japan
Yutaka Ishii, Kyushu University, Japan
Michitaka Hirose, The University of Tokyo, Japan

Keigo MATSUMOTO is currently pursuing his Ph.D. in Information Science and Technology at the University of Tokyo in Japan. His research fields are mainly virtual reality (VR) and spatial perception. Based on perception theory, especially cross-modal effects, he tries to manipulate spatial perception and expand VR space. At the same time, he is developing creative demonstrations that offer fascinating opportunities to recognize how relative and uncertain our senses are. His awards include Japan Media Arts Festival Excellence Award and the President's Award of The University of Tokyo.

Nami OGAWA is currently pursuing her Ph.D. in Engineering under the supervision of Prof. Michitaka HIROSE at the University of Tokyo in Japan. Her research fields are mainly virtual reality (VR) and perceptual psychology. Based on psychological theory, especially well-known illusions, she tries to develop ingenious displays and artworks that evoke artificial novel sensations and experiences. At the same time, she utilizes VR as an experimental tool to investigate human perception. She is interested in body ownership and cross-modal perception.

Hiroyuki INOU is an Associate Professor of Mathematics at Kyoto University. He received a Ph.D. from the Department of Mathematics at Kyoto University in 2001. His research field is complex dynamics. He has been developing visualization programs of fractal objects which appear in complex dynamics in order to understand their complicated structures not only in complex dimension one such as Julia sets and the Mandelbrot set, but also in complex dimension two (i.e. in real dimension four) using virtual reality systems.

Shizuo KAJI is an Associate Professor of the Institute of Mathematics for Industry at Kyushu University. He received a Ph.D. from the Department of Mathematics at Kyoto University in 2007. His research interest is in topology and its applications to sciences.

Yutaka ISHII is a Professor of Mathematics at Kyushu University. He received his Ph.D. from The University of Tokyo in 1998. His research interest includes fractal sets arising from dynamical systems in four-dimensional space and their visualization using virtual reality systems.

Prof. Hirose Michitaka focuses on developing a high-level user interface that unites human and computer, called Cybernetic Interface. Starting with virtual reality technology, he seeks to research and develop such interfaces. Some of the research themes that he is working on are image-based rendering technology, augmented reality technology, multimodal and crossmodal interfaces, and technology concerning lifelog and Big data. He is also interested in the contents that are made from such technology, and social implementation of those technologies. Some projects that he is working on are the Digital Museum project, the Digital Public Art project, and the Senior Cloud project.

Description: 4D space has always been a source of imagination and intellectual activities for human beings. By our novel visualization technique based on multiple 3D projections created in VR, Polyvision equips us with the sense of 4D letting us explore high dimensional data and mathematical objects in a totally new way.

PortOn: Portable mid-air imaging optical system on glossy materials

Speaker(s): Ayaka Sano, The University of Electro-Communications, Japan
Naoya Koizumi, The University of Electro-Communications, JST PRESTO, Japan

Ayaka Sano is a graduate student from the University of Electro- Communications.

Dr. Naoya Koizumi is an assistant professor of the Graduate School of Informatics and Engineering at the University of Electro-Communications and a researcher of PRSTO program in Japan Science and Technology Agency (2016-2020). He received his BE (2004) and ME (2006) from the University of Electro-Communications, and PhD (2013) in Media Design from Keio University (KMD). He was a JSPS Postdoctoral Researcher at Keio University (2013) and project researcher at the University of Tokyo (2013-2016).

Description: PortOn is a portable optical system that form mid-air images that stand on a glossy surface such as a table or the floor. PortOn projects light to form a mid-air image at a position that is easy for a human to see when it is placed on a flat surface.

ReFriction: Remote friction control on polystyrene foam by ultrasound phased array

Speaker(s): Task Ohmori, The University of Tokyo, Japan
Yuki Abe, The University of Tokyo, Japan
Yu Someya, The University of Tokyo, Japan
Masahiro Fujiwara, The University of Tokyo, Japan
Yasutoshi Makino, The University of Tokyo, Japan
Hiroyuki Shinoda, The University of Tokyo, Japan

He is a Master's student of the Graduate School of Information Science and Technology, the University of Tokyo. He received the BS degree of Engineering from the University of Tokyo, in 2018. His research interests include information physics and haptics.

He is a Master's student of the Graduate School of Information Science and Technology, the University of Tokyo. He received the BS degree of Engineering from the University of Tokyo, in 2019. His research interests include information physics and haptics.

He is a Master's student of the Graduate School of Information Science and Technology, the University of Tokyo. He received the BS degree of Engineering from the University of Tokyo, in 2019. His research interests include information physics and haptics.

He is a project assistant professor in the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He received the BS degree in Engineering, the MS degree and the PhD degree in Information Science and Technology from the University of Tokyo, in 2010,2012, and 2015, respectively. His research interests include information physics, haptics, non-contact sensing and application systems related to them. He is a member of IEEE.

Yasutoshi Makino received his Ph.D. in Information Science and Technology from the Univ. of Tokyo in 2007. He worked as a researcher for two years in the Univ. of Tokyo and an assistant professor at Keio University from 2009 to 2013. From 2013 he moved to the Univ. of Tokyo as a lecturer, and he is an associate professor in the Department of Complexity Science and Engineering in the University of Tokyo from 2017. His research interest includes haptic interactive systems.

Hiroyuki Shinoda is a professor in the Graduate School of Frontier Sciences, University of Tokyo, Japan. He received his Ph.D. degree in engineering from the University of Tokyo in 1995. After a period at UC Berkeley as a visiting scholar in 1999, he was an associate professor in the University of Tokyo from 2000 to 2012. His research interests include information physics, haptics, midair haptics, two-dimensional communication, and application systems related to them. He is a member of IEEJ, RSJ, JSME, IEEE and ACM.

Description: We propose a system that can remotely change the friction feel of the polystyrene foam surface using an Airborne Ultrasound Tactile Display (AUTD). Since no device is needed on the target surface, tactile display could be large or disposable. Furthermore, changing the surface friction of three-dimensional objects is also expected.

Simple is Vest: High-Density Tactile Vest that Realizes Tactile Transfer of Fingers

Speaker(s): Taha Moriyama, The University of Electro-Communication, Japan
Akifumi Takahashi, The University of Electro-Communications, Japan
Hideyuki Asazu, The University of Electro-Communications, Japan
Hiroyuki Kajimoto, The University of Electro-Communications, Japan

Taha Moriyama is a PhD student in the University of Electro-Communications, Japan. His research interests are tactile displays, tactile sensors, human interface and virtual reality. Born in Egypt and studied most of life in Germany.

Akifumi Takahashi is a PhD student in the University of Electro-Communications, Japan. His research interests are tactile displays, tactile sensors, human interface and virtual reality.

Hideyuki Asazu is a master course student in the University of Electro-Communications, Japan. His research interests are tactile displays, tactile sensors, human interface and virtual reality.

Hiroyuki Kajimoto received a PhD in information science and technology from The University of Tokyo in 2006. He is currently a professor in the Department of Informatics at the University of Electro-Communications, Japan. His research interests are tactile displays, tactile sensors, human interface and virtual reality. He is a member of IEEE and ACM.

Description: We developed a high-density tactile vest, which adopts 144 eccentric mass vibration motors actuated individually and five Peltier elements that presents the haptic sensation of the five fingertips to the back rather than to the fingertip as a new haptic presentation method for objects in a virtual reality (VR) environment.

StickyTouch: An Adhesion Changeable Surface

Speaker(s): Yoshitaka Ishihara, Osaka University, Japan
Ryo Shirai, Osaka University, Japan
Yuichi Itoh, Osaka University, Japan
Kazuyuki Fujita, Tohoku University, Research Institute of Electrical Communication, Japan
Takao Onoye, Osaka University, Japan

Yoshitaka Ishihara is a master course student of Graduate School of Information Science and Technology, Osaka University, Japan. His research interest is developing a novel tactile display that represents adhesive information on a surface.

Ryo Shirai received the B.E. and M.E. degree in information systems engineering from Osaka University, Suita, Japan, in 2016 and 2018, respectively, where he is currently pursuing the Ph.D. degree in information science and technology. Mr. Shirai is currently a research fellow with the Japan Society for the Promotion of Science (JSPS) from 2019. His current research interests include analog circuits design, embedded systems, and sensor systems.

Yuichi Itoh received Dr.Eng. degree in information systems engineering from Osaka University, Japan, in 2002. He joined Osaka University as a research associate in 2002, and promoted as a lecturer in 2007.He is currently a associate professor of the Department of Information Systems Engineering, Osaka University. His research interests include Human Computer Interaction.

Kazuyuki Fujita is an Assistant Professor in ICD Lab., Research Institute of Electrical Communication at Tohoku University. He received his Ph.D. in Information Science and Technology from Osaka University in 2013. He worked for ITOKI, an office space design company, and was engaged in research and development on future offices for 2013-2018. His research interest includes Human-Computer Interaction and Virtual Reality.

Takao Onoye received Dr.Eng. degree in information systems engineering from Osaka University, Japan, in 1997. He joined Osaka University as a research associate in 1993, and promoted as a lecturer in 1998. Since 1999 through 2002, he was with Kyoto University as an associate professor. He is currently a professor of the Department of Information Systems Engineering, Osaka University. His research interests include System-on-a-Chip implementation of multimedia (audiovisual) processing system. Dr. Onoye is a member of IEEE, IEICE, IPSJ, and ITE of Japan.

Description: We propose StickyTouch, a novel tactile display that represents adhesive information on a surface. Adhesion control can be achieved by a temperature sensitive adhesive sheet whose temperature is locally controlled by peltier devices arranged in a grid. We implemented a proof-of-concept prototype and proposed the example applications of the display.

SwarmCloak: Landing of a Swarm of Nano-Quadrotors on Human Arms

Speaker(s): Evgeny Tsykunov, Skolkovo Institute of Science and Technology, Russia
Ruslan Agishev, Skolkovo Institute of Science and Technology, Russia
Roman Ibrahimov, Skolkovo Institute of Science and Technology, Russia
Luiza Labazanova, Skolkovo Institute of Science and Technology, Russia
Taha Moriyama, The University of Electro-Communications, Japan
Hiroyuki Kajimoto, The University of Electro-Communications, Japan
Dzmitry Tsetserukou, Skolkovo Institute of Science and Technology, Russia

Evgeny Tsykunov received the MS degree in computer science from Skolkovo Institute of Science and Technology, Moscow, Russian Federation in 2016. He is currently working towards the Ph.D. degree in the Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology. His research interests include developing control algorithms and interfaces for the human-swarm interaction.

Ruslan Agishev received a Bachelor degree in computer engineering from Moscow Institute of Physics and Technology, Russia, in 2017. He received the MS degree in the Department of Space and Engineering Systems, Skolkovo Institute of Science and Technology. His research interests include robotics and mathematics, focusing on UAVs control and navigation, path planning algorithms.

Roman Ibrahimov received the BSc degree in systems engineering from ADA University, Azerbaijan, in 2018. He was an exchange student at METU, Turkey, in 2016 and ITMO University, Russia, in 2017. He is now a second-year MS student at the Department of Space and Engineering Systems, Skoltech, Russia. His research interests include, but are not limited to, robotics and control systems.

Labazanova Luiza received the MS degree in the Department of Space and Engineering Systems, Skolkovo Institute of Science and Technology. In addition, she was a visiting student at the Department of Informatics, University of Electro-Communications, Japan. Her research interests include robotics and haptics, focusing on wearable devices and mechanoreceptors stimulation.

Ph.D. student, University of Electro-Communications.

Professor, University of Electro-Communications.

Dzmitry Tsetserukou received the Ph.D. degree in Information Science and Technology from the University of Tokyo, Japan, in 2007. From 2007 to 2009, he was a JSPS Post-Doctoral Fellow at the University of Tokyo. He worked as Assistant Professor at the Electronics-Inspired Interdisciplinary Research Institute, Toyohashi University of Technology from 2010 to 2014. From August 2014 he works at Skolkovo Institute of Science and Technology as Head of Intelligent Space Robotics Laboratory. Dzmitry is a member of the Institute of Electrical and Electronics Engineers (IEEE) since 2006 and the author of over 70 technical publications, 3 patents, and a book.

Description: A novel system SwarmCloak is used for landing of a fleet of four flying robots on the human hands and forearms using light-sensitive landing pads with vibrotactile feedback. Two types of tactile displays with vibromotors are activated by the light emitted from LED array at the bottom of each quadcopter.

Synesthesia Wear : Full-body haptic clothing interface based on two-dimensional signal transmission

Speaker(s): Taichi Furukawa, Keio University Graduate School of Media Design, Japan
Nobuhisa Hanamitsu, Enhance, inc.; Keio University Graduate School of Media Design, Japan
Yoichi Kamiyama, Keio University Graduate School of Media Design, Japan
Hideaki Nii, VIVITA Japan Inc., Japan
Charalampos Krekoukiotis, Keio University Graduate School of Media Design, Japan
Kouta Minamizawa, Keio University Graduate School of Media Design, Japan Science and Technology Agency (JST), Japan
Akihito Noda, Nanzan University, Japan Science and Technology Agency (JST), Japan
Junko Yamada, TEIJIN LIMITED, Japan
Keiichi Kitamura, TEIJIN LIMITED, Japan
Daisuke Niwa, TEIJIN LIMITED, Japan
Yoshiaki Hirano, TEIJIN LIMITED, Japan
Tetsuya Mizuguchi, Enhance, inc., Japan

Received bachelor degree of Computer Science and Technology from Salesian Polytechnic in 2018. He is master's student of Keio University Graduate School of Media Design, where engage researches on virtual reality and haptics at KMD Embodied Media Project.

Nobuhisa Hanamitsu is a computer/haptic scientist and media technology enthusiast from Japan, currently is a PhD program at Keio Media Design. In addition, he is a "Synesthesia" scientist at Enhance Incorporated, too. His current research interests include full body embodied haptic interaction design, haptic effect and applications of haptic technology in VR/AR/MR.

He is a researcher of Keio University Graduate School of Media Design, where engage researches on virtual reality and haptics at KMD Embodied Media Project.

In 2006, he completed without degree from the University of Electro-Communications graduate school of engineering studies doctoral course in mechanical engineering. 2007, assistant professor in University of Tokyo. In 2008, he was received his Ph.D. (Engineering) from University of Electro-Communications. 2009, senior assistant professor in Keio University. 2010, researcher in National University of Singapore. 2012, researcher in IIJ innovation institute, Japan. 2017, he joined the VIVITA Inc and he designs the electronic components and gadgets.

Harry Krekoukiotis was born in Greece and holds a Diploma degree in Architectrural Engineering, a graduate degree in Design Research (Design-Space-Culture graduate program) from National Technical University of Athens, Greece, as well as a Diploma in Digital Filmmaking from SAE Institute Athens. Currently he is pursuing a masters degree in Media Design in Keio University Graduate School of Media Design, in Tokyo, Japan, where his research focuses on spatial storytelling through AR and Haptics, as a member of the Embodied Media Project.

Received Ph.D in Information Science and Technology from University of Tokyo in 2010. He is Principle Investigator of KMD Embodied Media Project, where drives multiple researches on sharing, augmenting, and creating bodily experiences by applying the emerging technologies on virtual reality and haptics. He also serve as a board member at Virtual Reality Society of Japan, Executive Director at Superhuman Sports Society, Vice chair for conference at IEEE Technical Committee on Haptics, Associate Program Manager at Japan Science and Technology Agency, and Technical Advisor at Telexistence, inc.

Akihito Noda received the B.E. degree in control and systems engineering from Tokyo Institute of Technology, Tokyo, Japan, in 2005, and the M.E. and Ph.D. degrees in information physics and computing from the University of Tokyo, Tokyo, Japan, in 2010 and 2013, respectively. He was an Engineer at INCS, Inc. from 2005 to 2008, a Research Fellow at the Japan Society for the Promotion of Science (JSPS) from 2010 to 2013, and a Project Assistant Professor at the University of Tokyo, from 2013 to 2017. Since 2017, he has been an Associate Professor at Nanzan University.

Received Master’s degree of Agriculture from Kyushu University in 2001. She is a manager of wearable project with two-dimensional signal transmission technology at TEIJIN LIMITED.

Received master’s degree in Science and Technology from Niigata University in 2001. His research interests are business planning and software development for wearable healthcare industry.

Received Ph.D. degree in Engineering (Applied Chemistry) from Waseda University in 2004. He is a manager of Home Healthcare R&D Planning Department at TEIJIN PHARMA LIMITED. His research interests are medical devices and wearable sensors and actuators.

Received Bachelor’s degree of Commerce from Nihon University in 1991. He is a general manager of Smart Sensing Business Development Project with two-dimensional signal transmission technology at TEIJIN LIMITED.

Entertainment Design, Synesthesia Design, Interaction Design, Digital Storytelling. Along with his pursuit of research on the links between human desires and media, he engages in a wide range of creative activities in synesthesia around the globe, spanning genres such as video games, music, music videos, and live performances.

Description: Synesthesia Wear is a novel full-body haptic interface that provides vibrotactile sensations to the whole body and free movement in space using Two-dimensional signal transmission Technology. We also demonstrate spatial computing application as the future use in Mixed Reality using Synesthesia Wear.

Three-dimensional Interaction Technique Using an Acoustically Manipulated Balloon

Speaker(s): Takuro Furumoto, The University of Tokyo, Japan
Takaaki Kamigaki, The University of Tokyo, Japan
Mitsuru Ito, The University of Tokyo, Japan
Masahiro Fujiwara, The University of Tokyo, Japan
Yasutoshi Makino, The University of Tokyo, Japan
Hiroyuki Shinoda, The University of Tokyo, Japan

Takuro Furumoto is a Ph.D student at the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He recieved his B.E. and M.E. degrees from the University of Tokyo in 2014 and 2017, respectively. His research interests include acoustic manipulation and its applications. He is a member of ACM, IEEE, and VRSJ.

Takaaki Kamigaki is a project researcher at the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He recieved the B.E., M.E. degrees from Kumamoto University, and Ph.D degree in Science from the University of Tokyo. His research interests include ultrasound-based mid-air haptics.

Mitsuru Ito is a Ph.D. student in the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He received his M.S degree in Frontier Sciences, the University of Tokyo in 2015. His research interests include midair haptic interfaces and aireal displays.

Masahiro Fujiwara is a project assistant professor in the Graduate School of Frontier Sciences, the University of Tokyo, Japan. He received the BS degree in Engineering, the MS degree and the PhD degree in Information Science and Technology from the University of Tokyo, in 2010, 2012, and 2015, respectively. His research interests include information physics, haptics, non-contact sensing and application systems related to them. He is a member of IEEE.

Yasutoshi Makino received his Ph.D. in Information Science and Technology from the Univ. of Tokyo in 2007. He worked as a researcher for two years in the Univ. of Tokyo and an assistant professor at Keio University from 2009 to 2013. From 2013 he moved to the Univ. of Tokyo as a lecturer, and he is an associate professor in the Department of Complexity Science and Engineering in the University of Tokyo from 2017. His research interest includes haptic interactive systems.

Hiroyuki Shinoda is a professor in the Graduate School of Frontier Sciences, University of Tokyo, Japan. He received his Ph.D. degree in engineering from the University of Tokyo in 1995. After a period at UC Berkeley as a visiting scholar in 1999, he was an associate professor in the University of Tokyo from 2000 to 2012. His research interests include information physics, haptics, midair haptics, two-dimensional communication, and application systems related to them. He is a member of IEEJ, RSJ, JSME, IEEE and ACM.

Description: We use an acoustically manipulated balloon as a visual and tangible interface for the representation of a mid-air virtual object in a full-body AR/MR environment. The user can manipulate the physical balloon by manipulating the corresponding virtual object, and conversely, can manipulate the virtual object by physically manipulating the balloon.

TwinCam Go: Proposal of Vehicle-Ride Sensation Sharing with Stereoscopic 3D Visual Perception and Vibro-Vestibular Feedback for Immersive Remote Collaboration

Speaker(s): Vibol Yem, Tokyo Metropolitan University, Japan
Reon Nashiki, Tokyo Metropolitan University, Japan
Tsubasa Morita, Tokyo Metropolitan University, Japan
Fumiya Miyashita, Tokyo Metropolitan University, Japan
Tomohiro Amemiya, The University of Tokyo, Japan
Yasushi Ikei, Tokyo Metropolitan University, Japan

Vibol Yem received a PhD in engineering from University of Tsukuba in 2015. He is currently an assistant professor in the Department of Computer Science, Graduate School of Systems Design, Tokyo Metropolitan University. His research interests are Human Interface, Tactile/Haptic Device, VR/AR, Wearable, Robotics. He is a member of ACM and IEEE.

Reon Nashiki is a master's degree student at Tokyo Metropolitan University. He obtained the bachelor degree in mechatronics system engineering from Tokyo Metropolitan in 2017. His research interests include development of telexistence system, virtual reality and ultra reality.

Tsubasa Morita is a master's degree student at Tokyo Metropolitan University. He obtained the bachelor degree in mechanical system engineering from Tokyo Metropolitan in 2019. His research interests include development of telepresence system, virtual reality and ultra reality.

Miyashita Fumiya is a master's degree student at Tokyo Metropolitan University. He obtained the bachelor degree in mechanical system engineering from Tokyo Metropolitan in 2017. His research interests include investigating sensation of activeness, virtual reality and ultra reality.

Tomohiro Amemiya is an associate professor in the Graduate School of Information Science and Technology, the University of Tokyo, Japan. He received B.S. and M.S. degrees in mechano-informatics from the University of Tokyo, in 2002 and 2004. From 2004 to 2019, he was a research scientist at NTT Communication Science Laboratories, Japan. He was also an honorary research associate at the Institute of Cognitive Neuroscience, University College London, UK in 2014-2015, concurrently. He received a Ph.D. in Information Science and Technology from Osaka University, Japan, in 2008. His research interests include haptic perception, tactile neural systems, VR, and assistive technologies.

Yasushi Ikei graduated from the Graduate School of Engineering, The University of Tokyo with a PhD degree in the industrial mechanical engineering in 1988. He joined Tokyo Metropolitan Institute of Technology in 1992. He is currently Professor at the department of computer science, Tokyo Metropolitan University. His research interests are in the virtual reality, ultra reality, telepresence, multisensory display, and cognitive engineering. He received paper awards and contribution award from the Virtual Reality Society of Japan (VRSJ). He gained innovative technologies awards from METI Japan and DCAJ in 2012,2017,2018. He is former vice president and fellow member of the VRSJ.

Description: We proposed and developed a prototype of vehicle-ride sensation sharing system that enables a rider to remotely collaborate with a driver and can receive both 3D visual perception and vibro-vestibular sensation. A remote rider can collaborate with driver via voice communication and perceive motion sensation via wheelchair’s movement.