Augmented Reality Guided Respiratory Liver Tumors Punctures: A Preliminary Feasibility Study

Speaker(s): Ruotong Li, Institute of Computer Science, University of Bonn, Germany
Tianpei Yang, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China
Weixin Si, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China
Xiangyun Liao, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China
Qiong Wang, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China
Reinhard Klein, Institute of Computer Science, University of Bonn, Germany
Pheng-Ann Heng, The Chinese University of Hong Kong, China

Ruotong Li is a Ph.D student in Department of Computer Science II at the University of Bonn, Germany. Her research interests include computer graphics and augmented reality applications in medicine. Contact her at liruoton@cs.uni-bonn.de.

Tianpei Yang is a visiting Master student in the Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences. His research interests are machine learning, computer graphics and augmented reality. Contact him at ytp327@gmail.com.

Weixin Si is an Associate Professor in the Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences. His research interests include virtual reality/ augmented reality/ mixed reality/ artificial intelligence for medical applications. Contact him at wxsics@gmail.com.

Xiangyun Liao is an Assistant Professor in the Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences. His research interests include virtual reality, physics based modeling and medical imaging. Contact him at xyunliao@gmail.com.

Qiong Wang is an Associate Professor in the Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences. Her research interests include VR applications in medicine, visualization, human-computer interaction and computer graphics. Contact her at wangqiong@siat.ac.cn.

Reinhard Klein is a Professor in Department of Computer Science II at the University of Bonn, Germany. His research interests include computer graphics, human-computer interaction as well as virtual and augmented reality. Contact him at rk@cs.uni-bonn.de.

Pheng-Ann Heng is a Professor in the Department of Computer Science and Engineering at the Chinese University of Hong Kong. His research interests include AI and VR for medical applications, surgical simulation, visualization, graphics and human-computer interaction. Contact him at pheng@cse.cuhk.edu.hk.

Description: This paper presented a preliminary feasible study for respiratory liver tumor puncture navigation via augmented reality modality, which allows surgeons targeting the lesion more easily, more efficiently and more precisely.

Bezalel - Towards low-cost pin-based shape displays

Speaker(s): Pedro de Almeida Sacramento, Universidade Federal de Viçosa, Brazil
Ricardo dos Santos Ferreira, Universidade Federal de Viçosa, Brazil
Marcus Vinicius Alvim Andrade, Universidade Federal de Viçosa, Brazil

Pedro is a professor in Information Systems and Engineering courses at Faculdade de Viçosa, a private college in Viçosa, Minas Gerais, Brazil. He has a small self funded laboratory where he conducts independent experiments in the field of human-computer interaction. He is also an Information Technology technician at the Federal University of Viçosa.

Ricardo dos Santos Ferreira is a full professor at the Department of Informatics of Federal University of Vicosa.

Marcus V. A. Andrade is a full professor at the Department of Informatics of Federal University of Vicosa.

Description: Bezalel is a solution for low-cost pin-based shape displays that requires 2√n actuators to actuate n pins. It outperforms the refresh rate of the state-of-the-art using half as much actuators.

Effect of Attention Adaptive Personal Audio Deliverable System on Digital Signage

Speaker(s): Noko Kuratomo, University of Tsukuba, Japan
Kazuki Yamada, University of Tsukuba, Japan
Soh Masuko, University of Tsukuba; Rakuten Institute of Technology, Rakuten, Inc., Japan
Toshimasa Yamanaka, University of Tsukuba, Japan
Keiichi Zempo, University of Tsukuba, Japan

KURATOMO, Noko received B.E., from College of Engineering Systems, the University of Tsukuba at 2019. He belongs currently to Graduate School of Systems and Information Engineering, the University of Tsukuba. His research interest includes the understanding of human intentions and emotions through sensing.

YAMADA, Kazuki received B.E., from College of Media Art And Science Technology, the University of Tsukuba at 2019. He belongs currently to Graduate School of Systems and Information Engineering, the University of Tsukuba. His research interests Augmented Reality and Image Processing.

Soh MASUKO received Ph.D. in Eng. at University of Tsukuba at 2008. He works for the Future Merchant Design Lab in Rakuten Institute of Technology as a section manager and the Faculty of Art & Design at Tsukuba University as a Professor as well. His research interests cover Entertainment Computing, HCI, Computer Vision, especially immersive shopping experience in Online Merges with Offline.

Toshimasa Yamanaka, PhD in Kansei Science, is a Professor at the Faculty of Art and Design, University of Tsukuba. He is a Chair of the Doctoral Program of Kansei, Behavioral and Brain Sciences, Graduate School of Comprehensive Human Sciences, University of Tsukuba. Also, Vice Chair of the Graduate School of Comprehensive Human Sciences, University of Tsukuba. Also, Executive Board Member of International Association of Universal Design and Board member of IASDR (International Association of Societies of Design Research). From 2012-2016, he served as President of the Japanese Society for the Science of Design.

ZEMPO, Keiichi received B.S., M.B.A. and Ph.D. in Eng. degrees from College of Natural Science, Master’s Program in Business Administration & Public Policy and the Department of Intelligent Interaction Technologies, University of Tsukuba at 2008, 2010 and 2013, respectively. He worked on Center for Service Engineering, National Institute of Advanced Industrial Science and Technology (AIST) from 2013 to 2014. He is currently with University of Tsukuba as an assistant professor. His research interests include extension of human perception, big data utilization and integration based on sensor signals, service systems.

Description: We have developed a system that only reached sound information to people who need it, like people watching a screen. This system has improved space comfortability while maintaining advertising effect.

Latency of 30 ms Matters More Than Refresh Rate Above 60 Hz for First Person Targeting Tasks

Speaker(s): Josef Spjut, NVIDIA, United States of America
Ben Boudaoud, NVIDIA, United States of America
Kamran Binaee, Rochester Institute of Technology, NVIDIA, United States of America
Jonghyun Kim, NVIDIA, United States of America
Alexander Majercik, NVIDIA, United States of America
Morgan McGuire, NVIDIA, Canada
David Luebke, NVIDIA, United States of America
Joohwan Kim, NVIDIA, United States of America

Josef Spjut is a Research Scientist at NVIDIA working on new human experiences, such as esports and augmented reality. Previously he was a Visiting Assistant Professor in the department of Engineering at Harvey Mudd College. He received a Ph.D. from the University of Utah and a B.S. from University of California, Riverside, both in Computer Engineering.

Ben joined NVIDIA in January 2018 as research staff in the New Experiences Research group. Prior to joining NVIDIA he worked on ultra-low power circuit and system design for medical products including wearable and implantable monitors for the cardiac space. He received his MS from the University of Virginia in 2014 where his work focused on development and deployment of wearable 6 and 9 DoF motion sensing platforms for clinical applications. Ben's research interests include techniques for low power, high efficiency circuit and system design as well as applications of low power sensors and systems within the VR/AR space.

Kamran finished his Ph.D. in Imaging Science at the Chester F. Carlson Center for Imaging Science at Rochester Institute of Technology. He worked with Dr. Gabriel Diaz at PerForM lab. During his Ph.D. he focused on three major research areas: 1) Developing Virtual/Augmented Reality systems, 2) Eye tracking in a VR system and developing spatial/temporal calibration routines for head mounted displays and 3) Computational modeling of human eye-hand coordination using machine learning techniques. His undergrad and Ms.C. degrees are in Electrical Engineering with focus on robotics and image processing.

Jonghyun Kim is a research scientist at NVIDIA research. He does research on 3D display systems including near-eye display, light field display, and holographic display and 3D imaging systems including light field microscopy and holographic microscopy. He enjoys designing and prototyping various imaging and display systems. He did his Ph. D. in the Department of Electrical and Computer Engineering in Seoul National University.

Zander Majercik is a Research Engineer at NVIDIA. His main research interest is novel rendering algorithms with a focus on ray-tracing. As a software engineer at NVIDIA Research, he implements software supporting projects in vision science, novel display technologies for XR systems, and deep learning algorithms. He graduated from Williams College in 2017 with a BA in Computer Science.

Morgan McGuire is a distinguished scientist at NVIDIA researching technology for creating new experiences in visual computing. He is currently investigating hardware acceleration and new displays for augmented reality, streaming 3D graphics, eSports, and ray tracing.

Dr. David Luebke is Vice President of Graphics Research at NVIDIA. He helped found NVIDIA Research in 2006 after eight years on the faculty of the University of Virginia. Prior to that, Luebke received his Ph.D. in 1998 at the University of North Carolina under Frederick P. Brooks. His research focuses on the intersection of human perception, computer graphics, and display technology. Luebke is an NVIDIA Distinguished Inventor and an IEEE Fellow.

Joohwan Kim is a vision scientist in Nvidia's New Experience research group based in Santa Clara, California. Joohwan received his Ph.D. from Seoul National University in 2009, and was a postdoctoral fellow in University of California, Berkeley until 2015. Joohwan's current interests are in understanding and improving viewer experience of various types of displays, especially regarding esports.

Description: Eight skilled esports athletes perform first person targeting tasks with latency and refresh rate independently controlled. We show task completion time across 1-hit and tracking tasks.