Moderator: Joaquim Jorge, Instituto de Engenharia de Sistemas e Computadores - Investigação e Desenvolvimento (INESC-ID), ACM SIGGRAPH, Portugal
Joaquim Jorge coordinates the VIMMI research group at INESC-ID, is Professor of Computer Graphics and Interactive Techniques at Instituto Superior Técnico, University of Lisbon. He is Editor-in-Chief of the Computers and Graphics Journal, a Fellow of the Eurographics Association, a Distinguished ACM Member and Speaker, and IEEE Senior Member. He organized 40+ scientific events, including Eurographics 2016 as IPC CO-Chair, Eurovis 2019 as co-chair and IEEE VR 2020 as IPC co-chair. He is ACM/SIGGRAPH SCC Chair and (co)authored over 300 publications in international refereed journals, conferences, and books. His research interests include virtual reality, multimodal user interfaces, and medical applications.

Lecturer(s): Pedro F. Campos, Instituto de Engenharia de Sistemas e Computadores - Investigação e Desenvolvimento (INESC-ID), Universidade da Madeira, Portugal
Pedro Campos is Associate Professor with Habilitation in the Department of the Faculty of Exact Sciences and Engineering, University of Madeira. He teaches Programming Usable Interfaces, Advanced Research Topics and other curricular units related with Human-Computer Interaction and Software Engineering. Pedro is an ACM Senior Member and has published 100+d peer-reviewed papers in HCI, AR and VR, and has participated in the program committee of more than 50 international conferences. He had leading roles organizing more than 28 international conferences, serving as president of the program committee, associate chair, local organizer, posters chair, demos chair and others.

Daniel Lopes, Instituto de Engenharia de Sistemas e Computadores - Investigação e Desenvolvimento (INESC-ID); Instituto Superior Técnico, Universidade de Lisboa, Portugal
Daniel Simões Lopes is an Assistant Professor of Computer Science & Engineering at Técnico Lisboa, and Head of Biomedical Research at the Visualization and Intelligent Multimodal Interfaces Group at INESC-ID Lisboa, where he carries research in Computer Graphics and Human-Computer Interaction. He holds a degree in biomedical engineering from the University of Lisbon and graduated in computational engineering under the framework of the UT Austin|Portugal Program. After graduating, he was a postdoc at INESC-ID Lisboa and also a visiting scholar at INRIA - Lille. His main research interests are virtual reality, augmented reality, computer-aided design, and medical user interfaces.

Description: The growing interest of Augmented Reality (AR) together with the renaissance of Virtual Reality (VR) has opened new approaches and techniques on how professionals interact with medical imagery, plan, train and perform surgeries and also help people with special needs in Rehabilitation tasks. Indeed, many medical specialties already rely on 2D and 3D image data for diagnosis, surgical planning, surgical navigation, medical education or patient-clinician communication. However, the vast majority of current medical interfaces and interaction techniques continue unchanged, while the most innovative solutions have not unleashed the full potential of VR and AR. This is probably because extending conventional workstations to accommodate VR and AR interaction paradigms is not free of challenges. Notably, VR and AR-based workstations, besides having to render complex anatomical data in interactive frame rates, must promote proper anatomical insight, boost visual memory through seamless visual collaboration between professionals, free interaction from being seated at a desk (e.g., using mouse and keyboard) to adopt non-stationary postures and freely walk within a workspace, and must also support a fluid exchange of image data and 3D models as this fosters interesting discussions to solve clinical cases. Moreover, VR and AR-based techniques must also be designed according to good human-computer interaction principles since it is well known that medical professionals can be resistant to changes in their workflow. In this course, we will survey recent approaches to healthcare, including diagnosis, surgical training, planning, and followup as well as AR/MR/VR tools for patient rehabilitation. We discuss challenges, techniques, and principles in applying Extended Reality in these contexts and outline opportunities for future research.