Misha Sra (MIT Media Lab), Sergio Garrido-Jurado (University of Córdoba), Chris Schmandt (MIT Media Lab), Pattie Maes (MIT Media Lab)
Procedurally Generated Virtual Reality from 3D Reconstructed Physical Space
Best Student Paper:
Qianqian Tong, Zhiyong Yuan, Mianlun Zheng, Weixu Zhu, Guian Zhang, Xiangyun Liao (School of Computer, Wuhan University, Hubei, China)
A Novel Magnetic Levitation Haptic Device for Augmentationof Tissue Stiffness Perception
Sebastian von Mammen, Andreas Knote, Sarah Edenhofer (University of Augsburg)
Cyber Sick but Still Having Fun
Prof. Bernd Froehlich
Collaborative Virtual Reality
Immersive telepresence allows distributed groups of users to meet in a shared virtual 3D world. Our approach uses two coupled projection-based multi-user setups, each providing multiple users with perspectively correct stereoscopic images. At each site, the users and their local interaction space are continuously captured using a cluster of registered depth and color cameras. The captured 3D information is transferred to the respective other location, where the remote participants are virtually reconstructed in life-size. Local and remote users can jointly or independently explore virtual environments and virtually meet face-to-face for discussions. We structure collaborative activities of collocated and remote users using Photoportals. Virtual photos and videos serve as three-dimensional references to objects, places, activities of users and moments in time. They can be shared among users and serve as portals to the captured information. Our Photoportals also provide access to intermediate or alternative versions of a scenario and allow the review of recorded task sequences that include life-size representations of captured users.
Bernd Froehlich is a full professor of Computer Science at Bauhaus-Universität Weimar. Since his work on the Two-user Responsive Workbench, the World's first projection-based stereoscopic two-user system developed in 1997, he is convinced that virtual reality has to provide multiple users with individual perspectives to enable truly collaborative work. Consequently, his Virtual Reality and Visualization Research group at Bauhaus-Universität Weimar has continuously developed and refined multi-user 3D display systems and the interaction techniques and interfaces to support tight collaboration in collocated and distributed virtual environments. His research also focuses on the software systems, graphics and visualization methods for displaying complex models in virtual environments. He co-founded the IEEE Symposium on 3D User Interfaces in 2005, is the current chair of the steering committee of the IEEE Virtual Reality conference and serves as an associate editor of the Virtual Environments section of the journal Frontiers in AI and Robotics. For his contributions to the field, he received the 2008 IEEE Virtual Reality Technical Achievement Award.
Prof. Nadia Magnenat Thalmann
Seeing Through Virtual Humans in motion: from the skin to the molecules
In our talk, we will describe how we can quickly model the appearance of a Virtual human using 3D interactive modelling or photogrammetry techniques. We will describe the recreation of ancient ball players with the inclusion of pseudo muscles for creating realistic deformations. As the modelling is still an approximation of the shape, we will show how we can model virtual humans’ anatomical deformations using MRI as main input data. We will show two cases study, one for the hip showing a classical ballerina dancing and the other one a multiscale modeling of the knee articulation with data coming from organ to molecules that interact with each level. An example will be shown with a soccer player. These case studies have been performed in our participation to several European Research Projects as the project REPLAY, 3DAnatomical Human and the project Multiscale Human.
Professor Thalmann joined NTU in August 2009 as the Director of the interdisciplinary Institute for Media Innovation. She has authored dozens of books, published more than 600 papers on virtual humans/virtual worlds and social robots (jointly with her PhD students), organised major conferences as CGI, CASA, and delivered more than 300 keynote addresses, some of them at global events such as the World Economic Forum in Davos.
During her illustrious career, she also established MIRALab at the University of Geneva in Switzerland, a ground-breaking interdisciplinary multimedia research institute. She participated in more than 50 European research projects, helping MIRALab to develop revolutionising interdisciplinary research in computer graphics, computer animation, and virtual worlds and producing impactful work that synergises art, fashion, computer graphics. Her work is regularly displayed at museums, galleries and fashion shows. Her most recent work includes the 3D virtual patient, including a case study on visualizing the articulations of ballerinas while dancing or soccer players.
In NTU, Singapore, recently, she revolutionized social robotics by unveiling the first social robot Nadine that can have mood and emotions and remember people and actions. (See wikipedia: social Nadine robot).
Besides having bachelor's and master's degrees in disciplines such as psychology, biology, chemistry and computer science, Professor Thalmann completed her PhD in quantum physics at the University of Geneva. She has received honorary doctorates from Leibniz University of Hannover and the University of Ottawa in Canada and several prestigious other awards as the Humboldt Research Award in Germany.
She is Editor-in-Chief of The Visual Computer, co-Editor-in-Chief of Computer Animation and Virtual Worlds, and editor of many other scientific journals. She is a life member of the Swiss Academy of Engineering Sciences.
Prof. Jun Rekimoto
Human Augmentation and the Age of Internet-of-Abilities
Traditionally, the field of Human Computer Interaction (HCI) was primarily concerned with designing and investigating interfaces between humans and machines. However, with recent technological advances, the concepts of "enhancing", "augmenting" or even "re-designing" humans themselves are becoming feasible and serious topics of scientific research as well as engineering development.
"Augmented Human" is a term that I use to refer to this overall research direction. Augmented Human introduces a fundamental paradigm shift in HCI: from human-computer-interaction to human-computer-integration, and out abilities will be mutually connected through the networks (what we call IoA, or Internet of Abilities, as the next step of IoT: Internet of Things). In this talk, I will discuss rich possibilities and distinct challenges in enhancing human abilities. I will introduce our recent projects including design of flying cameras as our remote and external eyes, a home appliance that can increase your happiness, an organic physical wall/window that dynamically mediates the environment, and an immersive human-human connection system called "JackIn."
Jun Rekimoto received his B.A.Sc., M.Sc., and Ph.D. in Information Science from Tokyo Institute of Technology in 1984, 1986, and 1996, respectively. Since 1994 he has worked for Sony Computer Science Laboratories (Sony CSL). In 1999 he formed and directed the Interaction Laboratory within Sony CSL. Since 2007 he has been a professor in the Interfaculty Initiative in Information Studies at The University of Tokyo. Since 2011 he also has been Deputy Director of Sony CSL
Rekimoto's research interests include human-computer interaction, computer augmented environments and computer augmented human (human-computer integration). He invented various innovative interactive systems and sensing technologies, including NaviCam (a hand-held AR system), CyberCode (the world's first marker-based AR system), Augmented Surfaces, HoloWall, and SmartSkin (two earliest representations of multi-touch systems). He received iF Interaction Design Award in 2000, the Japan Inter-Design Award in 2003, iF Communication Design Award in 2005, Good Design Best 100 Award in 2012, Japan Society for Software Science and Technology Fundamental Research Award in 2012, and ACM UIST Lasting Impact Award , Zoom Japon Les 50 qui font le Japon de demain in 2013. In 2007, He also elected to ACM SIGCHI Academy.