On June 11th 2020, the paper "A Pipeline for Multiparty Volumetric Video Conferencing: transmission of point clouds over low latency DASH" authored by Jack Jansen (CWI), Shishir Subramanyam (CWI), Romain Bouqueau (Motion Spell), Gianluca Cernigliaro (i2Cat Foundation), Marc Martos Cabré (i2Cat Foundation), Fernando Pérez (The Modern Cultural) and Pablo Cesar (CWI, TU Delft) has been awarded with the Best Demo paper Award at the ACM MMSys 2020 conference.
The paper introduces an architecture intended for volumetric videoconferencing that provides a highly realistic 3D representation of the participants, based on pointclouds, using low latency DASH as the transport mechanism. A pointcloud representation is suitable for real-time applications like video conferencing, due to its low-complexity and because it does not need a time-consuming reconstruction process. Low latency DASH is shown to be applicable to conferencing applications and enables client-based adaptation mechanisms for tiling and bandwidth use. This pipeline enables use cases such as remote medical consultation, cultural visits or tele-working.
The work was presented in the context of the VRTogether project, and three of the authors, Jack Jansen, Shishir Subramanyam and Pablo Cesar, are members of the CWI Distributed and Interactive Systems (DIS) research group.
The ACM Multimedia Systems Conference (MMSys) provides a forum for researchers to present and share their latest research findings in multimedia systems. While research about specific aspects of multimedia systems are regularly published in the various proceedings and transactions of the networking, operating systems, real-time systems, databases, mobile computing, distributed systems, computer vision, and middleware communities, MMSys aims to cut across these domains in the context of multimedia data types. This provides a unique opportunity to investigate the intersections and the interplay of the various approaches and solutions developed across these domains to deal with multimedia data types.
CWI’s Distributed and Interactive Systems research group focuses on facilitating and improving the way people use interactive systems and how people communicate with each other. We combine data science with a strong human-centric, empirical approach to understand the experience of users. This enables us to design and develop next generation intelligent and empathic systems. We base our results on realistic testing grounds and data sets, and embrace areas such as ubiquitous computing, human-centered multimedia systems, and languages.
More information
