An end-to-end system for the production and delivery of photorealistic social immersive virtual reality experiences

Rezultaty

Report on the initial software versions, including their applicability for use in the pilots.

Documentation and technical fact sheets v3

his deliverable provides all the printable support documentation of VRTogether.

Final Software release, with documentation and Technical report targeting its use beyond the scope of the VR-Together project,

Technical report on third pilot

Technical report on third pilot, explaining the outcome of the deployment and its evaluation

Documentation and technical fact sheets v2

This deliverable provides all the printable support documentation of VRTogether.

User scenarios, requirements and architecture v3

This document will describe the use cases, functional and non-functional requirements, and software architecture needed to demonstrate the VR-Together approach to social photorealistic VR. It will be developed iteratively, with a new version issued for each pilot deployment

Market analysis report v3

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.1.

Documentation and technical fact sheets. v1

This deliverable provides all the printable support documentation of VRTogether.

Market Analysis Report v2

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.1.

User scenarios, requirements and architecture v1

This document will describe the use cases, functional and non-functional requirements, and software architecture needed to demonstrate the VR-Together approach to social photorealistic VR. It will be developed iteratively, with a new version issued for each pilot deployment

User scenarios, requirements and architecture v2

This document will describe the use cases, functional and non-functional requirements, and software architecture needed to demonstrate the VR-Together approach to social photorealistic VR. It will be developed iteratively, with a new version issued for each pilot deployment

Market analysis report v1

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.1.

Technical report on second pilot

Technical report on second pilot, explaining the outcome of the deployment and its evaluation

Technical report on first pilot

Technical report on first pilot explaining the outcome of the deployment and its evaluation

Third example of content delivered

Third example of content delivered, together with production and deployment plan for live content production and delivery

Second example of content

Second example of content tested production and deployment plan for live content production and delivery

First example of content

First example of content delivered together with production and deployment plan for live content production and delivery

Final version of the content demonstrations

Publikacje

ImAc : enabling immersive and accessible media services

Autorzy: Montagud, Mario; Núñez, Juan A.; Fernández, Sergi; Orero, Pilar; Matamala, Anna
Opublikowane w: Frontiers Blogs, Numer 12, 2018
Wydawca: WoRLD: Workshop on Reading, Language and Deafness
DOI: 10.5281/zenodo.3755775

AR/VR for conferencing and remote assistance

Autorzy: Hans Stocking, Simon N.B. Gunkel, Tom De Koninck, Michel van Eersel, Bart Kok
Opublikowane w: VRIC ConVRgence 2020, 2020, Strona(/y) 175-177
Wydawca: Laval Virtual
DOI: 10.5281/zenodo.4040587

PC-MCU - point cloud multipoint control unit for multi-user holoconferencing systems

Autorzy: Gianluca Cernigliaro, Marc Martos, Mario Montagud, Amir Ansari, Sergi Fernandez
Opublikowane w: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, 2020, Strona(/y) 47-53, ISBN 9781450379458
Wydawca: ACM
DOI: 10.1145/3386290.3396936

Self-Supervised Deep Depth Denoising

Autorzy: Sterzentsenko, Vladimiros; Saroglou, Leonidas; Chatzitofis, Anargyros; Thermos, Spyridon; Zioulis, Nikolaos; Doumanoglou, Alexandros; Zarpalas, Dimitrios; Daras, Petros
Opublikowane w: ICCV 2019, 2019
Wydawca: IEEE Xplore
DOI: 10.5281/zenodo.4032773

360-Degree Photo-realistic VR Conferencing

Autorzy: Simon N.B Gunkel, Marleen D.W. Dohmen, Hans Stokking, Omar Niamut
Opublikowane w: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Strona(/y) 946-947, ISBN 978-1-7281-1377-7
Wydawca: IEEE
DOI: 10.1109/vr.2019.8797971

A pipeline for multiparty volumetric video conferencing - transmission of point clouds over low latency DASH

Autorzy: Jack Jansen, Shishir Subramanyam, Romain Bouqueau, Gianluca Cernigliaro, Marc Martos Cabré, Fernando Pérez, Pablo Cesar
Opublikowane w: Proceedings of the 11th ACM Multimedia Systems Conference, 2020, Strona(/y) 341-344, ISBN 9781450368452
Wydawca: ACM
DOI: 10.1145/3339825.3393578

[DC] Multi-user (Social) Virtual Reality Commnunication

Autorzy: Simon N.B. Gunkel
Opublikowane w: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Strona(/y) 1359-1360, ISBN 978-1-7281-1377-7
Wydawca: IEEE
DOI: 10.1109/vr.2019.8797877

Measuring and Understanding Photo Sharing Experiences in Social Virtual Reality

Autorzy: Jie Li, Yiping Kong, Thomas Röggla, Francesca De Simone, Swamy Ananthanarayan, Huib de Ridder, Abdallah El Ali, Pablo Cesar
Opublikowane w: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 2019, Strona(/y) 1-14, ISBN 9781450359702
Wydawca: ACM Press
DOI: 10.1145/3290605.3300897

Social VR: A New Medium for Remote Communication and Collaboration

Autorzy: Li, J., Vinayagamoorthy, V., Williamson, J., Shamma, D. A. & Cesar, P.
Opublikowane w: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems, 2021
Wydawca: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems

A Social VR Clinic for Knee Arthritis Patients with Haptics

Autorzy: Tong Xue, Jie Li, Guo Chen, and Pablo Cesar
Opublikowane w: IMX-20, 2020
Wydawca: IMX-20
DOI: 10.6084/m9.figshare.12479204.v2

Social VR: A New Medium for Remote Communication and Collaboration

Autorzy: Jie Li, Vinoba Vinayagamoorthy, Raz Schwartz, Wijnand IJsselsteijn, David A. Shamma, Pablo Cesar
Opublikowane w: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Strona(/y) 1-8, ISBN 9781450368193
Wydawca: ACM
DOI: 10.1145/3334480.3375160

CakeVR: A Social Virtual Reality (VR) Tool for Co-designing Cakes

Autorzy: Mei, Y., Li, J., De Ridder, H. & Cesar, P.
Opublikowane w: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems, 2021
Wydawca: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems

Understanding User Proxemics and Social Formations in an Instrumented Virtual Reality Workshop

Autorzy: Williamson, J., Li, J., Shamma, D.A., Vinayagamoorthy, V. & Cesar, P.
Opublikowane w: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems, 2021
Wydawca: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems

Measuring User Quality of Experience in Social VR systems

Autorzy: Francesca De Simone
Opublikowane w: Proceedings of the 3rd International Workshop on Multimedia Alternate Realities - AltMM'18, 2018, Strona(/y) 25-26, ISBN 9781450359795
Wydawca: ACM Press
DOI: 10.1145/3268998.3277702

Comparing the Quality of Highly Realistic Digital Humans in 3DoF and 6DoF: A Volumetric Video Case Study

Autorzy: Shishir Subramanyam, Jie Li, Irene Viola, Pablo Cesar
Opublikowane w: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2020, Strona(/y) 127-136, ISBN 978-1-7281-5608-8
Wydawca: IEEE
DOI: 10.1109/vr46266.2020.00031

Open-source software tools for measuring resources consumption and DASH metrics

Autorzy: Mario Montagud, Juan Antonio De Rus, Rafael Fayos-Jordan, Miguel Garcia-Pineda, Jaume Segura-Garcia
Opublikowane w: Proceedings of the 11th ACM Multimedia Systems Conference, 2020, Strona(/y) 261-266, ISBN 9781450368452
Wydawca: ACM
DOI: 10.1145/3339825.3394931

VR Conferencing: communicating and collaborating in photo-realistic social immersive environments

Autorzy: F. De Simone, J. Li, A. El Ali, H. Galvan, S. Gunkel, P. Cesar
Opublikowane w: ConVRgence 3 Days Scientific Conference, 2019, Strona(/y) 45-46, ISBN 978-2-9566251-2-4
Wydawca: Laval Virtual
DOI: 10.5281/zenodo.4036168

Temporal Interpolation of Dynamic Digital Humans using Convolutional Neural Networks

Autorzy: Irene Viola, Jelmer Mulder, Francesca De Simone, Pablo Cesar
Opublikowane w: 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), 2019, Strona(/y) 90-907, ISBN 978-1-7281-5604-0
Wydawca: IEEE
DOI: 10.1109/aivr46125.2019.00022

A Color-Based Objective Quality Metric for Point Cloud Contents

Autorzy: Irene Viola, Shishir Subramanyam, Pablo Cesar
Opublikowane w: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020, Strona(/y) 1-6, ISBN 978-1-7281-5965-2
Wydawca: IEEE
DOI: 10.1109/qomex48832.2020.9123089

Multi-sensor capture and network processing for virtual reality conferencing

Autorzy: Sylvie Dijkstra-Soudarissanane, Karim El Assal, Simon Gunkel, Frank ter Haar, Rick Hindriks, Jan Willem Kleinrouweler, Omar Niamut
Opublikowane w: Proceedings of the 10th ACM Multimedia Systems Conference, 2019, Strona(/y) 316-319, ISBN 9781450362979
Wydawca: ACM
DOI: 10.1145/3304109.3323838

Experiencing Virtual Reality Together - Social VR Use Case Study

Autorzy: Simon Gunkel, Hans Stokking, Martin Prins, Omar Niamut, Ernestasia Siahaan, Pablo Cesar
Opublikowane w: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video - TVX '18, 2018, Strona(/y) 233-238, ISBN 9781-450351157
Wydawca: ACM Press
DOI: 10.1145/3210825.3213566

Convergence between TV and VR: Enabling Truly Immersive and Social Experience

Autorzy: Mario Montagud, Juan A. Núñez, Themistoklis Karavellas, Ibai Jurado, Sergi Fernández
Opublikowane w: ACM TVX2018, 2018
Wydawca: ACM TVX2018

Attention-Enhanced Sensorimotor Object Recognition

Autorzy: Spyridon Thermos, Georgios Th. Papadopulos, Petros Daras, Gerasimos Potamianos
Opublikowane w: 2018 25th IEEE International Conference on Image Processing (ICIP), 2018, Strona(/y) 336-340, ISBN 978-1-4799-7061-2
Wydawca: IEEE
DOI: 10.1109/icip.2018.8451158

Subjective Visual Quality Assessment of Immersive 3D Media Compressed by Open-Source Static 3D Mesh Codecs

Autorzy: Kyriaki Christaki, Emmanouil Christakis, Petros Drakoulis, Alexandros Doumanoglou, Nikolaos Zioulis, Dimitrios Zarpalas, and Petros Daras
Opublikowane w: 25th International Conference on MultiMedia Modeling (MMM), Thessaloniki, Greece, January 8-11, 2019., 2018
Wydawca: Visual Computing lab
DOI: 10.29007/ms1v

Virtual reality conferencing - multi-user immersive VR experiences on the web

Autorzy: Simon N. B. Gunkel, Hans M. Stokking, Martin J. Prins, Nanda van der Stap, Frank B. ter Haar, Omar A. Niamut
Opublikowane w: Proceedings of the 9th ACM Multimedia Systems Conference, 2018, Strona(/y) 498-501, ISBN 9781450351928
Wydawca: ACM
DOI: 10.1145/3204949.3208115

Let’s Get in Touch! Adding Haptics to Social VR

Autorzy: Leonor Fermoselle, Simon Gunkel, Frank ter ter Haar, Sylvie Dijkstra-Soudarissanane, Alexander Toet, Omar Niamut, Nanda van van der Stap
Opublikowane w: ACM International Conference on Interactive Media Experiences, Numer (pre-print available), 2020, Strona(/y) 174-179, ISBN 9781450379762
Wydawca: ACM
DOI: 10.1145/3391614.3399396

Watching Videos Together in Social Virtual Reality: An Experimental Study on User's QoE

Autorzy: Francesca De Simone, Jie Li, Henrique Galvan Debarba, Abdallah El Ali, Simon N.B Gunkel, Pablo Cesar
Opublikowane w: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Strona(/y) 890-891, ISBN 978-1-7281-1377-7
Wydawca: IEEE
DOI: 10.1109/vr.2019.8798264

User Centered Adaptive Streaming of Dynamic Point Clouds with Low Complexity Tiling

Autorzy: Shishir Subramanyam, Irene Viola, Alan Hanjalic, Pablo Cesar
Opublikowane w: Proceedings of the 28th ACM International Conference on Multimedia, 2020, Strona(/y) 3669-3677, ISBN 9781450379885
Wydawca: ACM
DOI: 10.1145/3394171.3413535

Augmented VR

Autorzy: Antonis Karakottas, Alexandros Papachristou, Alexandros Doumanoqlou, Nikolaos Zioulis, Dimitrios Zarpalas, Petros Daras
Opublikowane w: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2018, Strona(/y) 1-1, ISBN 978-1-5386-3365-6
Wydawca: IEEE
DOI: 10.1109/vr.2018.8446561

Designing a Social VR Clinic for Medical Consultations

Autorzy: Jie Li, Guo Chen, Huib de Ridder, Pablo Cesar
Opublikowane w: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Strona(/y) 1-9, ISBN 9781450368193
Wydawca: ACM
DOI: 10.1145/3334480.3382836

Everyday photo-realistic social VR: communicate and collaborate with an enhanced co-presence and immersion

Autorzy: Simon NB Gunkel; Hans Stokking; Tom De Koninck; Omar Niamut
Opublikowane w: Proceedings of International Broadcast Conference (IBC 2019), 2019
Wydawca: Proceedings of International Broadcast Conference (IBC 2019)
DOI: 10.5281/zenodo.4040503

Realidad Virtual inmersiva. Un mundo de posibilidades(Case study at the Museo Thyssen-Bornemisza)

Autorzy: Ana Revilla, Ignacio Lacosta
Opublikowane w: Arte, Patrimonio y Tecnología en la Era Digital, 2019, Strona(/y) 427-436, ISBN 978848380411
Wydawca: Gobierno de Aragón
DOI: 10.5281/zenodo.4036250

Space Wars: An AugmentedVR Game

Autorzy: Kyriaki Christaki, Konstantinos C. Apostolakis, Alexandros Doumanoglou, Nikolaos Zioulis, Dimitrios Zarpalas, Petros Daras
Opublikowane w: MultiMedia Modeling - 25th International Conference, MMM 2019, Thessaloniki, Greece, January 8–11, 2019, Proceedings, Part II, Numer 11296, 2019, Strona(/y) 566-570, ISBN 978-3-030-05715-2
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-030-05716-9_47

Deep sensorimotor learning for RGB-D object recognition

Autorzy: Spyridon Thermos, Georgios Th. Papadopoulos, Petros Daras, Gerasimos Potamianos
Opublikowane w: Computer Vision and Image Understanding, Numer 190, 2020, Strona(/y) 102844, ISSN 1077-3142
Wydawca: Academic Press
DOI: 10.1016/j.cviu.2019.102844

A Reduced Reference Metric for Visual Quality Evaluation of Point Cloud Contents

Autorzy: Irene Viola, Pablo Cesar
Opublikowane w: IEEE Signal Processing Letters, Numer 27, 2020, Strona(/y) 1660-1664, ISSN 1070-9908
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/lsp.2020.3024065

HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Media

Autorzy: Anargyros Chatzitofis, Leonidas Saroglou, Prodromos Boutis, Petros Drakoulis, Nikolaos Zioulis, Shishir Subramanyam, Bart Kevelham, Caecilia Charbonnier, Pablo Cesar, Dimitrios Zarpalas, Stefanos Kollias, Petros Daras
Opublikowane w: IEEE Access, Numer 8, 2020, Strona(/y) 176241-176262, ISSN 2169-3536
Wydawca: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3026276

TogetherVR: A Framework for Photorealistic Shared Media Experiences in 360-Degree VR

Autorzy: Martin J. Prins, Simon N. B. Gunkel, Hans M. Stokking, Omar A. Niamut
Opublikowane w: SMPTE Motion Imaging Journal, Numer 127/7, 2018, Strona(/y) 39-44, ISSN 1545-0279
Wydawca: Society of Motion and Television Engineers
DOI: 10.5594/JMI.2018.2840618

Social viewing in cinematic virtual reality: a design space for social movie applications

Autorzy: Sylvia Rothe, Alexander Schmidt, Mario Montagud, Daniel Buschek, Heinrich Hußmann
Opublikowane w: Virtual Reality, 2020, ISSN 1359-4338
Wydawca: Springer London
DOI: 10.1007/s10055-020-00472-4

DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectors

Autorzy: Anargyros Chatzitofis, Dimitrios Zarpalas, Stefanos Kollias, Petros Daras
Opublikowane w: Sensors, Numer 19/2, 2019, Strona(/y) 282, ISSN 1424-8220
Wydawca: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s19020282

On the Plausibility of Virtual Body Animation Features in Virtual Reality

Autorzy: Henrique Galvan Debarba, Sylvain Chagué, Caecilia Charbonnier
Opublikowane w: IEEE Transactions on Visualization & Computer Graphics, Numer (pre-print available), 2020, Strona(/y) tbd, ISSN 1077-2626
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2020.3025175

Rezultaty

Publikacje

Udostępnij tę stronę Udostępnij tę stronę w mediach społecznościowych

Pobierz Pobierz zawartość strony