Video Optical See-Through Augmented Reality surgical System

Project Information

VOSTARS

Grant agreement ID: 731974

DOI 10.3030/731974

Project closed

EC signature date 9 November 2016

Start date 1 December 2016

End date 30 November 2020

Funded under

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Total cost € 4 438 444,71

EU contribution € 3 816 440,00

Coordinated by

UNIVERSITA DI PISA
Italy

Deliverables

Websites, patent fillings, videos etc. (2)

Plan for use and dissemination of results – 1-18 months

This deliverable will report on some activities of the Task 11.1.

Communication tools (project identity set, website)

This deliverable will report on some activities of the Task 11.1.

Documents, reports (1)

Plan for use and dissemination of results

This deliverable will report on some activities of the Task 11.1.

Publications

Peer reviewed articles (22)

Commercially Available Head-Mounted Displays Are Unsuitable for Augmented Reality Surgical Guidance: A Call for Focused Research for Surgical Applications

Author(s): Marina Carbone, Roberta Piazza, Sara Condino
Published in: Surgical Innovation, Issue 27/3, 2020, Page(s) 254-255, ISSN 1553-3506
Publisher: SAGE Publications
DOI: 10.1177/1553350620903197

Parallax Free Registration for Augmented Reality OpticalSee-through Displays in the Peripersonal Space

Author(s): Vincenzo Ferrari, Nadia Cattari, Umberto Fontana, Fabrizio Cutolo
Published in: IEEE Transactions on Visualization and Computer Graphics, 2020, Page(s) 1-1, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2020.3021534

Review on Augmented Reality in Oral and Cranio-Maxillofacial Surgery: Toward “Surgery-Specific” Head-Up Displays

Author(s): Giovanni Badiali, Laura Cercenelli, Salvatore Battaglia, Emanuela Marcelli, Claudio Marchetti, Vincenzo Ferrari, Fabrizio Cutolo
Published in: IEEE Access, Issue 8, 2020, Page(s) 59015-59028, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2020.2973298

Toed-in vs Parallel Displays in Video See-Through Head-Mounted Displays for Close-Up View

Author(s): Nadia Cattari, Fabrizio Cutolo, Renzo D'amato, Umberto Fontana, Vincenzo Ferrari
Published in: IEEE Access, Issue 7, 2019, Page(s) 159698-159711, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2019.2950877

AUGMENTED REALITY TO IMPROVE SURGICAL SIMULATION. LESSONS LEARNED TOWARDS THE DESIGN OF A HYBRID LAPAROSCOPIC SIMULATOR FOR CHOLECYSTECTOMY

Author(s): Viglialoro R. M., Esposito N., Condino S., Cutolo F., Guadagni S., Gesi M., Ferrari M., Ferrari V.
Published in: IEEE Transactions on Biomedical Engineering, 2019, ISSN 0018-9294
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbme.2018.2883816

Are augmented reality headsets in surgery a dead end?

Author(s): Vincenzo Ferrari, Marina Carbone, Sara Condino, Fabrizio Cutolo
Published in: Expert Review of Medical Devices, Issue 16/12, 2019, Page(s) 999-1001, ISSN 1743-4440
Publisher: Future Drugs Ltd.
DOI: 10.1080/17434440.2019.1693891

Ambiguity-Free Optical–Inertial Tracking for Augmented Reality Headsets

Author(s): Fabrizio Cutolo, Virginia Mamone, Nicola Carbonaro, Vincenzo Ferrari, Alessandro Tognetti
Published in: Sensors, Issue 20/5, 2020, Page(s) 1444, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s20051444

Review of the Augmented Reality Systems for Shoulder Rehabilitation

Author(s): Rosanna Maria Viglialoro, Sara Condino, Giuseppe Turini, Marina Carbone, Vincenzo Ferrari, Marco Gesi
Published in: Information, Issue 10/5, 2019, Page(s) 154, ISSN 2078-2489
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/info10050154

Software Framework for Customized Augmented Reality Headsets in Medicine

Author(s): Fabrizio Cutolo, Benish Fida, Nadia Cattari, Vincenzo Ferrari
Published in: IEEE Access, Issue 8, 2020, Page(s) 706-720, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2019.2962122

Perceptual Limits of Optical See-Through Visors for Augmented Reality Guidance of Manual Tasks

Author(s): Sara Condino, Marina Carbone, Roberta Piazza, Mauro Ferrari, Vincenzo Ferrari
Published in: IEEE Transactions on Biomedical Engineering, Issue 67/2, 2020, Page(s) 411-419, ISSN 0018-9294
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbme.2019.2914517

The Wearable VOSTARS System for Augmented Reality-Guided Surgery: Preclinical Phantom Evaluation for High-Precision Maxillofacial Tasks

Author(s): Laura Cercenelli, Marina Carbone, Sara Condino, Fabrizio Cutolo, Emanuela Marcelli, Achille Tarsitano, Claudio Marchetti, Vincenzo Ferrari, Giovanni Badiali
Published in: Journal of Clinical Medicine, Issue 9/11, 2020, Page(s) 3562, ISSN 2077-0383
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/jcm9113562

Perspective Preserving Solution for Quasi-Orthoscopic Video See-Through HMDs

Author(s): Fabrizio Cutolo * , Umberto Fontana and Vincenzo Ferrari
Published in: Technologies, Issue 6/1, 2018, Page(s) 9, ISSN 2227-7080
Publisher: MDPI AG
DOI: 10.3390/technologies6010009

Augmented reality in open surgery

Author(s): Benish Fida, Fabrizio Cutolo, Gregorio di Franco, Mauro Ferrari, Vincenzo Ferrari
Published in: Updates in Surgery, 2018, ISSN 2038-131X
Publisher: Springer Verlag
DOI: 10.1007/s13304-018-0567-8

The Role of Camera Convergence in Stereoscopic Video See-through Augmented Reality Displays

Author(s): Fabrizio Cutolo, Vincenzo Ferrari
Published in: International Journal of Advanced Computer Science and Applications, Issue 9/8, 2018, ISSN 2156-5570
Publisher: International Journal of Advanced Computer Science and Applications
DOI: 10.14569/ijacsa.2018.090803

Letter to the Editor on “Augmented Reality Based Navigation for Computer Assisted Hip Resurfacing: A Proof of Concept Study”

Author(s): Fabrizio Cutolo
Published in: Annals of Biomedical Engineering, Issue 47/11, 2019, Page(s) 2151-2153, ISSN 0090-6964
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10439-019-02299-w

A new head-mounted display-based augmented reality system in neurosurgical oncology: a study on phantom

Author(s): Fabrizio Cutolo, Antonio Meola, Marina Carbone, Sara Sinceri, Federico Cagnazzo, Ennio Denaro, Nicola Esposito, Mauro Ferrari, Vincenzo Ferrari
Published in: Computer Assisted Surgery, Issue 22/1, 2017, Page(s) 39-53, ISSN 2469-9322
Publisher: Taylor & Francis Group
DOI: 10.1080/24699322.2017.1358400

Wearable Augmented Reality Platform for Aiding Complex 3D Trajectory Tracing

Author(s): Sara Condino, Benish Fida, Marina Carbone, Laura Cercenelli, Giovanni Badiali, Vincenzo Ferrari, Fabrizio Cutolo
Published in: Sensors, Issue 20/6, 2020, Page(s) 1612, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s20061612

Projected Augmented Reality to Drive Osteotomy Surgery: Implementation and Comparison With Video See-Through Technology

Author(s): Virginia Mamone; Vincenzo Ferrari; Sara Condino; Fabrizio Cutolo
Published in: IEEE Access, Issue 1, 2020, Page(s) 169024 - 169035, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3021940

How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens

Author(s): Sara Condino, Giuseppe Turini, Paolo D. Parchi, Rosanna M. Viglialoro, Nicola Piolanti, Marco Gesi, Mauro Ferrari, Vincenzo Ferrari
Published in: Journal of Healthcare Engineering, Issue 2018, 2018, Page(s) 1-12, ISSN 2040-2295
Publisher: Multi Science Publishing
DOI: 10.1155/2018/5435097

Off-Line Camera-Based Calibration for Optical See-Through Head-Mounted Displays

Author(s): Fabrizio Cutolo, Umberto Fontana, Nadia Cattari, Vincenzo Ferrari
Published in: Applied Sciences, Issue 10/1, 2020, Page(s) 193, ISSN 2076-3417
Publisher: MDPI
DOI: 10.3390/app10010193

Wearable Augmented Reality Application for Shoulder Rehabilitation

Author(s): Sara Condino, Giuseppe Turini, Rosanna Viglialoro, Marco Gesi, Vincenzo Ferrari
Published in: Electronics, Issue 8/10, 2019, Page(s) 1178, ISSN 2079-9292
Publisher: MDPI
DOI: 10.3390/electronics8101178

The vostars project: a new wearable hybrid video and optical see-through augmented reality surgical system for maxillofacial surgery

Author(s): G. Badiali, F. Cutolo, L. Cercenelli, M. Carbone, R. D’Amato, V. Ferrari, C. Marchetti
Published in: International Journal of Oral and Maxillofacial Surgery, Issue 48, 2019, Page(s) 153, ISSN 0901-5027
Publisher: Churchill Livingstone
DOI: 10.1016/j.ijom.2019.03.472

Conference proceedings (9)

InGaN/GaN µLED SPICE modelling with size-dependent ABC model integration

Author(s): Anis Daami, Francois Olivier
Published in: Physics and Simulation of Optoelectronic Devices XXVII, 2019, Page(s) 13, ISBN 9781510624672
Publisher: SPIE
DOI: 10.1117/12.2509382

Green InGaN/GaN based LEDs: high luminance and blue shift

Author(s): Anis Daami, François Olivier, Ludovic Dupré, Christophe Licitra, Franck Henry, François Templier, Stéphanie Le Calvez
Published in: Gallium Nitride Materials and Devices XIV, 2019, Page(s) 21, ISBN 9781510624795
Publisher: SPIE
DOI: 10.1117/12.2509396

Towards a Wearable Augmented Reality Visor for High-Precision Manual Tasks

Author(s): Cattari, Nadia; Piazza, Roberta; D'Amato, Renzo; Fida, Benish; Carbone, Marina; Condino, Sara; Cutolo, Fabrizio; Ferrari, Vincenzo
Published in: 2020 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Issue 4, 2020
Publisher: IEEE
DOI: 10.1109/memea49120.2020.9137253

[POSTER] Hybrid Video/Optical See-Through HMD

Author(s): Fabrizio Cutolo, Umberto Fontana, Marina Carbone, Renzo D'Amato, Vincenzo Ferrari
Published in: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), 2017, Page(s) 52-57, ISBN 978-0-7695-6327-5
Publisher: IEEE
DOI: 10.1109/ISMAR-Adjunct.2017.31

Closed – Loop Calibration for Optical See-Through Near Eye Display with Infinity Focus

Author(s): Umberto Fontana, Fabrizio Cutolo, Nadia Cattari, Vincenzo Ferrari
Published in: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2018, Page(s) 51-56, ISBN 978-1-5386-7592-2
Publisher: IEEE
DOI: 10.1109/ismar-adjunct.2018.00033

InGaN/GaN μLEDS for display applications Optical and electrical characteristics spread comprehension

Author(s): A. Daami, F. Olivier, D. Sarrasin, L. Dupré, F. Templier
Published in: Proceedings of the 2017 International conference on Solid State Devices and Materials, 2017
Publisher: SSDM

A Microsoft HoloLens Mixed Reality Surgical Simulator for Patient-Specific Hip Arthroplasty Training

Author(s): Giuseppe Turini, Sara Condino, Paolo Domenico Parchi, Rosanna Maria Viglialoro, Nicola Piolanti, Marco Gesi, Mauro Ferrari, Vincenzo Ferrari
Published in: Lecture Notes in Computer Science, 2018, Page(s) 201-210, ISBN 978-3-319-95281-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-95282-6_15

Proof of Concept: Wearable Augmented Reality Video See-Through Display for Neuro-Endoscopy

Author(s): Marina Carbone, Sara Condino, Fabrizio Cutolo, Rosanna Maria Viglialoro, Oliver Kaschke, Ulrich W. Thomale, Vincenzo Ferrari
Published in: Lecture Notes in Computer Science, Issue volume 10851, 2018, Page(s) 95-104, ISBN 978-3-319-95281-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-95282-6_7

InGaN/GaN μLEDS for display applications Optical and electrical characteristics spread comprehension

Author(s): A. Daami, F. Olivier, D. Sarrasin, L. Dupré, F. Templier
Published in: Extended Abstracts of the 2017 International Conference on Solid State Devices and Materials, 2017
Publisher: The Japan Society of Applied Physics
DOI: 10.7567/ssdm.2017.ps-7-06