Accurate Mixed Reality on the Microsoft HoloLens – AccuMixHOLO

Funded By: University of Pisa, PROGRAMMA DI VALORIZZAZIONE – POCARNO 2022 

Bando pubblico per la realizzazione di Programmi di valorizzazione dei brevetti tramite il finanziamento di progetti di Proof of Concept (PoC)  delle Università italiane e degli Enti Pubblici di Ricerca (EPR) italiani e degli Istituti di Ricovero e Cura a Carattere Scientifico (IRCCS) da finanziare nell’ambito del Piano Nazionale di Ripresa e Resilienza, Missione 1 “Digitalizzazione, innovazione competitività, cultura e turismo” – Componente 2 “Digitalizzazione, innovazione e competitività nel sistema produttivo” – Investimento 6 “Sistema della proprietà industriale” finanziato dall’Unione Europea – NextGenerationEU

PARTICIPATING INSTITUTIONS: University of Pisa – Department of Information Engineering

STARTING DATE: 2023

APPROVED END DATE: 2025

The project objectives are: (1) to explore methods for integrating a frontal lens system into Microsoft HoloLens displays to prevent misalignment between virtual and real-world information; (2) to develop a Unity3D plugin that performs a user-independent calibration procedure; and (3) to achieve millimetric precision with the Microsoft HoloLens during manual precision tasks without the use of eye-tracking devices. The project consists of two parallel and interconnected activities: hardware development and software development. Additionally, a trial phase is planned to assess the system’s performance and potential applications. These activities are closely aligned to ensure the seamless integration of the hardware and software components.

TOTAL BUDGET:  60.000€

The research activity has resulted in the following main publications in peer-reviewed journals and contributions to conference proceedings:

  1. Ferrari, Vincenzo, Nadia Cattari, Sara Condino, and Fabrizio Cutolo. “Optical Rules to Mitigate the Parallax-Related Registration Error in See-Through Head-Mounted Displays for the Guidance of Manual Tasks.” Multimodal Technologies and Interaction 8, no. 1 (2024): 4.
  2. Cattari, Nadia, Fabrizio Cutolo, and Vincenzo Ferrari. “Optical See-Through Head-Mounted Display With Mitigated Parallax-Related Registration Errors: A User Study Validation.” IEEE Transactions on Human-Machine Systems (2024).
  3. Nocera, Alessio, Sara Condino, Vincenzo Ferrari, and Fabrizio Cutolo. “Control of the Cameras Matrix Parameters for Accurate Online Calibration to Perform Precision Tasks with Microsoft HoloLens 2 Headset.” In 2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), pp. 799-804. IEEE, 2024.