“Evolution of medicine is only possible if researchers and clinicians connect.”

Professor Mazda Farshad, MD is Principal Investigator and Medical Director at Balgrist University Hospital

Musculoskeletal disorders reduce the quality of life by causing pain and discomfort and reducing mobility and function. 

Patient outcomes are largely dependent on surgeons’ performance, which in turn depends on their experience and ability. AI can augment the human surgeon’s skills and Balgrist University Hospital is playing a leading role in evolving the future of this medicine. 

Professor Philipp Fürnstahl, Research in Orthopedic Computer Science and Lead AR Research at Balgrist University Hospital, explains how the technology helps clinicians: “Augmented reality and artificial intelligence are enabling technologies. They disruptively change how work is done in specific sectors and across sectors. At the beginning of our project, we evaluated different AR devices, we decided to use the Microsoft Hololens. A transparent display allows the user to see the real world and computer generated images simultaneously. Real-world perception of humans is overlaid by useful computer-generated information.” 

Transferring this information to a real-life operating room is another challenge as the technology needs to be calibrated to work under different lighting conditions. The stakes are high: misplacing a surgical screw that is intended to enter bone in a patient’s spine, even by a few millimeters, can have catastrophic consequences including paralysis. 

The first time the technology was applied in a clinical setting was at the end of December 2020. Describing it as a “very intense and interesting experience,” Professor Dr. med. Mazda Farshad, Principal Investigator and Medical Director at Balgrist University Hospital, described how the mixed reality technology was used: 

“The trajectory of screws into the spine were projected onto the patient, guiding the surgeon’s hands. The results that were evaluated after surgery for accuracy were impressive. We need studies and further evaluation to explore further potential benefits of this approach.”

Collaboration remains an important part of the Balgrist story, sharing best practices with others to ensure that the entire field of knowledge is constantly pushing forward. 

Beatrice Beck Schimmer, Director at University Medicine Zurich says:

“The Balgrist University Hospital is an ideal partner for us because of its cutting-edge science, technology, and research. Technological innovation is extremely important for students because they will be our future physicians and doctors.”

Detlef Günther, Vice President Research at ETH agrees, praising the willingness to put theory into practice:

“The nature of our collaboration is that we try to translate research from our institute to the placement within Balgrist, then bring it to patients. Peer-reviewed papers are one expression of innovation. Bringing something into the reality of the operating room is much more important; you have to have the courage to go the long way of applying something for the first time.”

The future of augmented reality continues with research underway to explore how the augmented reality world can be enhanced through auditory inputs as well as visual. Combining the best of technology with the best human minds is producing better outcomes for patients across the world.