-
Towards Intelligent Speech Assistants in Operating Rooms: A Multimodal Model for Surgical Workflow Analysis
Authors:
Kubilay Can Demir,
Belen Lojo Rodriguez,
Tobias Weise,
Andreas Maier,
Seung Hee Yang
Abstract:
To develop intelligent speech assistants and integrate them seamlessly with intra-operative decision-support frameworks, accurate and efficient surgical phase recognition is a prerequisite. In this study, we propose a multimodal framework based on Gated Multimodal Units (GMU) and Multi-Stage Temporal Convolutional Networks (MS-TCN) to recognize surgical phases of port-catheter placement operations…
▽ More
To develop intelligent speech assistants and integrate them seamlessly with intra-operative decision-support frameworks, accurate and efficient surgical phase recognition is a prerequisite. In this study, we propose a multimodal framework based on Gated Multimodal Units (GMU) and Multi-Stage Temporal Convolutional Networks (MS-TCN) to recognize surgical phases of port-catheter placement operations. Our method merges speech and image models and uses them separately in different surgical phases. Based on the evaluation of 28 operations, we report a frame-wise accuracy of 92.65 $\pm$ 3.52% and an F1-score of 92.30 $\pm$ 3.82%. Our results show approximately 10% improvement in both metrics over previous work and validate the effectiveness of integrating multimodal data for the surgical phase recognition task. We further investigate the contribution of individual data channels by comparing mono-modal models with multimodal models.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
High-Performance Photon Number Resolving Detectors for 850-950 nm wavelengths
Authors:
J. W. N. Los,
Mariia Sidorova,
B. L. Rodriguez,
Patrick Qualm,
J. Chang,
S. Steinhauer,
V. Zwiller,
I. Esmaeil Zadeh
Abstract:
Since their first demonstration in 2001, superconducting-nanowire single-photon detectors have witnessed two decades of great developments. SNSPDs are the detector of choice in most modern quantum optics experiments and are slowly finding their way into other photon starved fields of optics. Until now, however, in nearly all experiments SNSPDs were used as binary detectors, meaning they can only d…
▽ More
Since their first demonstration in 2001, superconducting-nanowire single-photon detectors have witnessed two decades of great developments. SNSPDs are the detector of choice in most modern quantum optics experiments and are slowly finding their way into other photon starved fields of optics. Until now, however, in nearly all experiments SNSPDs were used as binary detectors, meaning they can only distinguish between 0 and more than 1 photons and photon number information is lost. Recent research works have demonstrated proof of principle photon number resolving (PNR) SNSPDs counting 2 to 5 photons. The photon-number-resolving capability is highly demanded in various quantum-optics experiments, including HOM interference, photonic quantum computing, quantum communication, and non Gaussian quantum state preparation. In particular, PNR detectors at the wavelength range of 850 to 950 nm are of great interest due to the availability of high quality semiconductor quantum dots and high-performance Cesium-based quantum memories. In this paper, we demonstrate NbTiN based SNSPDs with over 94 percent system detection efficiency, sub 11 ps timing jitter for one photon, and sub 7 ps for two photon. More importantly, our detectors resolve up to 7 photons using conventional cryogenic electric readout circuitry. Through theoretical analysis, we show that the current PNR performance of our detectors can still be further improved by improving the signal to noise ratio and bandwidth of our readout circuitry. Our results are promising for the future of optical quantum computing and quantum communication.
△ Less
Submitted 14 January, 2024;
originally announced January 2024.
-
Real-Time Measurements of Photonic Microchips with Femtometer-Scale Spectral Precision and Ultra-High Sensitivity
Authors:
Mahdi Mozdoor Dashtabi,
Mohammad Talebi Khoshmehr,
Hamed Nikbakht,
Bruno Lopez Rodriguez,
Naresh Sharma,
Iman Esmaeil Zadeh,
B. Imran Akca
Abstract:
Photonic integrated circuits (PICs) are enabling major breakthroughs in a number of areas, including quantum computing, neuromorphic processors, wearable devices, and more. Nevertheless, existing PIC measurement methods lack the spectral precision, speed, and sensitivity required for refining current applications and exploring new frontiers such as point-of-care or wearable biosensors. Here, we pr…
▽ More
Photonic integrated circuits (PICs) are enabling major breakthroughs in a number of areas, including quantum computing, neuromorphic processors, wearable devices, and more. Nevertheless, existing PIC measurement methods lack the spectral precision, speed, and sensitivity required for refining current applications and exploring new frontiers such as point-of-care or wearable biosensors. Here, we present the Sweeping Optical Frequency Mixing Method (SOHO), surpassing traditional PIC measurement methods with real-time operation, 30 dB higher sensitivity, and over 100 times better spectral resolution. Leveraging the frequency mixing process with a sweeping laser and custom control software, SOHO excels in simplicity, eliminating the need for advanced optical components and additional calibration procedures. We showcase its superior performance on ultrahigh-quality factor (Q) fiber-loop resonators (Q = 46M) as well as microresonators realized on a new optical waveguide platform. An experimental spectral resolution of 19.1 femtometers is demonstrated using an 85-meter-long unbalanced fiber Mach Zehnder Interferometer, constrained by noise resulting from the extended fiber length, while the theoretical resolution is calculated to be 6.2 femtometers, limited by the linewidth of the reference laser. With its excellent performance metrics, SOHO has the potential to become a vital measurement tool in photonics, excelling in high-speed and high-resolution measurements of weak optical signals.
△ Less
Submitted 8 December, 2023; v1 submitted 8 October, 2023;
originally announced October 2023.
-
Well-posedness for a family of degenerate parabolic mixed equations
Authors:
Ramiro Acevedo,
Christian Gómez,
Bibiana López Rodríguez
Abstract:
The aim of this work is to show an abstract framework to analyze a family of linear degenerate parabolic mixed equations. We combine the theory for the degenerate parabolic equations with the classical Babuska-Brezzi theory for linear mixed stationary equations to deduce sufficient conditions to prove the well-posedness of the problem. Finally, we illustrate the application of the abstract framewo…
▽ More
The aim of this work is to show an abstract framework to analyze a family of linear degenerate parabolic mixed equations. We combine the theory for the degenerate parabolic equations with the classical Babuska-Brezzi theory for linear mixed stationary equations to deduce sufficient conditions to prove the well-posedness of the problem. Finally, we illustrate the application of the abstract framework through examples that come from physical science applications including fluid dynamics models and electromagnetic problems.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
