ULL Banner Image

Ultra Low Latency Streamer in Surgery and Medical Imaging applications


Real-time communication and live data transfer has become crucial in surgeries and medical imaging application.  The ability to capture and share images live via endoscopy is essential for diagnosing diseases, planning surgical procedures, and training medical professionals. Recent technological advancements have made this possible, offering interactive and highly realistic live streaming.

iWave has recently announced the launch of the Ultra Low Latency Streamer and Recorder, which integrates real time communication and data transfer with very minimal delay between different devices and streaming locations during medical surgery. The ULL streamer proves to be an ideal solution for the increasing demand for low latency live streaming for delivery and distribution to the end user throughout the entire process.

Streaming of traditional X-ray imaging, computed tomography (CT), positron emission tomography (PET), and magnetic resonance imaging (MRI) often have a delay of several hundred milliseconds. The Ultra-low latency streaming from iWave reduces end to end streaming or Glass to Glass delay to a mere few milliseconds in the order of 66ms** over Wi-Fi 5. The streamed video is visualized and analysed in real-time simultaneously at local and remote places by Vision Pro and other industry acclaimed tools and systems, which helps medical personnel take quick decisions and actions. The Apple Vision Pro is a mixed-reality headset that combines augmented reality (AR) and virtual reality (VR) which is integrated into the ULL Streamer Decoder. As a result, we get:

  • Better synchronization of live events
  • Enhanced use experience with less buffering time
  • Competitive advantage in industries that require split-second decision-making

Key Features of Ultra Low Latency Streamer and Recorder:

  • Simultaneous compression and decompression of 4K UHD video at 60 Hz with audio.
  • 12G-SDI/HDMI 2.0 input/output for flexible integration.
  • Real-time encoding of 12G-SDI/HDMI 2.0 input video for live streaming or recording to M.2 SSD/USB storage.
  • Streaming over Wi-Fi 5
  • Capture, decode, and live display of video streams on HDMI 2.0/12G-SDI output.
  • The AES encryption method is used to scramble video content for secure broadcasting.
  • The ULL Streamer also supports zero latency 12G-SDI/HDMI2.0 pass through/ loop mode
ULL image

The FPGA powering the ULL streamer features HDMI RX and TX and Wi-Fi 5, enabling seamless data reception and transmission for real-time viewing, processing, and integration with displays. The Zynq UltraScale+ MPSoC is particularly efficient for video streaming purposes due to its integrated H.264/H.265 video codec unit. This feature allows for hardware-accelerated video encoding and decoding, making it highly suitable for high-definition video streaming.

The video codec is integrated into medical systems by first capturing raw video from imaging devices like endoscopes through high-speed interfaces like 12G-SDI or HDMI. This raw data is processed in the programmable logic (PL) for enhancements such as noise reduction or color correction. The integrated H.264/H.265 codec then compresses the video within the FPGA, reducing its size for efficient transmission. This compressed video is streamed to monitors, storage, or remote systems, ensuring high-quality, low-latency video critical for medical diagnostics and procedures.

The Ultra-Low Latency (ULL) Streamer Workflow:

The Encoder captures high-quality video from 12G-SDI or HDMI 2.0 sources at up to 3840x2160p resolution and 60 frames per second. The video is captured during surgical procedures, encoded into smaller data packets and then streamed over Wi-Fi 5 through protocols like UDP, SRP, RTMP, and RTSP. The encoded data is sent to a decoder, which displays the video on a high-speed displays like Apple Vision Pro etc. In addition, the video can be streamed to web-based platforms such as YouTube and Wowza and can be enhanced based on the customer requirement. The ULL streamer supports encryption and decryption to ensure secure streaming, with an add option to also incorporate audio from 12G-SDI or HDMI 2.0 sources.

Use cases of ULL Streamer:

  1. Real-Time Data Integration for Informed Decision-Making: Ultra-low latency streaming enables seamless integration of data into a surgical workflow, providing surgeons with the real-time insights.
  2. Telemedicine and Remote Surgery: Enables specialists to remotely participate in surgeries with near-instantaneous video transmission ensuring synchronized communication between remote and on-site teams.
  3. Medical Training and Simulation: Provides live streaming of surgical procedures or medical simulations to students and trainees, allowing for immediate feedback and interaction.
  4. ICU Monitoring: Streams real-time video and vital signs data from Intensive Care Units (ICUs) to remote monitoring stations, allowing healthcare providers to make quick decisions.
  5. Live Diagnostics: Facilitates the rapid transmission of diagnostic imaging (like ultrasound or endoscopy) to specialists who can interpret the results in real time, enhancing the diagnosis time.
  6. Emergency Response Coordination: In critical care situations, the ULL streamer can be used to provide instant video feeds from the scene to emergency response teams or hospitals, ensuring that the medical intervention is well-coordinated and timely.

The successful integration of ultra-low latency streaming over Wi-Fi for medical surgery has the potential to significantly improve surgical outcomes and expand access to life-saving procedures worldwide.

iWave, an embedded systems engineering and solutions company, designs and manufactures solutions for the Industrial, Medical, Automotive, and Avionics vertical markets. Building on a core competency of embedded expertise since 1999, iWave has built a strong portfolio of high-performance FPGA System on Modules, boards and solutions.

For more information feel free to contact iWave at mktg@iwave-global.com.

Copyright © 2022 iWave Systems Technologies Pvt. Ltd.