Skip to content

Holoscan SDK v0.5.0

Compare
Choose a tag to compare
@agirault agirault released this 03 Apr 14:26
· 12 commits to main since this release

Release Artifacts

Release Notes

New Features

This release of the Holoscan SDK along with additions to HoloHub provide the following main features:

H264 encoder/decoder support

Operators to support H264 bitstream accelerated encoder and decoder were added to HoloHub, as illustrated by two new applications: h264_video_decode and h264_endoscopy_tool_tracking.

iGPU compute support on Holoscan Developer Kits

The L4T Compute Assist container is now available on NGC to perform computation on the integrated GPU (iGPU) of Holoscan Developer Kits configured to use their discrete GPU (dGPU), allowing to run workloads on both GPUs in parallel.

Use Holoscan operators in GXF applications

Infrastructure and documentation were added to wrap Holoscan operators as GXF codelets so they can be used by other frameworks which use GXF extensions.

x86_64 physical I/O support

The Holoscan SDK now officially support physical I/O on x86_64 platforms. The High Speed endoscopy application on HoloHub has been tested with Rivermax/GPU Direct RDMA support and offers similar performances as previously reported with the Holoscan Developer Kits.

Depth-map rendering

The Holoscan SDK visualization module (referred to as Holoviz) adds depth-map rendering capabilities to support displaying inference results with depth information.

New examples

The Holoscan SDK now provides a new suite of examples with associated step-by-step documentation to better introduce users to the SDK, taking them from a Hello World example to an application that deploys an ultrasound segmentation inference. Additional examples are also available to demonstrate how to integrate sensors and third-party frameworks into their workflow.

Changes from previous release

  • All sample applications along with domain specific operators were migrated from the Holoscan SDK
    to HoloHub.
  • Most operators have been transitioned to native implementations.

Issues Fixed

Issue Description
3834424 Ultrasound segmentation application is not functional on NVIDIA IGX Orin [ES] Developer Kit with iGPU configuration in deployment stack
3842899 High-Speed Endoscopy application is not supported in deployment stack
3897810 Applications not working on x86_64 systems with multiple GPUs
3936290 Cannot run exclusive display from docker container

Supported Platforms

Note: This release is intended for use with the listed platforms only. NVIDIA does not provide support for this release on products other than those listed below.

Platform OS
NVIDIA Clara AGX Developer Kit - NVIDIA Holopack 1.2 (L4T r34.1.2)
- Meta Tegra Holoscan 0.5.0 (L4T r35.2.1)
NVIDIA IGX Orin [ES] Developer Kit - NVIDIA Holopack 1.2 (L4T r34.1.2)
- Meta Tegra Holoscan 0.5.0 (L4T r35.2.1)
NVIDIA IGX Orin Developer Kit Meta Tegra Holoscan 0.5.0 (L4T r35.2.1)
x86_64 platforms with Ampere GPU or above
(tested with RTX6000 and A6000)
Ubuntu 20.04

Known Issues

This section supplies details about issues discovered during development and QA but not resolved in this release.

Issue Description
3878494 Inference fails after tensorrt engine file is first created using BlockMemoryPool. Fix available in TensorRT 8.4.1. Use UnboundedAllocator as a workaround.
3762996 nvidia-peermem.ko fails to load using insmod on Holoscan devkits in dGPU mode. Install nvidia-peer-memory following the RDMA instructions in the Holoscan SDK User Guide.
3655489 Installing dGPU drivers can remove nvgpuswitch.py script from the executable search path. Explicitly including /opt/nvidia/l4t-gputools/bin in the PATH environment variable ensures this script can be found for execution.
3599303 Linux kernel is not built with security hardening flags. Future releases will include a Linux kernel built with security hardening flags.
3633688 RDMA on the NVIDIA IGX Orin [ES] Developer Kit (holoscan-devkit) is not functional. PCIe switch firmware update fixed the issue. RDMA for the Clara AGX Developer Kit is functional and unaffected by this issue.
3881725 VK_ERROR_INITIALIZATION_FAILED with segmentation fault while running High-Speed Endoscopy gxf/cpp app. Fix available in CUDA drivers 520. Workaround implemented in v0.4 to retry automatically.
4048062 Warning or error when deleting TensorRT runtime ahead of deserialized engines for some versions of TensorRT
4036186 H264 encoder/decoder are not supported on iGPU
4047688 H264 applications are missing dependencies (nvidia-l4t-multimedia-utils) to run in the arm64 dGPU container