Holoscan SDK v0.5.1
Release Artifacts
- 🐋 Docker container: tag
v0.5.1-dgpuandv0.5.1-igpu - 🐍 Python wheel:
holoscan==0.5.1 - 📦️ Debian package: tags
v0.5.1-amd64andv0.5.1-arm64 - 📕 Documentation
Release Notes
Additions
This release of the Holoscan SDK provide the following additions:
Support for the NVIDIA IGX Orin Developer Kit
The Holoscan SDK 0.5.1 adds support for the NVIDIA IGX Orin Developer Kit in both iGPU or dGPU modes. That support is enabled by the release of the Holopack 2.0 Developer Preview now available through the latest version of the SDK Manager. Python wheels and Debian packages for the arm64/aarch64 architecture support both iGPU and dGPU. Starting with 0.5.1, the Holoscan container on NGC now offers two separate tags, one for iGPU and one for dGPU.
Lazy loading of python modules
Python users might be interested in using the Holoscan SDK without requiring to import every operators, which requires to have all their dependencies available in the python environment (example: TensorRT...). With 0.5.1, a user can create an Holoscan application by only importing the modules they require, for example, importing holoscan.core only and not holoscan.operators.
Note: in 0.6.0, the operators will be broken down in separate modules to offer further importing granularity and lower dependency requirements.
ffmpeg support in the Holoscan container on NGC
Facilitates conversions of standard video formats to gxf entities in the Holoscan containers (example)
Improved L4T Compute Assist container
The L4T Compute Assist container - used to run compute workloads on the iGPU of a developer kit configured for dGPU - now includes the deviceQuery executable to facilitate validating its configuration, along with updated troubleshooting steps.
Issues Fixed
| Issue | Description |
|---|---|
| - | Fixed instructions in documentation for datasets download and debian package installation |
Supported Platforms
Note: This release is intended for use with the listed platforms only. NVIDIA does not provide support for this release on products other than those listed below.
| Platform | OS |
|---|---|
| NVIDIA Clara AGX Developer Kit | - NVIDIA Holopack 1.2 (L4T r34.1.2) - Meta Tegra Holoscan 0.5.0 (L4T r35.2.1) |
| NVIDIA IGX Orin [ES] Developer Kit | - NVIDIA Holopack 1.2 (L4T r34.1.2) - Meta Tegra Holoscan 0.5.0 (L4T r35.2.1) |
| NVIDIA IGX Orin Developer Kit | - NVIDIA Holopack 2.0 (L4T r35.4.0) - Meta Tegra Holoscan 0.5.1 (L4T r35.3.1) |
x86_64 platforms with Ampere GPU or above(tested with RTX6000 and A6000) |
Ubuntu 20.04 |
Known Issues
This section supplies details about issues discovered during development and QA but not resolved in this release.
| Issue | Description |
|---|---|
| 3878494 | Inference fails after tensorrt engine file is first created using BlockMemoryPool. Fix available in TensorRT 8.4.1. Use UnboundedAllocator as a workaround. |
| 3762996 | nvidia-peermem.ko fails to load using insmod on Holoscan devkits in dGPU mode. Install nvidia-peer-memory following the RDMA instructions in the Holoscan SDK User Guide. |
| 3655489 | Installing dGPU drivers can remove nvgpuswitch.py script from the executable search path. Explicitly including /opt/nvidia/l4t-gputools/bin in the PATH environment variable ensures this script can be found for execution. |
| 3599303 | Linux kernel is not built with security hardening flags. Future releases will include a Linux kernel built with security hardening flags. |
| 3633688 | RDMA on the NVIDIA IGX Orin [ES] Developer Kit (holoscan-devkit) is not functional. PCIe switch firmware update fixed the issue. RDMA for the Clara AGX Developer Kit is functional and unaffected by this issue. |
| 3881725 | VK_ERROR_INITIALIZATION_FAILED with segmentation fault while running High-Speed Endoscopy gxf/cpp app. Fix available in CUDA drivers 520. Workaround implemented in v0.4 to retry automatically. |
| 4048062 | Warning or error when deleting TensorRT runtime ahead of deserialized engines for some versions of TensorRT |
| 4036186 | H264 encoder/decoder are not supported on iGPU |
| 4047688 | H264 applications are not able to run in the arm64 dGPU container |
| 4101714 | --privileged permission required to run rendering applications from the Holoscan iGPU container on IGX Orin Developer Kit with Holopack 2.0 DP |
| 4116861 | H264 video encoding fails on IGX Orin Developer Kit with Holopack 2.0 DP |