Releases: nvidia-holoscan/holoscan-sdk
Holoscan SDK v0.5.0
Release Artifacts
- 🐋 Docker container: tag
v0.5.0 - 🐍 Python wheel:
holoscan==0.5.0 - 📦️ Debian package: tags
v0.5.0-amd64andv0.5.0-arm64 - 📕 Documentation
Release Notes
New Features
This release of the Holoscan SDK along with additions to HoloHub provide the following main features:
H264 encoder/decoder support
Operators to support H264 bitstream accelerated encoder and decoder were added to HoloHub, as illustrated by two new applications: h264_video_decode and h264_endoscopy_tool_tracking.
iGPU compute support on Holoscan Developer Kits
The L4T Compute Assist container is now available on NGC to perform computation on the integrated GPU (iGPU) of Holoscan Developer Kits configured to use their discrete GPU (dGPU), allowing to run workloads on both GPUs in parallel.
Use Holoscan operators in GXF applications
Infrastructure and documentation were added to wrap Holoscan operators as GXF codelets so they can be used by other frameworks which use GXF extensions.
x86_64 physical I/O support
The Holoscan SDK now officially support physical I/O on x86_64 platforms. The High Speed endoscopy application on HoloHub has been tested with Rivermax/GPU Direct RDMA support and offers similar performances as previously reported with the Holoscan Developer Kits.
Depth-map rendering
The Holoscan SDK visualization module (referred to as Holoviz) adds depth-map rendering capabilities to support displaying inference results with depth information.
New examples
The Holoscan SDK now provides a new suite of examples with associated step-by-step documentation to better introduce users to the SDK, taking them from a Hello World example to an application that deploys an ultrasound segmentation inference. Additional examples are also available to demonstrate how to integrate sensors and third-party frameworks into their workflow.
Changes from previous release
- All sample applications along with domain specific operators were migrated from the Holoscan SDK
to HoloHub. - Most operators have been transitioned to native implementations.
Issues Fixed
| Issue | Description |
|---|---|
| 3834424 | Ultrasound segmentation application is not functional on NVIDIA IGX Orin [ES] Developer Kit with iGPU configuration in deployment stack |
| 3842899 | High-Speed Endoscopy application is not supported in deployment stack |
| 3897810 | Applications not working on x86_64 systems with multiple GPUs |
| 3936290 | Cannot run exclusive display from docker container |
Supported Platforms
Note: This release is intended for use with the listed platforms only. NVIDIA does not provide support for this release on products other than those listed below.
| Platform | OS |
|---|---|
| NVIDIA Clara AGX Developer Kit | - NVIDIA Holopack 1.2 (L4T r34.1.2) - Meta Tegra Holoscan 0.5.0 (L4T r35.2.1) |
| NVIDIA IGX Orin [ES] Developer Kit | - NVIDIA Holopack 1.2 (L4T r34.1.2) - Meta Tegra Holoscan 0.5.0 (L4T r35.2.1) |
| NVIDIA IGX Orin Developer Kit | Meta Tegra Holoscan 0.5.0 (L4T r35.2.1) |
x86_64 platforms with Ampere GPU or above(tested with RTX6000 and A6000) |
Ubuntu 20.04 |
Known Issues
This section supplies details about issues discovered during development and QA but not resolved in this release.
| Issue | Description |
|---|---|
| 3878494 | Inference fails after tensorrt engine file is first created using BlockMemoryPool. Fix available in TensorRT 8.4.1. Use UnboundedAllocator as a workaround. |
| 3762996 | nvidia-peermem.ko fails to load using insmod on Holoscan devkits in dGPU mode. Install nvidia-peer-memory following the RDMA instructions in the Holoscan SDK User Guide. |
| 3655489 | Installing dGPU drivers can remove nvgpuswitch.py script from the executable search path. Explicitly including /opt/nvidia/l4t-gputools/bin in the PATH environment variable ensures this script can be found for execution. |
| 3599303 | Linux kernel is not built with security hardening flags. Future releases will include a Linux kernel built with security hardening flags. |
| 3633688 | RDMA on the NVIDIA IGX Orin [ES] Developer Kit (holoscan-devkit) is not functional. PCIe switch firmware update fixed the issue. RDMA for the Clara AGX Developer Kit is functional and unaffected by this issue. |
| 3881725 | VK_ERROR_INITIALIZATION_FAILED with segmentation fault while running High-Speed Endoscopy gxf/cpp app. Fix available in CUDA drivers 520. Workaround implemented in v0.4 to retry automatically. |
| 4048062 | Warning or error when deleting TensorRT runtime ahead of deserialized engines for some versions of TensorRT |
| 4036186 | H264 encoder/decoder are not supported on iGPU |
| 4047688 | H264 applications are missing dependencies (nvidia-l4t-multimedia-utils) to run in the arm64 dGPU container |
Holoscan SDK v0.4.1
Release Notes
Changes from previous release
- HoloPack: update to version 1.2
- Python: throw warnings instead of exceptions if a GXF extension cannot be loaded, to unblock execution if the operator using that extension is not needed by the application.
Issues Fixed
- NGC container: fix issue related to expired signing key preventing to call
apt update - Source: fix issues in Dockerfile related to missing pinned dependency and expired signing key
Please see the list of known issues below for more information.
Supported Platforms
Note: This release is intended for use with the listed platforms only. NVIDIA does not provide support for this release on products other than those listed below.
| Description | Supported Version |
|---|---|
| Supported NVIDIA® Tegra® Linux Driver Package (L4T) | NVIDIA® Holopack 1.2 -- R34.1.2 |
| Supported Jetson Platforms | Holoscan Developer Kits |
| Supported x86_64 Platforms | Ubuntu 20.04 with Ampere GPU or above (tested with RTX6000 and A6000) |
| Supported Software for Clara AGX Developer Kit with NVIDIA® RTX6000 and IGX Orin Developer Kit with NVIDIA® A6000 |
NVIDIA® Driver 510.73.08 CUDA 11.6.1 TensorRT 8.2.3 GXF 2.5 AJA NTV2 SDK 16.2 |
Known Issues
This section supplies details about issues discovered during development and QA but not resolved in this release.
| Issue | Description |
|---|---|
| 3878494 | Inference fails after tensorrt engine file is first created using BlockMemoryPool |
| 3762996 | nvidia-peermem.ko fails to load using insmod on Holoscan devkits in dGPU mode. Install nvidia-peer-memory following the RDMA instructions in the Holoscan SDK User Guide. |
| 3655489 | Installing dGPU drivers can remove nvgpuswitch.py script from the executable search path. Explicitly including /opt/nvidia/l4t-gputools/bin in the PATH environment variable ensures this script can be found for execution. |
| 3599303 | Linux kernel is not built with security hardening flags. Future releases will include a Linux kernel built with security hardening flags. |
| 3633688 | RDMA on the NVIDIA IGX Orin Developer Kit (holoscan-devkit) is not functional. PCIe switch firmware update fixed the issue. RDMA for the Clara AGX Developer Kit is functional and unaffected by this issue. |
| 3834424 | Ultrasound segmentation application is not functional on NVIDIA IGX Orin Developer Kit (holoscan-devkit) with iGPU configuration in deployment stack |
| 3842899 | High-Speed Endoscopy application is not supported in deployment stack. |
| 3881725 | VK_ERROR_INITIALIZATION_FAILED with segmentation fault while running High-Speed Endoscopy gxf/cpp app (workaround implemented in v0.4 and fix in available in 520 drivers) |
| 3897810 | Applications not working on x86_64 systems with multiple GPUs |
| 3936290 | Cannot run exclusive display from docker container |
Holoscan SDK v0.4
Release Notes
New Features
This new release of Holoscan SDK brings the following main features:
-
Python API
A new Python API which allows for rapid prototyping and deployment of AI workflows has been added. The python API is accessible through the provided container or source build as well as PyPi. -
Inference module
A new Holoscan Inference module (HoloInfer) has been added. The HoloInfer module facilitates designing and executing inference and processing applications through its APIs. -
Multi-AI Inference Extension
A Multi AI Inference codelet is provided, which takes multiple AI inference related parameters and can ingest multiple GXF messages and transmits multiple tensors as the output via a single GXF Transmitter. -
Native Operators using C++/Python APIs
The capability to write native operators in C++ and Python has been added and several sample Holoscan native operators are provided. -
FPGA Alpha-Blending
The FPGA Alpha-Blending using AJA capture card allows very-low latency passthrough of the input video to output, while blending the AI inference overlay directly on the input signal on the FPGA on AJA PCIe card.
Changes from previous release
- The container available from NGC has been renamed and now includes development tools.
Developers can build new applications in C++ and Python directly from the container. - Holoviz operator is now used for all pipelines and handles compositing, blending, and visualization of RGB or RGBA images, masks, geometric primitives and text. The operator also supports headless rendering and streaming the rendered images to an output.
- Along with the distribution of Python package on PyPi, this release includes pre-compiled Debian package available on NGC
Issues Fixed
- Handle incorrect DISPLAY env configuration in Holoviz (3772272)
Please see the list of known issues below for more information.
Supported Platforms
Note: This release is intended for use with the listed platforms only. NVIDIA does not provide support for this release on products other than those listed below.
| Description | Supported Version |
|---|---|
| Supported NVIDIA® Tegra® Linux Driver Package (L4T) | NVIDIA® Holopack 1.1 -- R34.1.2 |
| Supported Jetson Platforms | Holoscan Developer Kits |
| Supported x86 Platforms | Ubuntu 20.04 with Turing/Ampere GPU |
| Supported Software for Clara AGX Developer Kit with NVIDIA® RTX6000 and IGX Orin Developer Kit with NVIDIA® A6000 |
NVIDIA® Driver 510.73.08 CUDA 11.6.1 TensorRT 8.2.3 GXF 2.5 AJA NTV2 SDK 16.2 |
Known Issues
This section supplies details about issues discovered during development and QA but not resolved in this release.
| Issue | Description |
|---|---|
| 3878494 | Inference fails after tensorrt engine file is first created using BlockMemoryPool |
| 3762996 | nvidia-peermem.ko fails to load using insmod on Holoscan devkits in dGPU mode. Install nvidia-peer-memory following the RDMA instructions in the Holoscan SDK User Guide. |
| 3655489 | Installing dGPU drivers can remove nvgpuswitch.py script from the executable search path. Explicitly including /opt/nvidia/l4t-gputools/bin in the PATH environment variable ensures this script can be found for execution. |
| 3599303 | Linux kernel is not built with security hardening flags. Future releases will include a Linux kernel built with security hardening flags. |
| 3633688 | RDMA on the NVIDIA IGX Orin Developer Kit (holoscan-devkit) is not functional. PCIe switch firmware update fixed the issue. RDMA for the Clara AGX Developer Kit is functional and unaffected by this issue. |
| 3834424 | Ultrasound segmentation application is not functional on NVIDIA IGX Orin Developer Kit (holoscan-devkit) with iGPU configuration in deployment stack |
| 3842899 | High-Speed Endoscopy application is not supported in deployment stack. |
| 3881725 | VK_ERROR_INITIALIZATION_FAILED with segmentation fault while running High-Speed Endoscopy gxf/cpp app (workaround implemented in v0.4 and fix in available in 520 drivers) |
| 3897810 | Applications not working on x86_64 systems with multiple GPUs |
| 3936290 | Cannot run exclusive display from docker container |
Clara Holoscan Embedded SDK v0.3
Clara Holoscan Embedded SDK v0.2
Release notes in progress