V0.11.0 Release Plan

[cp5555]

Release Manager

@cp5555

Endgame

• Code freeze: Aug. 30, 2024
• Bug Bash date: Sept. 02, 2024
• Release date: Sept. 11, 2024

Main Features

SuperBench Improvement

1. • Add CUDA 12.4 dockerfile (Dockerfile - Add CUDA 12.4 dockerfile #619)
2. • Improve document (Docs - fix typos #628 and Docs - Add BibTeX in README and repo #632)
3. • Update omegaconf version to 2.3.0 (Update omegaconf version to 2.3.0 #631)
4. • Fix MSCCL build error in CUDA12.4 docker build pipeline (CI/CD - Fix MSCCL build error in CUDA12.4 docker build pipeline #633)
5. • Update Docker Exec Command for Persistent HPCX Environment (Bug Fix - Update Docker Exec Command for Persistent HPCX Environment #635)
6. • Use types-setuptools to replace types-pkg_resources (Use types-setuptools as types-pkg_resources is Yanked #637)
7. • Update Docker Exec Command for Persistent HPCX Environment (Bug Fix - Update Docker Exec Command for Persistent HPCX Environment #635)
8. • Fix bug of failure test and warning of pandas in data diagnosis (Bug Fix: Data Diagnosis - Fix bug of failure test and warning of pandas in data diagnosis #638)
9. • Remove pytest version constraint (<=7.4.4)

Micro-benchmark Improvement

1. • Add hipblasLt tuning to dist-inference cpp implementation (Benchmarks: Revise Code - Add hipblasLt tuning to dist-inference cpp implementation #616)
2. • Add support for NVIDIA L4/L40/L40s GPUs in gemm-flops (Benchmarks: Micro benchmarks - add support for NVIDIA L4/L40/L40s GPUs in gemm-flops #634)
3. • Upgrade mlc to v3.11 (Dockerfile - Upgrade mlc to v3.11 #620)
4. • Support cuDNN Backend API in cudnn-function.

Model Benchmark Improvement

1. Support VGG, LSTM, and GPT-2 small in TensorRT Inference Backend
2. Support VGG, LSTM, and GPT-2 small in ORT Inference Backend
3. Support more TensorRT parameters (Related to TensorRT parameter passing can be enhanced #366)

Result Analysis