v1.43.0: GKE and networking enhancements

[ighosh98]

What's Changed

Key New Features 🎉

• add support for kueue v0.9.0 to enable Topology Aware Scheduling by @ighosh98 in add support for kueue v0.9.0 to enable TAS #3277
• RDMA networking and multi-zone cluster support for GKE A3-Ultra by @annuay-google in Cluster changes for a3u #3299
• Improved reservations support for GKE A3-Ultra by @annuay-google in Node pool changes a3u #3298

Module Improvements 🔨

• Add cloud rdma drivers into startup script module by @abbas1902 in Add cloud rdma drivers into startup script module #3289
• add support for enable DCGM monitoring in GKE by @chengcongdu in add support for enable DCGM monitoring in GKE #3279
• add GKE support for node local dns by @chengcongdu in add GKE support for node local dns #3280
• Update topology-scheduler-scripts.yaml by @thisSIDEofRANDOM in Update topology-scheduler-scripts.yaml #3286

Improvements 🛠

• add firewall to allow tcp traffic for parallelstore by @chengcongdu in add firewall to allow tcp traffic for parallelstore #3262
• Allow specifying GKE's system node pool disk properties by @ankitkinra in Allow specifying GKE's system node pool disk properties #3268
• Adds Cluster Toolkit Dockerfile for backend integration with XPK by @RachaelSTamakloe in Adds Cluster Toolkit Dockerfile for backend integration with XPK #3237
• Add cluster and hostname as cloud ops labels by @abbas1902 in Add cluster and hostname as cloud ops labels #3163
• Print job detail for gke-storage-parallelstore integration test by @mohitchaurasia91 in Print job detail for gke-storage-parallelstore integration test #3264
• Add max_pods_per_node for GKE cluster and nodepool by @pawloch00 in Add max_pods_per_node for GKE cluster and nodepool #3197
• Fix image-building.md link by @jemish-google in Fix image-building.md link #3287
• Updating Cluster Toolkit Dockerfile README by @RachaelSTamakloe in Updating Cluster Toolkit Dockerfile README #3290
• Updating Go version in Cluster Toolkit Dockerfile by @RachaelSTamakloe in Updating Go version in Cluster Toolkit Dockerfile #3301
• Add Integration Test to Cluster Toolkit Dockerfile by @RachaelSTamakloe in Add Integration Test to Cluster Toolkit Dockerfile #3302
• XPK blueprint updates to make it more compatible with the tool by @ankitkinra in XPK blueprint updates to make it more compatible with the tool #3192
• expanding subnetwork_cidr_suffix by @ighosh98 in expanding subnetwork_cidr_suffix #3304
• Updating Slurm-GCP to 6.8.6 by @cdunbar13 in Updating Slurm-GCP to 6.8.6 #3336

Bug fixes 🐞

• Revert "update a3 machines local ssd to use nvme instead of scsi for better performance" by @chengcongdu in Revert "update a3 machines local ssd to use nvme instead of scsi for better performance" #3272
• remove GKE reservation validation for local ssd NVMe/CSCI interface by @chengcongdu in remove GKE reservation validation for local ssd NVMe/CSCI interface #3281

New Contributors

• @pawloch00 made their first contribution in Add max_pods_per_node for GKE cluster and nodepool #3197
• @thisSIDEofRANDOM made their first contribution in Update topology-scheduler-scripts.yaml #3286
• @jemish-google made their first contribution in Fix image-building.md link #3287

Full Changelog: v1.42.0...v1.43.0

---

This discussion was created from the release v1.43.0: GKE and networking enhancements.