Contents

NVIDIA Container Toolkit

Contents
GPUsCompute CapabilityArchitecture
GeForce RTX 40908.9Ada Lovelace
GeForce RTX 509012.0Blackwell
L40/L40S8.9Ada Lovelace
A800/A1008.0Ampere
H800/H100/H2009.0Hopper
B200/B300/GB20010.0Blackwell
Jetson AGX Orin8.7Ampere
Jetson AGX Thor?Blackwell

https://docs.nvidia.com/deeplearning/cudnn/backend/latest/reference/support-matrix.html#cudnn-cuda-hardware-versions

  • NVIDIA Drvier: >=570.26
  • CUDA: 12.8 Update 1
  • cuDNN: 9.8.0
  • Distribution: Ubuntu 24.04.z (z <= 1) LTS
  • TensorRT: 10.9
  • TensorRT-LLM: 0.20.0rc0
  • Python: 3.12
  • PyTorch: 2.7.0

SM_100 SM_101 SM_120

References