Contents

• 1. Introduction
• 2. Supported GPUs
• 3. Supported Configurations
• 4. Virtualization
• 5. Concepts
  • 5.1. Terminology
  • 5.2. Partitioning
  • 5.3. CUDA Concurrency Mechanisms
• 6. Deployment Considerations
  • 6.1. System Considerations
  • 6.2. Application Considerations
• 7. MIG Device Names
  • 7.1. Device Enumeration
  • 7.2. CUDA Device Enumeration
• 8. Supported MIG Profiles
  • 8.1. RTX PRO 6000 Blackwell MIG Profiles
  • 8.2. A30 MIG Profiles
  • 8.3. A100 MIG Profiles
  • 8.4. H100 MIG Profiles
  • 8.5. H200 MIG Profiles
• 9. Getting Started with MIG
  • 9.1. Prerequisites
  • 9.2. Enable MIG Mode
    • 9.2.1. GPU Reset on Hopper+ GPUs
    • 9.2.2. GPU Reset on NVIDIA Ampere Architecture GPUs
    • 9.2.3. Driver Clients
  • 9.3. List GPU Instance Profiles
  • 9.4. Creating GPU Instances
    • 9.4.1. Instance Geometry
  • 9.5. Running CUDA Applications on Bare-Metal
    • 9.5.1. GPU Instances
    • 9.5.2. GPU Utilization Metrics
    • 9.5.3. Compute Instances
  • 9.6. Destroying GPU Instances
  • 9.7. Monitoring MIG Devices
  • 9.8. MIG with CUDA MPS
    • 9.8.1. Workflow
    • 9.8.2. Configure GPU Instances
    • 9.8.3. Set Up the MPS Control Daemons
    • 9.8.4. Launch the Application
    • 9.8.5. A Complete Example
  • 9.9. Running CUDA Applications as Containers
    • 9.9.1. Install Docker
    • 9.9.2. Install NVIDIA Container Toolkit
    • 9.9.3. Running Containers
  • 9.10. MIG with Kubernetes
  • 9.11. MIG with Slurm
• 10. Device Nodes and Capabilities
  • 10.1. System Level Interface
    • 10.1.1. /dev Based nvidia-capabilities
    • 10.1.2. /proc based nvidia-capabilities (Deprecated)
• 11. Notices
  • 11.1. Notice
  • 11.2. OpenCL
  • 11.3. Trademarks