nvidia-smi

Aid the management and monitoring of NVIDIA GPU devices. More information: https://developer.nvidia.com/nvidia-system-management-interface.

• Display information on all available GPUs and processes using them:

nvidia-smi

• Display more detailed GPU information:

nvidia-smi --query

• Monitor overall GPU usage with 1-second update interval:

nvidia-smi dmon