How Do I View the GPU Usage on a ModelArts Notebook Instance?

If you select GPU when creating a notebook instance, perform the following operations to view GPU usage:

1. Log in to the ModelArts console and perform the following operations:
   • New console: Choose Model Build > Notebook.
   • Old console: Choose Development Space > Notebook.
2. In the notebook list, locate the target notebook and click Access Environment in the Operation column. Then, in the Access Method dialog box, click Access on the right of JupyterLab Access.
3. In the Files tab of the Jupyter page, click New and select Terminal.
4. Run the following command to view GPU usage:

   nvidia-smi

5. Check which processes in the current notebook instance use GPUs.

   Method 1:

   python /modelarts/tools/gpu_processes.py

   The following figure shows the case that the current process is using GPUs.

   

   The following figure shows the case that the current process is not using GPUs.

   

   Method 2:

   Open /resource_info/gpu_usage.json and view the processes that are using GPUs.

   

   If no process is using GPUs, the file may be unavailable or empty.