Show Username & full process command with nvidia-smi

nvidia-smi-process-name.md

This script is based one nvidia-smi, but it can show complete process names and commands.

nvidia-smi |tr -s ' '|grep -Eo "| [0123] [0-9]{3,} .*"|awk -F' ' '{system("s=$(cat /proc/"$2"/cmdline| tr \"\\0\" \" \");u=$(ps -o uname= -p "$2");echo "$1"sep$u sep"$5"sep$s" ) }'|sed -e 's/sep/\t/g'

The output is like this

0   root    5825MiB python playground2.py
0   root    6319MiB /opt/conda/bin/python -u /cail/model.py
1   root    137MiB  python playground2.py
1   root    273MiB  /usr/bin/python -u /sentsim/cli_predict.py
1   root    4735MiB /opt/conda/bin/python -u /cail/model.py
1   root    199MiB  /usr/bin/python -u /sentsim/train.py
2   root    137MiB  python playground2.py
2   root    4735MiB /opt/conda/bin/python -u /cail/model.py

As a compare, the output of nvidia-smi is

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      3296      C   python                                      5825MiB |
|    0     21266      C   /opt/conda/bin/python                       6319MiB |
|    1      3296      C   python                                       137MiB |
|    1      8063      C   /usr/bin/python                              273MiB |
|    1     21266      C   /opt/conda/bin/python                       4735MiB |
|    1     30439      C   /usr/bin/python                              199MiB |
|    2      3296      C   python                                       137MiB |
|    2     21266      C   /opt/conda/bin/python                       4735MiB |
+-----------------------------------------------------------------------------+

That's extremely helpful, thanks

Awesome. thanks

That's extremely helpful, thanks

Thanks so much for the little script @padeoe! I also prefer simpler tools over nvitools though it is cool.

For zsh users, instead of making an alias (which would be a pain because of all the quotes) you can simply make a function.

function nvidia-smi-pro() {
    nvidia-smi && (nvidia-smi |tr -s ' '|grep -Eo "| [0123456789]+ N/A N/A [0-9]{3,} .*"|awk -F' ' '{system("s=$(cat /proc/"$4"/cmdline| tr \"\\0\" \" \");u=$(ps -o uname= -p "$4");echo "$1"sep"$4"sep$u sep"$7"sep$s" ) }'|sed 's/sep/\t/g')
}