查看GPU NUMA

[TOC]

参考：https://blog.csdn.net/dcrmg/article/details/78146797

[yangxue.chen@yz-gpu002 ~]$ lspci | grep -i nvidia
02:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX TITAN X] (rev a1)
02:00.1 Audio device: NVIDIA Corporation GM200 High Definition Audio (rev a1)
03:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX TITAN X] (rev a1)
03:00.1 Audio device: NVIDIA Corporation GM200 High Definition Audio (rev a1)
82:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX TITAN X] (rev a1)
82:00.1 Audio device: NVIDIA Corporation GM200 High Definition Audio (rev a1)
83:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX TITAN X] (rev a1)
83:00.1 Audio device: NVIDIA Corporation GM200 High Definition Audio (rev a1)

前边的序号 "02:00.0"是显卡的代号

[yangxue.chen@yz-gpu002 ~]$ lspci -v -s 02:00.0
02:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX TITAN X] (rev a1) (prog-if 00 [VGA controller])
        Subsystem: NVIDIA Corporation Device 1132
        Physical Slot: 2
        Flags: bus master, fast devsel, latency 0, IRQ 112, NUMA node 0
        Memory at cf000000 (32-bit, non-prefetchable) [size=16M]
        Memory at 23fe0000000 (64-bit, prefetchable) [size=256M]
        Memory at 23ff0000000 (64-bit, prefetchable) [size=32M]
        I/O ports at 6000 [size=128]
        [virtual] Expansion ROM at d0000000 [disabled] [size=512K]
        Capabilities: <access denied>
        Kernel driver in use: nvidia
        Kernel modules: nouveau, nvidia_drm, nvidia

NUMA 0

[yangxue.chen@yz-gpu002 ~]$ lspci -v -s 82:00.0
82:00.0 VGA compatible controller: NVIDIA Corporation GM200 [GeForce GTX TITAN X] (rev a1) (prog-if 00 [VGA controller])
        Subsystem: NVIDIA Corporation Device 1132
        Physical Slot: 8
        Flags: bus master, fast devsel, latency 0, IRQ 114, NUMA node 1
        Memory at fa000000 (32-bit, non-prefetchable) [size=16M]
        Memory at 27fe0000000 (64-bit, prefetchable) [size=256M]
        Memory at 27ff0000000 (64-bit, prefetchable) [size=32M]
        I/O ports at e000 [size=128]
        [virtual] Expansion ROM at fb000000 [disabled] [size=512K]
        Capabilities: <access denied>
        Kernel driver in use: nvidia
        Kernel modules: nouveau, nvidia_drm, nvidia

NUMA 1

只有一个 NUMA下的GPU才可以P2P

[yangxue.chen@yz-gpu002 ~]$ nvidia-smi
Mon Jan 14 09:57:51 2019
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 396.45                 Driver Version: 396.45                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX TIT...  Off  | 00000000:02:00.0 Off |                  N/A |
| 42%   83C    P2   163W / 250W |    793MiB / 12212MiB |     74%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX TIT...  Off  | 00000000:03:00.0 Off |                  N/A |
| 22%   33C    P8    16W / 250W |      0MiB / 12212MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   2  GeForce GTX TIT...  Off  | 00000000:82:00.0 Off |                  N/A |
| 22%   32C    P8    15W / 250W |      0MiB / 12212MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   3  GeForce GTX TIT...  Off  | 00000000:83:00.0 Off |                  N/A |
| 34%   76C    P2   154W / 250W |    793MiB / 12212MiB |     67%      Default |
+-------------------------------+----------------------+----------------------+

通过前面的代号，可以看到对应GPU信息