obscura/nccl-tests
1
0
Fork 0
mirror of https://github.com/NVIDIA/nccl-tests.git synced 2026-09-27 20:47:25 +00:00
Code Issues Packages Projects Releases Wiki Activity

doc: add all2all factor

Browse Source
This commit is contained in:
Oren
2024-07-24 22:55:00 -04:00
committed by GitHub
parent d028efcf35
commit c6eb15875f
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
doc/PERFORMANCE.md
+1
View File
@@ -140,5 +140,6 @@ To obtain a bus bandwidth which should be independent of the number of ranks _n_
* AllGather : (_n_-1)/_n_ * AllGather : (_n_-1)/_n_
* Broadcast : 1 * Broadcast : 1
* Reduce : 1 * Reduce : 1
* AlltoAll: (_n_-1)/_n_
The bus bandwidth should reflect the speed of the hardware bottleneck : NVLink, PCI, QPI, or network. The bus bandwidth should reflect the speed of the hardware bottleneck : NVLink, PCI, QPI, or network.