Accelerating AllReduce with a Persistent Straggler
Li et al. [2014]Jialin Li, Naveen Kr Sharma, Dan RK Ports, and Steven D Gribble.Tales of the tail: Hardware, OS, and application-level sources of tail latency.InProceedings o... [25]Nvidia NVLink.Nvidia NVLink and NVSwitch, 2021.https://www.nvidia.com/en-us/data-center/nvlink/. Jouppi et al. [2023]Norman P. Jouppi, George Kurian, Sheng Li, Pete...