| publication name | The Case for Network Coding for Collective Communication on HPC Interconnection Networks |
|---|---|
| Authors | Ahmed Shalaby, Ikki Fujiwara, Michihiro Koibuchi |
| year | 2015 |
| keywords | Interconnection networks; collective communication; network coding; high-performance computing. |
| journal | IEICE TRANSACTIONS on Information and Systems |
| volume | E98-D |
| issue | NO. 3 |
| pages | 661-670 |
| publisher | The Institute of Electronics, Information and Communication Engineers |
| Local/International | International |
| Paper Link | http://search.ieice.org/bin/summary.php?id=e98-d_3_661&category=D&lang=E&year=2015&abst= |
| Full paper | download |
| Supplementary materials | Not Available |
Abstract
SUMMARY Recently network bandwidth becomes a performance concern particularly for collective communication since bisection bandwidths of supercomputers become far less than their full bisection bandwidths. In this context we propose the use of a network coding technique to reduce the number of unicasts and the size of data transferred in latency-sensitive collective communications in supercomputers. Our proposed network coding scheme has a hierarchical multicasting structure with intra-group and inter-group unicasts. Quantitative analysis show that the aggregate path hop counts by our hierarchical network coding decrease as much as 94% when compared to conventional unicast-based multicasts. We validate these results by cycle-accurate network simulations. In 1,024-switch networks, the network reduces the execution time of collective communications as much as 70%. We also show that our hierarchical network coding is beneficial for any packet size.