We have already mentioned some issues related to the performance of parallel programs:
- Message-passing libraries
- Performance characteristics of the switch
- Latency, the overhead required to send the first byte of a message
- Bandwidth, the transfer rate of the switch
- Parallel I/O file systems
Other important topics, which will be discussed next, are:
- Parallel programming models (SPMD vs. Master/Worker)
- Modeling communications overhead
