Collective Communication I

2. MPI Routines
  • Barrier synchronization
  • Broadcast from one member to all other members
  • Gather data from an array spread across processes into one array
  • Scatter data from one member to all members
  • All-to-all exchange of data
  • Global reduction (e.g., sum, min of "common" data elements)
  • Scan across all members of a communicator