Chapter 4 -- Message-Passing Pro

KEY TERMS

collection communication -- 组通信

communicator -- 通信域

cyclic(or interleaved) -- 环状（或交叉）分配

embarrassingly parallel -- 令人满意的并行

rank -- 序号

Outline

Message-passing model

Message Passing Interface (MPI)

Coding MPI programs

Compiling MPI programs

Running MPI programs

Benchmarking MPI programs

Processes

Number is specified at start-up time

Remains constant throughout execution of program

All execute same program each has unique ID number

Alternately（交替） performs computations and communicates

Advantages of Message-passing Model

Gives programmer ability to manage the memory hierarchy(分级)

Portability to many architectures

Easier to create a deterministic program

Simplifies debugging