High Performance Computing 1
Distributed Memory Parallel Computer
•Problems need to be broken up into independent tasks with independent memory -- naturally matches a data based decomposition of problem using a “owner computes” rule
•
•Parallelization mostly at high granularity level controlled by user -- difficult for compilers/ automatic parallelization tools
•Computers are scalable to very large numbers of processors
•
•