High Performance Computing 1
Scalability
•Ignore communication of b (assume its there aready)
•Ignore effect of message size on communication
•To communicate, require n sends (rows of A) + 1 for the answer back, for each row, so total communication is n*(n+1) = n2 +n
•Total time of communication is
•      (n2 +n)*Tcomm