Question :
Suppose you want to perform two sums: one is a sum of 10 scalar variables, and one is a matrix sum of a pair of two-dimensional arrays, with dimensions 10 by 10. What speed-up do you get with 10 versus 100 processors?
Next, calculate the speedups assuming the matrices grow to 100 by 100. Which are strong scaling and which are weak scaling in this exercise?