MIMD/MPMD parallelism

Question

Assume that there is a globally shared data block that is being used by a set of machines in a cluster.

If it is a distributed memory model, say the whole structure is sent to every node in the cluster.

Each node in the cluster performs different operations to the parts of the shared data block in parallel.

My question is: can it be identified as a Multiple Instruction, Multiple Data (MIMD) model since the whole data block is shared by/transferred to every node in the cluster?

Answer 1

If you apply the same operation to different pieces of data then you have data-level parallelism, which according to Flynn's Taxonomy is equivalent to SIMD (Single Instruction, Multiple Data streams), typically applied in GPU processing.

Multiple Instruction, Multiple Data (MIMD) entail that different processors may be executing different instructions on different data.

So according to the definitions, the answer to your question is yes.