Distributed Memory and Processing

In computer science, distributed memory refers to a multiprocessor computer system in which each processor has its own private memory. In contrast, a shared memory multiprocessor offers a single memory space used by all processors.

Computational tasks can only operate on local data, and if remote data is required, the computational task must communicate with one or more remote processors. In contrast, a shared memory multiprocessor offers a single memory space used by all processors. Processors do not have to be aware where data resides, except that there may be performance penalties, and that race conditions are to be avoided.