Distributed and Parallel Systems Term Paper Example | Topics and Well Written Essays - 2250 words

Distributed and Parallel Systems - Term Paper Example A parallel system is a computer with more than one processor for parallel processing. Although there are many kinds of parallel computers, they are basically distinguished by the kind of interconnection between processor, known as processing elements (PES), and the memory. One major way to classify parallel computers is based on their memory architectures. Shared memory based parallel computing systems have multiple processors that access all available memory as a global address space. Distributed system is a network of a set of asynchronously connected computing devices. Communication in DS is either through shared memory or through messages. In wide-spread distributed systems, work and information are physically distributed, implying that computing needs should be distributed. Along with improvement in response time, this system contributes to offering a local control over data. With this solid background of multiprocessor systems, parallel computing, distributed systems and shared memory; speed-up performance law such as the Amdahl's law was introduced to throw light on algorithm design for speed-up and operational efficiency of parallel system. Concurrency is another important factor which enables distributed systems to share memory; and to better understand its execution, Dining philosophers' algorithm Bully's algorithm and Logical clocks were introduced. 2. Amdahl's Law The memory organization of parallel system also has a profound impact on algorithm design. In systems in which memory