Problem used to illustrate synchronization issues and techniques for resolving them
In computer science, the dining philosophers problem is an example problem often used in concurrent algorithm design to illustrate synchronization issues and techniques for resolving them.
Five philosophers dine together at the same table. Each philosopher has their own plate at the table. There is a fork between each plate. The dish served is a kind of spaghetti which has to be eaten with two forks. Each philosopher can only alternately think and eat. Moreover, a philosopher can only eat their spaghetti when they have both a left and right fork. Thus two forks will only be available when their two nearest neighbors are thinking, not eating. After an individual philosopher finishes eating, they will put down both forks.
The problem is how to design a regimen (a concurrent algorithm) such that any philosopher will not starve; i.e., each can forever continue to alternate between eating and thinking, assuming that no philosopher can know when others may want to eat or think (an issue of incomplete information).
Problems
The problem was designed to illustrate the challenges of avoiding deadlock, a system state in which no progress is possible. To see that a proper solution to this problem is not obvious, consider a proposal in which each philosopher is instructed to behave as follows:
think unless the left fork is available; when it is, pick it up;
think unless the right fork is available; when it is, pick it up;
when both forks are held, eat for a fixed amount of time;
put the left fork down;
put the right fork down;
repeat from the beginning.
With these instructions, the situation may arise where each philosopher holds the fork to their left; in that situation, they will all be stuck forever, waiting for the other fork to be available: it is a deadlock.
These four conditions are necessary for a deadlock to occur: mutual exclusion (no fork can be simultaneously used by multiple philosophers), resource holding (the philosophers hold a fork while waiting for the second), non-preemption (no philosopher can take a fork from another), and circular wait (each philosopher may be waiting on the philosopher to their left). A solution must negate at least one of those four conditions. In practice, negating mutual exclusion or non-preemption somehow can give a valid solution, but most theoretical treatments assume that those assumptions are non-negotiable, instead attacking resource holding or circular waiting (often both).
Dijkstra's solution
Dijkstra's solution negates resource holding; the philosophers atomically pick up both forks or wait, never holding exactly one fork outside of a critical section. To accomplish this, Dijkstra's solution uses one mutex, one semaphore per philosopher and one state variable per philosopher. This solution is more complex than the resource hierarchy solution.[5][4] This is a C++20 version of Dijkstra's solution with Tanenbaum's changes:
#include<chrono>#include<iostream>#include<mutex>#include<random>#include<semaphore>#include<thread>constexprconstsize_tN=5;// number of philosophers (and forks)enumclassState{THINKING=0,// philosopher is THINKINGHUNGRY=1,// philosopher is trying to get forksEATING=2,// philosopher is EATING};size_tinlineleft(size_ti){// number of the left neighbor of philosopher i, for whom both forks are availablereturn(i-1+N)%N;// N is added for the case when i - 1 is negative}size_tinlineright(size_ti){// number of the right neighbor of the philosopher i, for whom both forks are availablereturn(i+1)%N;}Statestate[N];// array to keep track of everyone's both_forks_available statestd::mutexcritical_region_mtx;// mutual exclusion for critical regions for // (picking up and putting down the forks)std::mutexoutput_mtx;// for synchronized cout (printing THINKING/HUNGRY/EATING status)// array of binary semaphors, one semaphore per philosopher.// Acquired semaphore means philosopher i has acquired (blocked) two forksstd::binary_semaphoreboth_forks_available[N]{std::binary_semaphore{0},std::binary_semaphore{0},std::binary_semaphore{0},std::binary_semaphore{0},std::binary_semaphore{0}};size_tmy_rand(size_tmin,size_tmax){staticstd::mt19937rnd(std::time(nullptr));returnstd::uniform_int_distribution<>(min,max)(rnd);}voidtest(size_ti)// if philosopher i is hungry and both neighbors are not eating then eat{// i: philosopher number, from 0 to N-1if(state[i]==State::HUNGRY&&state[left(i)]!=State::EATING&&state[right(i)]!=State::EATING){state[i]=State::EATING;both_forks_available[i].release();// forks are no longer needed for this eat session}}voidthink(size_ti){size_tduration=my_rand(400,800);{std::lock_guard<std::mutex>lk(output_mtx);// critical section for uninterrupted printstd::cout<<i<<" is thinking "<<duration<<"ms\n";}std::this_thread::sleep_for(std::chrono::milliseconds(duration));}voidtake_forks(size_ti){{std::lock_guard<std::mutex>lk{critical_region_mtx};// enter critical regionstate[i]=State::HUNGRY;// record fact that philosopher i is State::HUNGRY{std::lock_guard<std::mutex>lk(output_mtx);// critical section for uninterrupted printstd::cout<<"\t\t"<<i<<" is State::HUNGRY\n";}test(i);// try to acquire (a permit for) 2 forks}// exit critical regionboth_forks_available[i].acquire();// block if forks were not acquired}voideat(size_ti){size_tduration=my_rand(400,800);{std::lock_guard<std::mutex>lk(output_mtx);// critical section for uninterrupted printstd::cout<<"\t\t\t\t"<<i<<" is eating "<<duration<<"ms\n";}std::this_thread::sleep_for(std::chrono::milliseconds(duration));}voidput_forks(size_ti){std::lock_guard<std::mutex>lk{critical_region_mtx};// enter critical regionstate[i]=State::THINKING;// philosopher has finished State::EATINGtest(left(i));// see if left neighbor can now eattest(right(i));// see if right neighbor can now eat// exit critical region by exiting the function}voidphilosopher(size_ti){while(true){// repeat foreverthink(i);// philosopher is State::THINKINGtake_forks(i);// acquire two forks or blockeat(i);// yum-yum, spaghettiput_forks(i);// put both forks back on table and check if neighbors can eat}}intmain(){std::cout<<"dp_14\n";std::jthreadt0([&]{philosopher(0);});// [&] means every variable outside the ensuing lambda std::jthreadt1([&]{philosopher(1);});// is captured by referencestd::jthreadt2([&]{philosopher(2);});std::jthreadt3([&]{philosopher(3);});std::jthreadt4([&]{philosopher(4);});}
The function test() and its use in take_forks() and put_forks() make the Dijkstra solution deadlock-free.
Resource hierarchy solution
This solution negates circular waiting by assigning a partial order to the resources (the forks, in this case), and establishes the convention that all resources will be requested in order, and that no two resources unrelated by order will ever be used by a single unit of work at the same time. Here, the resources (forks) will be numbered 1 through 5 and each unit of work (philosopher) will always pick up the lower-numbered fork first, and then the higher-numbered fork, from among the two forks he plans to use. The order in which each philosopher puts down the forks does not matter. In this case, if four of the five philosophers simultaneously pick up their lower-numbered forks, only the highest-numbered fork will remain on the table, so the fifth philosopher will not be able to pick up any fork. Moreover, only one philosopher will have access to that highest-numbered fork, so he will be able to eat using two forks. This can intuitively be thought of as having one "left-handed" philosopher at the table, who – unlike all the other philosophers – takes his fork from the left first.
While the resource hierarchy solution avoids deadlocks, it is not always practical, especially when the list of required resources is not completely known in advance. For example, if a unit of work holds resources 3 and 5 and then determines it needs resource 2, it must release 5, then 3 before acquiring 2, and then it must re-acquire 3 and 5 in that order. Computer programs that access large numbers of database records would not run efficiently if they were required to release all higher-numbered records before accessing a new record, making the method impractical for that purpose.[2]
The resource hierarchy solution is not fair. If philosopher 1 is slow to take a fork, and if philosopher 2 is quick to think and pick its forks back up, then philosopher 1 will never get to pick up both forks. A fair solution must guarantee that each philosopher will eventually eat, no matter how slowly that philosopher moves relative to the others.
The following source code is a C++11 implementation of the resource hierarchy solution for five philosophers. The sleep_for() function simulates the time normally spent with business logic.[6]
For GCC: compile with
g++src.cpp-std=c++11-lpthread
#include<iostream>#include<chrono>#include<mutex>#include<thread>#include<random>#include<ctime>usingnamespacestd;intmyrand(intmin,intmax){staticmt19937rnd(time(nullptr));returnuniform_int_distribution<>(min,max)(rnd);}voidphilosopher(intph,mutex&ma,mutex&mb,mutex&mo){for(;;){// prevent thread from terminationintduration=myrand(200,800);{// Block { } limits scope of locklock_guard<mutex>gmo(mo);cout<<ph<<" thinks "<<duration<<"ms\n";}this_thread::sleep_for(chrono::milliseconds(duration));{lock_guard<mutex>gmo(mo);cout<<"\t\t"<<ph<<" is hungry\n";}lock_guard<mutex>gma(ma);// sleep_for() Delay before seeking second fork can be added here but should not be required.lock_guard<mutex>gmb(mb);duration=myrand(200,800);{lock_guard<mutex>gmo(mo);cout<<"\t\t\t\t"<<ph<<" eats "<<duration<<"ms\n";}this_thread::sleep_for(chrono::milliseconds(duration));}}intmain(){cout<<"dining Philosophers C++11 with Resource hierarchy\n";mutexm1,m2,m3,m4,m5;// 5 forks are 5 mutexesmutexmo;// for proper output// 5 philosophers are 5 threadsthreadt1([&]{philosopher(1,m1,m2,mo);});threadt2([&]{philosopher(2,m2,m3,mo);});threadt3([&]{philosopher(3,m3,m4,mo);});threadt4([&]{philosopher(4,m4,m5,mo);});threadt5([&]{philosopher(5,m1,m5,mo);});// Force a resource hierarchyt1.join();// prevent threads from terminationt2.join();t3.join();t4.join();t5.join();}
Arbitrator solution
Another approach is to guarantee that a philosopher can only pick up both forks or none by introducing an arbitrator to replace circular waiting, e.g., a waiter. In order to pick up the forks, a philosopher must ask permission of the waiter. The waiter gives permission to only one philosopher at a time until the philosopher has picked up both of his forks. Putting down a fork is always allowed. The waiter can be implemented as a mutex.
In addition to introducing a new central entity (the waiter), this approach can result in reduced parallelism: if a philosopher is eating and one of his neighbors is requesting the forks, all other philosophers must wait until this request has been fulfilled even if forks for them are still available.
Limiting the number of diners in the table
A solution presented by William Stallings[7] is to allow a maximum of n-1 philosophers to sit down at any time. The last philosopher would have to wait (for example, using a semaphore) for someone to finish dining before he "sits down" and requests access to any fork. This negates circular wait, guaranteeing at least one philosopher may always acquire both forks, allowing the system to make progress.
Chandy/Misra solution
In 1984, K. Mani Chandy and J. Misra[8] proposed a different solution to the dining philosophers problem to allow for arbitrary agents (numbered P1, ..., Pn) to contend for an arbitrary number of resources, unlike Dijkstra's solution. It is also completely distributed and requires no central authority after initialization. However, it violates the requirement that "the philosophers do not speak to each other" (due to the request messages).
For every pair of philosophers contending for a resource, create a fork and give it to the philosopher with the lower ID (n for agent Pn). Each fork can either be dirty or clean. Initially, all forks are dirty.
When a philosopher wants to use a set of resources (i.e., eat), said philosopher must obtain the forks from his contending neighbors. For all such forks the philosopher does not have, he sends a request message.
When a philosopher with a fork receives a request message, he keeps the fork if it is clean, but give it up when it is dirty. If the philosopher sends the fork over, he cleans the fork before doing so.
After a philosopher is done eating, all his forks become dirty. If another philosopher had previously requested one of the forks, the philosopher that has just finished eating cleans the fork and sends it.
This solution also allows for a large degree of concurrency, and will solve an arbitrarily large problem.
It also solves the starvation problem. The clean/dirty labels act as a way of giving preference to the most "starved" processes, and a disadvantage to processes that have just "eaten". One could compare their solution to one where philosophers are not allowed to eat twice in a row without letting others use the forks in between. Chandy and Misra's solution is more flexible than that, but has an element tending in that direction.
In their analysis, they derive a system of preference levels from the distribution of the forks and their clean/dirty states. They show that this system may describe a directed acyclic graph, and if so, the operations in their protocol cannot turn that graph into a cyclic one. This guarantees that deadlock cannot occur by negating circular waiting. However, if the system is initialized to a perfectly symmetric state, like all philosophers holding their left side forks, then the graph is cyclic at the outset, and their solution cannot prevent a deadlock. Initializing the system so that philosophers with lower IDs have dirty forks ensures the graph is initially acyclic.
^ abTanenbaum, Andrew S. (2006), Operating Systems - Design and Implementation, 3rd edition [Chapter: 2.3.1 The Dining Philosophers Problem], Pearson Education, Inc.
Lehmann, D. J., Rabin M. O, (1981). On the Advantages of Free Choice: A Symmetric and Fully Distributed Solution to the Dining Philosophers Problem. Principles Of Programming Languages 1981 (POPL'81), pp. 133–138.
Wot No Chickens? – Peter H. Welch proposed the Starving Philosophers variant that demonstrates an unfortunate consequence of the behaviour of Java thread monitors is to make thread starvation more likely than strictly necessary.