7a25c57474
* master worker pattern * Update App.java * Adding new line to README.md * Adding new line to pom.xml * Adding new line to ArrayEquality.java * Adding new line to Input.java * Adding new line to Result.java * Adding new line to ArrayTransposeMasterWorker.java * Adding new line to ArrayTransposeMaster.java * Adding new line to ArrayTransposeWorker.java * Adding new line to Worker.java * Adding new line to ArrayInputTest.java * Adding new line ArrayTransposeMasterWorkerTest.java * Adding new line to ArrayResult.java * Review changes * Update README.md
layout, title, folder, permalink, categories, tags
| layout | title | folder | permalink | categories | tags | ||
|---|---|---|---|---|---|---|---|
| pattern | Master-Worker | master-worker-pattern | /patterns/master-worker-pattern/ | Centralised Parallel Processing |
|
Also known as
Master-slave or Map-reduce
Intent
Used for centralised parallel processing.
Applicability
This pattern can be used when data can be divided into multiple parts, all of which need to go through the same computation to give a result, which need to be aggregated to get the final result.
Explanation
In this pattern, parallel processing is performed using a system consisting of a master and some number of workers, where a master divides the work among the workers, gets the result back from them and assimilates all the results to give final result. The only communication is between the master and the worker - none of the workers communicate among one another and the user only communicates with the master to get the required job done. The master has to maintain a record of how the divided data has been distributed, how many workers have finished their work and returned a result, and the results themselves to be able to aggregate the data correctly.