Parallel Overhead
The amount of time needed to organize parallel tasks, as opposed to undertaking useful work. Parallel overhead may comprise factors like:
1) Task start-up time
2) Synchronisations
3) Data communications
Software overhead inflicted by libraries, tools, parallel compilers, operating system etc.