Summary of Tradeoffs

• Different goals often have conflicting demands

  • Load Balance
    • fine-grain tasks
    • random or dynamic assignment
  • Communication
    • usually coarse grain tasks
    • decompose to obtain locality: not random/dynamic
  • Extra Work
    • coarse grain tasks
    • simple assignment
  • Communication Cost:
    • big transfers: amortize overhead and latency
    • small transfers: reduce contention

Previous slide

Back to first slide

View graphic version