CS267: Lecture 14

Parallel Matrix Products

October 15, 2001

Lecturer: Kathy Yelick

Abstract

We explore the design space for dense matrix multiplication, including variations on data layout, communication models, and  

2001 Lecture Notes

PowerPoint, Postscript, PDF

Assignments

Homework 3: Conjugate Gradient due 11/7

Readings

  • Matrix multiplication case study from Ian Foster's book.
  • A 3D Approach to Parallel Matrix Multiplication, by R. C. Agarwal, S. M. Balle, F. G. Gustavson, M. Joshi, and P. Palkar.
  • Recursive Array Layouts and Fast Parallel Matrix Multiplication by S. Chatterjee, A. R. Lebeck, P. K. Patnala, and M. Thottethodi.
  • Cache-Oblivious Algorithms, by Matteo Frigo, Charles E. Leiserson, Harald Prokop, and Sridhar Ramachandran.
  • E. Elmroth and F. Gustavson. A New Much Faster and Simpler Algorithm for LAPACK DGELS.
    Report UMINF-00.23. September 2000. Submitted to BIT.
  •