Parallel Systems Resources

These are various useful pointers to information related to the proposed topics. Here is a "table of contents":

MPI (Message Passing Interface)

Parallel tools and algorithms
Distributed Algorithms (and pointers to systems, conferences, etc.)
Practical dynamic load balancing
Bill McColl Home Page (Publications on making parallel programming more practical, BSP, chair of Oxford Parallel group (industry-academia)
BSP Worldwide Organization for development of BSP as both accurate complexity model and for programming tools providing architecture-independent interface to parallel programming
Jop Sibeyn Home Page (Publications on practical parallel list ranking, practical issues of routing, etc.)

MPI (WWW, Argonne)
- MPI man pages
- MPI FAQ
- MPI standard
- MPI-2 standard (includes ability to spawn new processes)
- ACE: High-level portable socket library w/ threads, Win32, etc.
MPICH implementation
MPI FAQ
LAM implementation of MPI (or ftp site, including linux binaries, misc. utils, etc.)
MPINU (subdirectory of TOP-C distribution, with MPI subset; also, see TOP-C)

Note, also the hardware section.

Note, also Memory Consistency Models for SMP.

CILK (MIT) (from MIT), with application for FFTW: "Fastest Fourier Transform in the West"
ABC++ Home Page (IBM Parallel Class Library for C++, supporting parametric shared regions)
B.U. tutorial based on SGI Power Challenger SMP machines
SGI Origin 2000 (and hardware description; largest SMP machine today, example of CC-NUMA)

TOP-C and related software (includes MPINU (MPI subset) and example code for Gaussian elimination, etc.)
- README for TOP-C
- topc.tar.gz (ftp download)
High Performance FORTRAN (not necessarily runnable here at CCS)

HPC+ (data-oriented and more -- support for Parallel Standard Template Library, with standard parallel algorithms implented)

"An Evaluation of Memory Consistency Models for Shared-Memory Systems with ILP" (excellent survey by Pai, Ranganathan, Adve and Harton
"Shared Memory Consistency Models: A Tutorial", Adve and Gharachorloo Computer, Vol. 29, No. 12, December 1996, pp. 66-76 (and locally stored abstract)
"The Shared Regions approach to software cache coherence on multiprocessors", Sandhu, Gamsa and Zhou, In Proceedings of the ACM Symposium on Principles and Practices of Parallel Programming, May 1993, pp. 229-238 (see also implementation)

Table of Contents