Loop Tiling for Parallelism

2000
ISBN: 978-0-7923-7933-1
Verlag: Springer US

Buch, Englisch, Band 575, 256 Seiten, Format (B × H): 160 mm x 241 mm, Gewicht: 1260 g

Reihe: The Springer International Series in Engineering and Computer Science

Loop tiling, as one of the most important compiler optimizations, is beneficial for both parallel machines and uniprocessors with a memory hierarchy. This book explores the use of loop tiling for reducing communication cost and improving parallelism for distributed memory machines. The author provides mathematical foundations, investigates loop permutability in the framework of nonsingular loop transformations, discusses the necessary machineries required, and presents state-of-the-art results for finding communication- and time-minimal tiling choices. Throughout the book, theorems and algorithms are illustrated with numerous examples and diagrams. The techniques presented in can be adapted to work for a cluster of workstations, and are also directly applicable to shared-memory machines once the machines are modeled as BSP (Bulk Synchronous Parallel) machines.
Features and key topics:

• Detailed review of the mathematical foundations, including convex polyhedra and cones;
• Self-contained treatment of nonsingular loop transformations, code generation, and full loop permutability;
• Tiling loop nests by rectangles and parallelepipeds, including their mathematical definition, dependence analysis, legality test, and code generation;
• A complete suite of techniques for generating SPMD code for a tiled loop nest;
• Up-to-date results on tile size and shape selection for reducing communication and improving parallelism;
• End-of-chapter references for further reading.

Researchers and practitioners involved in optimizing compilers and students in advanced computer architecture studies will find this a lucid and well-presented reference work with numerous citations to original sources.

Zielgruppe

Research

Fachgebiete

• Mathematik | Informatik EDV | Informatik Programmierung | Softwareentwicklung Compiler
• Mathematik | Informatik EDV | Informatik Programmierung | Softwareentwicklung Funktionale, Logische, Parallele und Visuelle Programmierung
• Mathematik | Informatik EDV | Informatik Technische Informatik Hochleistungsrechnen, Supercomputer
• Mathematik | Informatik EDV | Informatik Daten / Datenbanken Automatische Datenerfassung, Datenanalyse

Inhaltsverzeichnis

I Mathematic Background and Loop Transformation.- 1. Mathematical Background.- 2. Nonsingular Transformations And Permutabidlity.- II Tiling as a Loop Transformation.- 3. Rectangular Tiling.- 4. Parallelepiped Tiling.- III Tiling for Distributed-Memory Machines.- 5. Spmd Code Generation.- 6. Communication-Minimal Tiling.- 7. Time-Minimal Tiling.