Performance Computing: Modern Systems and Practices is a fully comprehensive and easily accessible treatment of high performance computing, covering fundamental concepts and essential knowledge while also providing key skills training. With this book, students will begin their careers with an understanding of possible directions for future research and development in HPC, domain scientists will learn how to use supercomputers as a key tool in their quest for new knowledge, and practicing engineers will discover how supercomputers can employ HPC systems and methods to the design and simulation of innovative products. This new edition has been fully updated, and has been reorganized and restructured to improve accessibility for undergraduate students while also adding trending content such as machine learning and a new chapter on CUDA.
1. Introduction
2. HPC Architecture
3. Commodity Clusters
4. Benchmarking
5. The Essential Moab
6. SMP
7. The Essential OpenMP
8. The Essential MPI
9. Parallel Algorithms
10. Libraries
11. Operating Systems
12. Scientific Visualization
13. Performance Monitoring
14. Debugging
15. Accelerators
16. Essential OpenACC
17. Mass Storage
18. File Systems
19. Map Reduce
20. Checkpointing
21. Beyond (Next Steps) Appendices: Essential C Linux?User Interface
Thomas Sterling is Professor of Informatics and Computing at Indiana University. He serves as the Executive Associate Director of the Center for Research in Extreme Scale Technologies (CREST) and as its Chief Scientist. He is most widely known for his pioneering work in commodity cluster computing as leader of the Beowulf Project for which he and colleagues were awarded the Gordon Bell Prize. Professor Sterling currently leads a team of researchers at IU to enable a new generation of extreme scale computing systems and applications. He is the co-author of six books and holds six patents. He has taught a graduate level course upon which this textbook will be heavily informed, five times. Maciej Brodowicz is Advanced Parallel Computing Engineer at the Center for Research in Extreme Scale Technologies (CREST) at Indiana University. Matthew Anderson works in the Department of English at the University of New England, Maine, USA.