Lately people have been combining MPI and OpenMP, to handle the increasing common architectures of clusters of multi-core machines. Perhaps the hardest problem in parallel computing is load balancing.

Transparent checkpointing (also known as system-level checkpointing) refers to the ability to checkpoint a (possibly MPI-parallel or distributed) application, without modifying the binaries of that ...

In this episode of Let’s Talk Exascale, Pavan Balaji and Ken Raffenetti describe their efforts to help MPI, the de facto programming model for parallel computing, run as efficiently as possible on ...