Linux announces plans to form High Performance Software Foundation

2 mins read

The Linux Foundation has announced that it plans to set up a High Performance Software Foundation (HPSF).

According to the Foundation, through a series of technical projects, HPSF plans to build, promote, and advance a portable software stack for high performance computing (HPC) by increasing adoption, lowering barriers to contribution, and supporting development efforts.

As use of HPC becomes ubiquitous in scientific computing and digital engineering, and AI use cases multiply, more and more data centres are deploying GPUs and other compute accelerators. HPSF intends to leverage investments made by the United States Department of Energy's (DOE) Exascale Computing Project (ECP), the EuroHPC Joint Undertaking, and other international projects in accelerated HPC to exploit the performance of this diversifying set of architectures.

Acting as an umbrella project under the Linux Foundation, HPSF will provide a neutral space for pivotal projects in the high-performance software ecosystem, enabling industry, academia, and government entities to collaborate together on the scientific software stack.

HPSF already benefits from strong support across the HPC landscape, including the likes of Amazon Web Services, Argonne National Laboratory, CEA, CIQ, Hewlett Packard Enterprise, Intel, Kitware, Lawrence Berkeley National Laboratory, Lawrence Livermore National Laboratory, Los Alamos National Laboratory, NVIDIA, Oak Ridge National Laboratory, Sandia National Laboratory, and the University of Oregon.

By drawing support from these organisations and members of the community, HPSF will set up a technical advisory committee (TAC) to manage working groups tackling a variety of HPC topics, and will follow a governance model based on the Cloud Native Computing Foundation (CNCF).

The HPSF is launching with the following initial open-source technical projects:

Spack: the HPC package manager

Kokkos: a performance-portable programming model for writing modern C++ applications in a hardware-agnostic way.

AMReX: a performance-portable software framework designed to accelerate solving partial differential equations on block-structured, adaptively refined    meshes.

WarpX: a performance-portable Particle-in-Cell code with advanced algorithms that won the 2022 Gordon Bell Prize

Trilinos: a collection of reusable scientific software libraries, known in particular for linear, non-linear,

Apptainer: a container system and image format specifically designed for secure high-performance computing.

VTK-m: a toolkit of scientific visualization algorithms for accelerator architectures.

HPCToolkit: performance measurement and analysis tools for computers ranging from laptops to the world’s largest GPU-accelerated supercomputers.

E4S: the Extreme-scale Scientific Software Stack

Charliecloud: HPC-tailored, lightweight, fully unprivileged container implementation.

HPSF aims to have a number of focused initiatives to support developers, including:

  • Continuous Integration resources tailored for HPC projects
  • Continuously built, turnkey software stacks
  • Architecture support
  • Performance regression testing and benchmarking

To learn more about the HPSF, including how to get involved and join as a member, please use the link below.