Overview On June 30th, 2024, CentOS 7 will reach end of life. Red Hat has already discontinued CentOS 8, replacing it with CentOS Stream. Going forward, organizations currently on either operating system should plan to transition to alternative open-source options...
IEEE Utility and Cloud Computing 2017 Conference: Is Singularity-based Container Technology Ready for Running MPI Applications on HPC Clouds?
From the Proceedings of the 10th International Conference on Utility and Cloud Computing:
The Message Passing Interface (MPI) standard has become the de facto programming model for parallel computing with the last 25-year continuous community effort. With the development of building efficient HPC clouds, more and more MPI-based HPC applications start running on cloud-based environments.
Singularity is one of the most attractive container technologies to build HPC clouds due to the claimed reproducible environments across the HPC centers. However, our investigations in the literature show that there is a lack of a systematical study on evaluating the performance of Singularity with various benchmarks and applications on different types of HPC platforms. Without these studies, it remains difficult to tell the community whether Singularity-based container technology is ready or not for running MPI applications on HPC clouds to gain desired performance.
To fill this gap in the literature, as a third-party, we first propose a four-dimension evaluation methodology to cover various aspects and based on that, we conduct extensive studies on evaluating the performance of Singularity on modern processors, and high-performance interconnects. Performance results prove that Singularity-based container technology can achieve near-native performance for both Intel Xeon and Intel Xeon Knights Landing (KNL) platforms with different memory access modes (i.e., cache, flat).
Singularity also shows very little overhead for running MPI-based HPC applications on both Omni-Path and InfiniBand networks. With the verification of our results, we believe that Singularity can be used for building next-generation HPC clouds with near-native performance as well as desired cloud features such as easy management and deployment.
Join Our Mailing List
Sylabs Partners With Carahsoft to Deliver Advanced Software Container Technology Services to the Public Sector
Advanced Container Technology to be Utilized for Collaboration in Sensitive Government SettingsSylabs, the global leader in providing professional tools and services for high performance container technologies, is pleased to announce its partnership with Carahsoft...
Discover an efficient solution to improve your workflow. Explore the benefits and get step-by-step guidance on implementation.