Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance
type: FAIRDigitalObject
type: RoCrateNanopub
created: 2026-05-11T16:07:27.507+02:00
creator: RoCrateBot
type: Nanopublication
has assertion: assertion
has provenance: provenance
has publication info: pubinfo

sig
has algorithm: RSA
signed by: RoCrateBot

Applied sciences
type: DefinedTerm

Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance
type: Resource
type: MediaObject
type: ConferencePaper
author: Anne Fouilloux
creator: Anne Fouilloux
date created: 2025-04-21 11:20:47.343711+00:00
date modified: 2025-10-14 08:35:36.966607+00:00
description: The modern form of containers, as popularly known through platforms like Docker, Singularity (Apptainer), Podman or Charliecloud, to cite only a few, began to take shape over a decade ago. However, the fundamentals behind containerization and actual benefits of containers in scientific computing remain largely unclear to a vast majority of users. In fact, there is a significant gap between simplistic “Hello world” examples found online and real scientific applications. Also, rumors suggest that achieving satisfactory performances on supercomputers across multiple nodes is impossible. The aim of this paper is to explain how containers can leverage the potential of high-speed networks for inter-node communications with UCX on Fram and Betzy (from the Norwegian national e-infrastructure provider). It is also shown how to achieve near-native performance on LUMI (EuroHPC’s flagship) despite a “Slingshot-11” interconnect and proprietary library. Results obtained in the standard OSU Micro-Benchmarks tests for latency and bandwidth, and with a fully-fledged climate model, demonstrate that containerized applications work just as well as their bare-metal counterparts, are portable and provide bit-for-bit reproducibility on different platforms. Containers are therefore highly recommended to minimize deployment and porting issues i) for AaaS (Applications as a Service) coming with all the necessary software environment (rather than source code only); and ii) so that HPC users do not have to rely on anybody to install what they need and can be operational within minutes whilst still getting top performance.
license: legalcode
sd date published: 2025-04-21 11:20:47.343711+00:00

Anne Fouilloux
type: Agent
affiliation: Simula Research Laboratory
orcid: 0000-0002-1784-2920

Figure-5 From: Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance
type: Sketch
type: Resource
type: MediaObject
author: Anne Fouilloux
creator: Anne Fouilloux
date created: 2025-04-21 11:12:36.676031+00:00
date modified: 2025-10-14 08:35:36.458544+00:00
description: Example of monthly mean reference height (i.e., at 2 m) air temperature (TREFHT) expressed in kelvin obtained with CESM2.3 and corresponding to a typical situation in January 2000, starting from a global 1 grid which is progressively increased by a factor of 4 over the Arctic, and exhibits a further 2 resolution refinement over Greenland and Iceland.
encoding format: image/png
license: legalcode
sd date published: 2025-04-21 11:12:36.676031+00:00

List of related nano publications
type: Resource
type: WebService
type: MediaObject
author: Anne Fouilloux
creator: Anne Fouilloux
date created: 2025-04-21 11:16:05.282869+00:00
date modified: 2025-10-14 08:35:36.708663+00:00
description: List all the nanopublications related to the paper with DOI: https://doi.org/10.1007/978-3-031-86240-3_4
license: legalcode
sd date published: 2025-04-21 11:16:05.282869+00:00

Jean Iaquinta
type: Agent
orcid: 0000-0002-8763-1643

Simula Research Laboratory
type: Organization
type: Agent

University of Oslo
type: Organization
type: Agent

Research Object related to the paper DOI:10.1007/978-3-031-86240-3_4
type: ResearchObject
type: Resource
type: MediaObject
author: Anne Fouilloux
creator: Anne Fouilloux
date created: 2025-04-21 16:41:31.960124+00:00
date modified: 2025-10-14 08:35:38.476022+00:00
description: This is the Research Object related to the paper https://doi.org/10.1007/978-3-031-86240-3_4
license: legalcode
sd date published: 2025-04-21 16:41:31.960124+00:00

Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance
type: ResearchObject
type: LiveRO
type: Dataset
type: BibliographyResearchObject
about: Applied sciences
author: Anne Fouilloux
author: Jean Iaquinta
content size: 0
copyright holder: Simula Research Laboratory
copyright holder: University of Oslo
creator: Anne Fouilloux
date created: 2025-04-21 11:09:24.989287+00:00
date modified: 2025-10-16 12:01:02.622300+00:00
date published: 2025-04-21 11:09:24.989287+00:00
description: Research Object related to the paper: Iaquinta, J., Fouilloux, A. (2025). Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance. In: Azab, A., Malkiewicz, T. (eds) Nordic e-Infrastructure Tomorrow. NeIC 2024. Communications in Computer and Information Science, vol 2398. Springer, Cham. https://doi.org/10.1007/978-3-031-86240-3_4
encoding format: application/ld+json
has part: Figure-5 From: Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance
has part: List of related nano publications
license: no-permission
publisher: Simula Research Laboratory
publisher: University of Oslo
creation mode: MANUAL
template: https://w3id.org/ro/terms/earth-science#BibliographyCentricResearchObjectTemplate
cite-as: Fouilloux, Anne, and Jean Iaquinta. "Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance." ROHub. Apr 21 ,2025. https://w3id.org/ro-id/231a8eab-7612-4b18-b4d1-dd7cf68628cf.

monthly_reports
type: Folder
type: Dataset
description: This folder contains the monthly reports

output
type: Folder
type: Dataset
description: Folder containing the generated papers. The papers were generated by ChatGPT or other LLMs. All the generated documents used free plan e.g. the documents were generated at no cost.

biblio
type: Folder
type: Dataset
has part: Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance

FAIR2Adapt
type: community
description: The FAIR2Adapt community is dedicated to advancing climate change adaptation in Europe by promoting FAIR and open data sharing to enhance the accessibility, interoperability, and usability of environmental and socio-economic data in support of climate change adaptation efforts.

IT-computer sciences
type: IPTC
path: Science and technology/Technology and engineering/IT-computer sciences

Fram, Betzy, and LUMI supercomputers, equipped with InfiniBand and HPE Slingshot interconnects, provide high bandwidth, low latency networks for MPI based parallel computing .
type: Sentence
norm score: 19.144307469180564
score: 26.4

Hpc platform
type: Phrase
norm score: 1.272264631043257
score: 2.5

text
type: Concept
norm score: 2.97029702970297
score: 7.8

geology
type: FieldOfResearch
norm score: 66.713034523081
score: 1.2826798558235168

earth sciences
type: FieldOfResearch
norm score: 66.713034523081
score: 1.2826798558235168

computer system
type: Concept
norm score: 2.6656511805026653
score: 7.0

bandwidth
type: Concept
norm score: 4.303122619954303
score: 11.3

experiment
type: Concept
norm score: 3.046458492003046
score: 8.0

LUMI s slingshot interconnect
type: Phrase
norm score: 1.1195928753180664
score: 2.2

research
type: Concept
norm score: 5.064737242955064
score: 13.3

Raxalpe
type: Place
wikidata: Q149533

computing system
type: Lemma
norm score: 3.56234096692112
score: 5.6

engineering
type: NASA
norm score: 25.156959414809403
score: 0.3401784896850586

Patent, copyright and trademark
type: IPTC
path: Economy, business and finance/Business information/Strategy and marketing/Patent, copyright and trademark

derivative
type: Concept
norm score: 2.77989337395278
score: 7.3

Hpc remain
type: Phrase
norm score: 1.424936386768448
score: 2.8

bitwise reproducibility
type: Phrase
norm score: 14.961832061068701
score: 29.4

general
type: NASA
norm score: 18.055164584304656
score: 0.24414630234241486

Hardware
type: IPTC
path: Economy, business and finance/Economic sector/Computing and information technology/Hardware

container
type: Concept
norm score: 16.146230007616143
score: 42.4

computer programming and software
type: NASA
norm score: 56.787876000885944
score: 0.7678993940353394

potential
type: Concept
norm score: 3.046458492003046
score: 8.0

computing
type: Lemma
norm score: 6.997455470737914
score: 11.0

Newspaper
type: IPTC
path: Arts, culture and entertainment/Mass media/Newspaper

potential of container
type: Phrase
norm score: 9.26208651399491
score: 18.2

communications in computer science
type: Phrase
norm score: 5.139949109414759
score: 10.1

Periodical
type: IPTC
path: Arts, culture and entertainment/Mass media/Periodical

node communication protocols
type: Phrase
norm score: 3.053435114503817
score: 6.0

image
type: Lemma
norm score: 3.435114503816794
score: 5.4

sentence
type: Concept
norm score: 2.8560548362528557
score: 7.5

Aida sentence
type: Phrase
norm score: 4.427480916030534
score: 8.7

potential
type: Lemma
norm score: 4.8346055979643765
score: 7.6

communication protocol
type: Concept
norm score: 5.217060167555217
score: 13.7

portability
type: Concept
norm score: 3.846153846153846
score: 10.1

Hardware
type: IPTC
path: Economy, business and finance/Economic sector/Computing and information technology/Hardware

scientific computing
type: Phrase
norm score: 2.391857506361323
score: 4.7

reproducibility
type: Lemma
norm score: 6.1704834605597965
score: 9.7

software
type: Domain
norm score: 27.192118226600986
score: 27.6

OSU micro benchmark experiment
type: Phrase
norm score: 8.804071246819339
score: 17.3

Hpc application
type: Phrase
norm score: 1.4758269720101782
score: 2.9

Science and technology
type: IPTC
path: Science and technology

research object
type: Phrase
norm score: 16.641221374045802
score: 32.7

mathematical and computer sciences
type: NASA
norm score: 56.787876000885944
score: 0.7678993940353394

A. Malkiewicz
type: Lemma
norm score: 5.852417302798982
score: 9.2

portability
type: Lemma
norm score: 6.106870229007634
score: 9.6

GigaByte/second) on Fram and Betzy, matching host installed OpenMPI . . . On LUMI, containers with MPICH . . and OFI swapped Slingshot libraries achieve identical bandwidth to CrayMPICH . a .
type: Sentence
norm score: 3.698332124728063
score: 5.1

Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance.
type: Sentence
norm score: 30.96446700507614
score: 42.7

script
type: Concept
norm score: 2.6656511805026653
score: 7.0

LUMI
type: Lemma
norm score: 6.297709923664122
score: 9.9

Iaquinta, J., Fouilloux, A. (2025). Unlocking the Potential of Containers in Scientific Computing to Achieve Bitwise Reproducibility, Portability and Performance.
type: Sentence
norm score: 23.132704858593183
score: 31.9

https://w3id.org/ro-id/enrichment/83c64005-d843-479c-bd0a-781bf4664366
type: Sentence
name: Containers provide excellent performance, portability, and bit for bit reproducibility for HPC applications like CESM, simplifying workflows and reducing deployment time. https://w id.org/np/RAisCNBIy b KxWJo uPmvkf PSRAdt NBq Aug KAKU .
norm score: 7.614213197969542
score: 10.5

http
type: Lemma
norm score: 3.816793893129771
score: 6.0

image
type: Concept
norm score: 2.8560548362528557
score: 7.5

node
type: Lemma
norm score: 3.1170483460559804
score: 4.9

communication protocol
type: Lemma
norm score: 5.089058524173028
score: 8.0

Information science
type: IPTC
path: Science and technology/Social sciences/Information science

Hpc architecture
type: Phrase
norm score: 1.2213740458015268
score: 2.4

fluid mechanics and thermodynamics
type: NASA
norm score: 25.156959414809403
score: 0.3401784896850586

other earth sciences
type: FieldOfResearch
norm score: 33.28696547691899
score: 0.6400026679039001

linguistics
type: Domain
norm score: 15.960591133004925
score: 16.2

2025
type: TimeReference

experiment
type: Lemma
norm score: 3.880407124681934
score: 6.1

Capital punishment
type: IPTC
path: Crime, law and justice/Law enforcement/Punishment (criminal)/Capital punishment

general (general)
type: NASA
norm score: 18.055164584304656
score: 0.24414630234241486

aida sentence
type: Phrase
norm score: 9.669211195928753
score: 19.0

derivative
type: Lemma
norm score: 3.56234096692112
score: 5.6

informatics
type: Concept
norm score: 2.2086824067022084
score: 5.8

Hpc system
type: Phrase
norm score: 1.8829516539440203
score: 3.7

guest
type: Concept
norm score: 3.008377760853008
score: 7.9

publishing
type: Domain
norm score: 2.6600985221674875
score: 2.7

deployment time. http
type: Phrase
norm score: 1.7302798982188294
score: 3.4

https://w3id.org/ro-id/enrichment/bed3fbd1-8446-45fa-afae-d4f19e89de80
type: Sentence
name: Containers can achieve near native performance and reproducibility in HPC using open source tools, overcoming proprietary library limitations on supercomputers like LUMI. https://w id.org/np/RA SFYwZmDw e rLiResVh VKiRsnIrzcoMl atf Lk .
norm score: 2.3930384336475705
score: 3.3

LUMI supercomputer
type: Phrase
norm score: 3.4096692111959284
score: 6.699999999999999

operation
type: Concept
norm score: 2.7418126428027416
score: 7.2

aggregated script
type: Phrase
norm score: 4.529262086513995
score: 8.9

High performance computing
type: Lemma
norm score: 4.198473282442748
score: 6.6

container
type: Lemma
norm score: 7.251908396946564
score: 11.399999999999999

Unlocking the Potential of Containers in Scientific Computing to Achieve
type: Sentence
norm score: 2.610587382160986
score: 3.6

information technology
type: Domain
norm score: 4.729064039408867
score: 4.8

earth sciences
type: FieldOfResearch
norm score: 33.28696547691899
score: 0.6400026679039001

performance
type: Lemma
norm score: 4.071246819338422
score: 6.4

singularity image
type: Phrase
norm score: 3.0025445292620865
score: 5.9

sentence
type: Lemma
norm score: 3.944020356234097
score: 6.2

computing
type: Concept
norm score: 5.217060167555217
score: 13.7

Patent, copyright and trademark
type: IPTC
path: Economy, business and finance/Business information/Strategy and marketing/Patent, copyright and trademark

reproducibility
type: Concept
norm score: 3.922315308453922
score: 10.3

Library and museum
type: IPTC
path: Arts, culture and entertainment/Culture/Library and museum

On Fram, Betzy, and LUMI, containerized CESM . simulations outperform host installed setups, achieving up to higher model throughput on LUMI, measured as simulated years per day .
type: Sentence
norm score: 3.625815808556925
score: 5.0

2024
type: TimeReference

Software
type: IPTC
path: Economy, business and finance/Economic sector/Computing and information technology/Software

Research Object related to the paper:
type: Sentence
norm score: 6.816533720087019
score: 9.4

Research Object
type: Lemma
norm score: 4.198473282442748
score: 6.6

http
type: Concept
norm score: 5.407463823305407
score: 14.200000000000001

research
type: Lemma
norm score: 3.944020356234097
score: 6.2

computer science
type: Domain
norm score: 49.45812807881774
score: 50.199999999999996

Library and museum
type: IPTC
path: Arts, culture and entertainment/Culture/Library and museum

Monthly summary - Science Live (April 2025).pdf
type: Resource
type: MediaObject
type: Report
author: Anne Fouilloux
content size: 174239
creator: Anne Fouilloux
date created: 2025-04-29 21:50:46.106437+00:00
date modified: 2025-10-14 08:35:38.901747+00:00
encoding format: application/pdf
license: legalcode
sd date published: 2025-04-29 21:50:46.106437+00:00

10.1007_978-3-031-86240-3_4_rewritten.pdf
type: Paper
type: Resource
type: MediaObject
author: Anne Fouilloux
content size: 127388
creator: Anne Fouilloux
date created: 2025-04-21 11:35:21.511086+00:00
date modified: 2025-10-14 08:35:37.408518+00:00
description: Version 1.0: We gave to GPT-4.1mini (free version) all the AIDA sentences generated for the paper 10.1007_978-3-031-86240-3_4 and asked to rewrite it following the template Abstract, Keywords, Introduction, Background, Discussion, Conclusion, References. We read the generated paper to spot any mistakes and we highlighted inconsistancies in yellow.
encoding format: application/pdf
license: legalcode
sd date published: 2025-04-21 11:35:21.511086+00:00

10.1007_978-3-031-86240-3_4_rewritten_version2.pdf
type: Paper
type: Resource
type: MediaObject
author: Anne Fouilloux
content size: 126230
creator: Anne Fouilloux
date created: 2025-04-21 14:55:19.214553+00:00
date modified: 2025-10-14 08:35:38.247108+00:00
description: Version 2.0 generated by ChatGPT (April 2025, sikt.no). Could you write a scientific paper of 4 pages with the following sections “Abstract, Keywords, Introduction, Background, Discussion, Conclusion, References. ” with a text that needs to be long to be published in a good journal and the paper should be based on the following AIDA sentences that you will need to all references in the text (make sure to add all the AIDA sentences in the text) and add in the reference section. The reference section should list all the AIDA sentences so you need to make sure all of them are referenced in the generated text. ensure all the AIDA sentences are included and referenced properly. This will ensure completeness and meet the requirements for the publication.:
encoding format: application/pdf
license: legalcode
sd date published: 2025-04-21 14:55:19.214553+00:00