-
Notifications
You must be signed in to change notification settings - Fork 133
Conference notes for 2025 04 08
Robert McLay edited this page May 6, 2025
·
3 revisions
- loading full spider cache that includes module file contents itself
- takes ~2.5 seconds (on Lustre + HHDs)
- based on ~13k modules shared by Bart Oldeman on EUM'25
- going with small + large spider cache
- one with module file contents, one without
- only load large spider cache when needed ("module load" commands)
- Tcl modules will present a challenge here
- will be ignored initially, will do Lua-only version first
- write raw Tcl text to /dev/shm and let tcl2lua consume that file instead
- error reporting will need to be tested accordingly
- semantics of cached loads option in Lmod will change
- module file contents will also be provided by spider cache, not just existence of module files
- Jens-Henrik @ JSC will test in their Jupyter notebook environment, where loading modules is currently quite slow
- weird crash in Lmod when loading modules from EESSI