Skip to content

{2023.06}[icelake,cascadelake] EasyStacks batch 18: 072 #1082

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

casparvl
Copy link
Collaborator

This contains the software that was installed between us generating the batches of EasyStacks for icelake and cascadelake, and the present day. With this PR, we should also be able to enable the CI.

It does require #1073 to be merged first, and then we should sync this PR with the default branch.

…yed somewhere in between us starting to install the icelake and cascadelake stack, and us builindg 071-eb-X.yml
Copy link

eessi-bot bot commented May 12, 2025

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/sapphirerapids, x86_64/intel/skylake_avx512, x86_64/intel/cascadelake, x86_64/intel/icelake, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software

@eessi-bot-deucalion
Copy link

Instance eessi-bot-deucalion is configured to build for:

  • architectures: aarch64/a64fx
  • repositories: eessi.io-2023.06-software

@eessi-bot-toprichard
Copy link

Instance rt-Grace-jr is configured to build for:

  • architectures: aarch64/nvidia/grace
  • repositories: eessi.io-2023.06-software

@eessi-bot-surf
Copy link

Instance eessi-bot-surf is configured to build for:

  • architectures: x86_64/amd/zen4, x86_64/amd/zen2
  • repositories: eessi-hpc.org-2023.06-software, eessi.io-2023.06-software, eessi.io-2023.06-compat, eessi-hpc.org-2023.06-compat

Copy link

eessi-bot bot commented May 12, 2025

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

@casparvl somehow you have added back in the now-removed version of ipypml

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

I guess the Java problem is also not caught by the consistency check since that is not a .lua file? I notice that Java 21 does not appear in the modulerc file for icelake and cascadelake

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

I suspect the file in #1066 (comment) was overwritten by a subsequent PR.

@casparvl
Copy link
Collaborator Author

casparvl commented May 14, 2025

@casparvl somehow you have added back in the now-removed version of ipypml

Wait, where is that? That's not in this PR, right? But happened in a previous PR then?

This looks similar, no?

[casparl@int6 icelake_cclake]$ ls -al /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/icelake/software/ipympl/
total 6
drwxr-xr-x   4 cvmfs cvmfs   30 May  3 13:29 .
drwxr-xr-x 499 cvmfs cvmfs 4096 Apr 23 15:05 ..
dr-xr-xr-x   6 cvmfs cvmfs   27 May  3 13:29 0.9.3-foss-2023a
dr-xr-xr-x   6 cvmfs cvmfs   27 May  6 10:50 0.9.3-gfbf-2023a
[casparl@int6 icelake_cclake]$ ls -al /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/ipympl/
total 2
drwxr-xr-x   4 cvmfs cvmfs 30 Mar 16  2024 .
drwxr-xr-x 508 cvmfs cvmfs 15 Jul 19  2024 ..
dr-xr-xr-x   6 cvmfs cvmfs 27 Mar 16  2024 0.9.3-foss-2023a
dr-xr-xr-x   6 cvmfs cvmfs 27 May 28  2024 0.9.3-gfbf-2023a

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

@casparvl somehow you have added back in the now-removed version of ipypml

Wait, where is that? That's not in this PR, right? But happened in a previous PR then?

This looks similar, no?

[casparl@int6 icelake_cclake]$ ls -al /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/icelake/software/ipympl/
total 6
drwxr-xr-x   4 cvmfs cvmfs   30 May  3 13:29 .
drwxr-xr-x 499 cvmfs cvmfs 4096 Apr 23 15:05 ..
dr-xr-xr-x   6 cvmfs cvmfs   27 May  3 13:29 0.9.3-foss-2023a
dr-xr-xr-x   6 cvmfs cvmfs   27 May  6 10:50 0.9.3-gfbf-2023a
[casparl@int6 icelake_cclake]$ ls -al /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software/ipympl/
total 2
drwxr-xr-x   4 cvmfs cvmfs 30 Mar 16  2024 .
drwxr-xr-x 508 cvmfs cvmfs 15 Jul 19  2024 ..
dr-xr-xr-x   6 cvmfs cvmfs 27 Mar 16  2024 0.9.3-foss-2023a
dr-xr-xr-x   6 cvmfs cvmfs 27 May 28  2024 0.9.3-gfbf-2023a

The module file has been removed for the foss version (it was removed in EasyBuild, it had the wrong toolchain level and was moved to gfbf)

@casparvl
Copy link
Collaborator Author

Ah, only the module file was removed... That explains: the scripts to replicate a stack will crawl the /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/haswell/software prefix to list all software to be installed (and it wasn't removed there). So... that's why it got reinstalled :|

@casparvl
Copy link
Collaborator Author

It was added in 046-eb-4.9.0.yml btw. So quite a while ago :D I guess we just have to ask someone with Stratum 0 access to remove the modulefile for these archs as well?

@casparvl
Copy link
Collaborator Author

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:icelake
bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:cascadelake

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented May 14, 2025

Updates by the bot instance eessi-bot-deucalion (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:icelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:cascadelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented May 14, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:icelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:cascadelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented May 14, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:icelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:cascadelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake resulted in:

  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake resulted in:

@eessi-bot-surf
Copy link

eessi-bot-surf bot commented May 14, 2025

Updates by the bot instance eessi-bot-surf (click for details)
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:icelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake
  • received bot command build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:cascadelake from casparvl

    • expanded format: build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:icelake resulted in:

    • no jobs were submitted
  • handling command build repository:eessi.io-2023.06-software instance:eessi-bot-mc-aws architecture:cascadelake resulted in:

    • no jobs were submitted

@eessi-bot-toprichard
Copy link

Updates by the bot instance rt-Grace-jr (click for details)
  • account casparvl has NO permission to send commands to the bot

Copy link

eessi-bot bot commented May 14, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-icelake for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.05/pr_1082/63015

date job status comment
May 14 13:01:14 UTC 2025 submitted job id 63015 awaits release by job manager
May 14 13:01:51 UTC 2025 released job awaits launch by Slurm scheduler
May 14 13:07:56 UTC 2025 running job 63015 is running
May 14 13:22:31 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-63015.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-icelake-17472282940.tar.gzsize: 19 MiB (20667548 bytes)
entries: 454
modules under 2023.06/software/linux/x86_64/intel/icelake/modules/all
bcgTree/1.2.1-foss-2023a.lua
Gblocks/0.91b.lua
Java/.modulerc.lua
MUSCLE/5.1.0-GCCcore-12.3.0.lua
RAxML/8.2.13-gompi-2023a-avx2.lua
software under 2023.06/software/linux/x86_64/intel/icelake/software
bcgTree/1.2.1-foss-2023a
Gblocks/0.91b
MUSCLE/5.1.0-GCCcore-12.3.0
RAxML/8.2.13-gompi-2023a-avx2
other under 2023.06/software/linux/x86_64/intel/icelake
2023.06/init/easybuild/eb_hooks.py
May 14 13:22:31 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_intel_icelake+default
P: perf: 550.354 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_intel_icelake+default
P: perf: 589.258 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_intel_icelake+default
P: latency: 1.52 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_intel_icelake+default
P: latency: 1.47 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_intel_icelake+default
P: latency: 2.99 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_intel_icelake+default
P: latency: 3.32 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_intel_icelake+default
P: latency: 0.35 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_intel_icelake+default
P: latency: 0.33 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_intel_icelake+default
P: bandwidth: 12116.01 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_intel_icelake+default
P: bandwidth: 13834.69 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-63015.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
May 14 15:39:36 UTC 2025 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-icelake-17472282940.tar.gz to S3 bucket succeeded

Copy link

eessi-bot bot commented May 14, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-cascadelake for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.05/pr_1082/63016

date job status comment
May 14 13:01:22 UTC 2025 submitted job id 63016 awaits release by job manager
May 14 13:01:48 UTC 2025 released job awaits launch by Slurm scheduler
May 14 13:07:54 UTC 2025 running job 63016 is running
May 14 13:25:36 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-63016.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-cascadelake-17472283590.tar.gzsize: 19 MiB (20667030 bytes)
entries: 454
modules under 2023.06/software/linux/x86_64/intel/cascadelake/modules/all
bcgTree/1.2.1-foss-2023a.lua
Gblocks/0.91b.lua
Java/.modulerc.lua
MUSCLE/5.1.0-GCCcore-12.3.0.lua
RAxML/8.2.13-gompi-2023a-avx2.lua
software under 2023.06/software/linux/x86_64/intel/cascadelake/software
bcgTree/1.2.1-foss-2023a
Gblocks/0.91b
MUSCLE/5.1.0-GCCcore-12.3.0
RAxML/8.2.13-gompi-2023a-avx2
other under 2023.06/software/linux/x86_64/intel/cascadelake
2023.06/init/easybuild/eb_hooks.py
May 14 13:25:36 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_intel_cascadelake+default
P: perf: 396.99 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_intel_cascadelake+default
P: perf: 416.34 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_intel_cascadelake+default
P: latency: 1.99 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_intel_cascadelake+default
P: latency: 1.87 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_intel_cascadelake+default
P: latency: 3.57 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_intel_cascadelake+default
P: latency: 3.92 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_intel_cascadelake+default
P: latency: 0.49 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_intel_cascadelake+default
P: latency: 0.45 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_intel_cascadelake+default
P: bandwidth: 10148.41 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_intel_cascadelake+default
P: bandwidth: 10166.53 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-63016.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
May 14 15:39:56 UTC 2025 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-cascadelake-17472283590.tar.gz to S3 bucket succeeded

@casparvl casparvl marked this pull request as ready for review May 14, 2025 14:42
ocaisa
ocaisa previously approved these changes May 14, 2025
@ocaisa ocaisa added the bot:deploy Ask bot to deploy missing software installations to EESSI label May 14, 2025
@eessi-bot-toprichard
Copy link

Label bot:deploy has been set by user ocaisa, but this person does not have permission to trigger deployments

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

There's something wrong with RaXML here, it should be included for Arm targets

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

It should have been built with the commit as detailed in https://github.com/EESSI/software-layer/pull/1032/files .

…whether this should be installed (or at least: which version of it should be installed)
@casparvl
Copy link
Collaborator Author

Perfect, only:

Using x86_64/generic as source of truth
Comparing /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/intel/cascadelake/modules/all to /cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/generic/modules/all
{
  "module_differences": {
    "missing": [],
    "added": [
      "ipympl/0.9.3-foss-2023a.lua"
    ]
  },
  "extension_differences": []
}

is left, which we knew. So now it's waiting for someone that can remove this from the Stratum 0 :)

@ocaisa
Copy link
Member

ocaisa commented May 14, 2025

I'm going to merge this so things are aligned and then sync it with #1081 and deal with the failure from there (since that one targets all archs anyway)

Copy link
Member

@ocaisa ocaisa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will deal with failing CI in context of #1081

@ocaisa ocaisa merged commit 187ae2f into EESSI:2023.06-software.eessi.io May 14, 2025
65 of 67 checks passed
Copy link

eessi-bot bot commented May 14, 2025

PR merged! Moved ['/project/def-users/SHARED/jobs/2025.05/pr_1082/63015', '/project/def-users/SHARED/jobs/2025.05/pr_1082/63016'] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.05.14

Copy link

eessi-bot bot commented May 14, 2025

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.05.14

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bot:deploy Ask bot to deploy missing software installations to EESSI cascadelake icelake
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants