Skip to content

Generating MFC Images and Testing Them on OSPool #935

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 46 commits into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
bb15510
just experimenting (#654)
Jun 15, 2025
d4875b8
updated sing version
Jun 15, 2025
e0dbc1c
corrected and directed images to be stored in images folder
Jun 15, 2025
eeb1706
corrected path
Jun 15, 2025
56ba5a4
chaning path
Jun 15, 2025
77c5ce0
another path correction
Jun 15, 2025
a12263e
added cloning of PR
Jun 15, 2025
6c64ac0
adjusted images commands
Jun 15, 2025
5234667
changed folder images=>image
Jun 15, 2025
23fff81
removed items from Build singularity Images
Jun 15, 2025
f6faafe
added --fakeroot
Jun 15, 2025
91b0e58
commenting to only generate one image
Jun 15, 2025
07ad245
added --sandbox
Jun 15, 2025
3204a2a
root path
Jun 15, 2025
999eaf6
apptainer
Jun 15, 2025
7162b30
removed stuff
Jun 15, 2025
303660b
removed fakeroot flag
Jun 15, 2025
7500195
using apptainer instead of github action
Jun 15, 2025
cac8ca9
ensuring all images are saved
Jun 15, 2025
aade580
user privileges
Jun 15, 2025
1ccbb7a
singularity files
Jun 15, 2025
65cff8f
corrected path (#654)
Jun 15, 2025
5940002
unified singularity files to avoid errors
Jun 15, 2025
b70278e
some changes
Jun 16, 2025
0728f78
experimenet with the workflow file
Jun 20, 2025
09cf1d7
removed all workflow files except containerization
Jun 20, 2025
a86aafd
edit container-image.yml
Jun 20, 2025
edde446
small edit
Jun 20, 2025
e0e1106
small edit
Jun 20, 2025
165970f
testing current workflow
Malmahrouqi3 Jul 10, 2025
d33ff5d
only cpu image
Malmahrouqi3 Jul 10, 2025
5c0eb49
another edit
Malmahrouqi3 Jul 10, 2025
d94a8c8
corrected permissions
Malmahrouqi3 Jul 10, 2025
e18a72e
figuring out runscript
Malmahrouqi3 Jul 10, 2025
35846d2
runscript edit
Malmahrouqi3 Jul 10, 2025
ab9ac8f
fixing runscript
Malmahrouqi3 Jul 10, 2025
9e1ad00
another fix to runscript
Malmahrouqi3 Jul 10, 2025
ce3214f
just checking
Malmahrouqi3 Jul 10, 2025
007f351
working concept pushed for testing
Jul 11, 2025
dcb169b
updating workflow file
Jul 11, 2025
7d2a89d
another approach: build and store then test
Jul 11, 2025
dbbc147
added double CI execution on base and fork
Malmahrouqi3 Jul 11, 2025
2798c9d
reorganized packages
Malmahrouqi3 Jul 11, 2025
a5ec16e
recent layer of nvhpc
Malmahrouqi3 Jul 11, 2025
8733924
HTConder job submission files
Malmahrouqi3 Jul 11, 2025
644f278
recnet changes
Malmahrouqi3 Jul 11, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
68 changes: 0 additions & 68 deletions .github/workflows/bench.yml

This file was deleted.

127 changes: 0 additions & 127 deletions .github/workflows/cleanliness.yml

This file was deleted.

55 changes: 55 additions & 0 deletions .github/workflows/container-image.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
name: Build Singularity Images

on:
push:

jobs:
Build-singularity-images:
name: Build Singularity Images
runs-on: ubuntu-latest
steps:
- name: Clone - PR
uses: actions/checkout@v4
with:
path: pr

- name: Build & Store Images
run: |
sudo apt-get update
sudo apt-get install -y software-properties-common openssh-client
sudo add-apt-repository -y ppa:apptainer/ppa
sudo apt-get install -y apptainer
sudo apptainer config fakeroot --enable $(whoami)

(cd pr/.github/workflows/images && sudo apptainer build mfc_cpu.sif Singularity.cpu)
scp pr/.github/workflows/images/mfc_cpu.sif ${{secrets.SSH_USER}}:MFC/mfc_cpu.sif
rm -rf pr/.github/workflows/images/mfc_cpu.sif

(cd pr/.github/workflows/images && sudo apptainer build mfc_cpu_bench.sif Singularity.cpu_bench)
scp pr/.github/workflows/images/mfc_cpu_bench.sif ${{secrets.SSH_USER}}:MFC/mfc_cpu_bench.sif
rm -rf pr/.github/workflows/images/mfc_cpu_bench.sif

(cd pr/.github/workflows/images && sudo apptainer build mfc_gpu.sif Singularity.gpu)
scp pr/.github/workflows/images/mfc_gpu.sif ${{secrets.SSH_USER}}:MFC/mfc_gpu.sif
rm -rf pr/.github/workflows/images/mfc_gpu.sif

(cd pr/.github/workflows/images && sudo apptainer build mfc_gpu_bench.sif Singularity.gpu_bench)
scp pr/.github/workflows/images/mfc_gpu_bench.sif ${{secrets.SSH_USER}}:MFC/mfc_gpu_bench.sif
rm -rf pr/.github/workflows/images/mfc_gpu_bench.sif

- name: Test Images
run: |
ssh ${{secrets.SSH_USER}} "
condor_submit MFC/mfc_cpu.sub
condor_submit MFC/mfc_cpu_bench.sub
condor_submit MFC/mfc_gpu.sub
condor_submit MFC/mfc_gpu_bench.sub
"

- name: Upload images as artifacts
uses: actions/upload-artifact@v4
if: always()
with:
name: singularity-images
path: |
pr/.github/workflows/images/*
48 changes: 0 additions & 48 deletions .github/workflows/coverage.yml

This file was deleted.

76 changes: 0 additions & 76 deletions .github/workflows/docs.yml

This file was deleted.

19 changes: 0 additions & 19 deletions .github/workflows/formatting.yml

This file was deleted.

Loading