Skip to content

Commit 9fc6daa

Browse files
authored
add hpc
1 parent fe57cce commit 9fc6daa

File tree

1 file changed

+31
-2
lines changed

1 file changed

+31
-2
lines changed

src/pages/gsoc_ideas.mdx

Lines changed: 31 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,14 +37,43 @@ Mike @Dietze
3737

3838
**Duration:**
3939

40-
Flexible to work as either a Small (175hr) or Large (350 hr)
40+
Flexible to work as either a Medium (175hr) or Large (350 hr)
4141

4242
**Difficulty:**
4343

4444
Medium
4545

4646
---
4747

48+
#### [Parallelization of runs](#hpc)
49+
50+
This project would extend PEcAn's existing run mechanisms to be able to run on an HPC using apptainer. For uncertaintity analysis, PEcAn will run 1000s of runs of the same model with small permutations. This is a perfect use for an HPC run. The goal is to not submit 1000s of jobs, but have a single job with multiple nodes that will run all of the ensembles efficiently. Running can be orchistrated using RabbitMQ but other methods are encouraged as well. The end goal should be for the PEcAn system to be launched, and run the full workflow on the HPC from start to finish leveraging as many nodes as given during the submission.
51+
52+
**Expected outcomes:**
53+
54+
A successful project would complete at subset of the following tasks:
55+
56+
* Show different ways to launch the jobs (rabbitmq, lock files, simple round robin, etc)
57+
* Report of different options and how they can be enabled
58+
59+
**Prerequisites:**
60+
61+
- Required: R (existing workflow and prototype is in R), docker
62+
- Helpful: familiarity with HPC and apptain
63+
64+
**Contact person:**
65+
66+
Rob @Kooper
67+
68+
**Duration:**
69+
70+
Flexible to work as either a Medium (175hr) or Large (350 hr)
71+
72+
**Difficulty:**
73+
74+
Medium
75+
76+
---
4877
#### [Database Improvements](#db)
4978

5079
**Chris TODO**
@@ -57,7 +86,7 @@ Medium
5786
Chris Black (@infotroph)
5887

5988
**Duration:**
60-
Flexible to work as either a Small (175hr) or Large (350 hr)
89+
Flexible to work as either a Medium (175hr) or Large (350 hr)
6190

6291
**Difficulty:**
6392
Medium, Large

0 commit comments

Comments
 (0)