List view
For this sprint, we have a renavigation: a COVID portal. We will _pause_ on RDPC development to get this COVID portal setup. - Review the requirements - Review the current deployment - Decide what we need to do to get the next things set up
Due by July 31, 2021## Goals - [ ] Production Deploy of the Program Dashboard Tables Display [Ciaran + Jon] - [ ] Production Deploy of new Dictionary version at end of sprint [Rosi] - Start `Clinical Data in File Repository` [Ciaran] - Continue `Clinical Data Charts` [Sam] - Continue Clinical Maintenance [Alexis] - Release Manager Planning [Jon] ## Other work - Import one data batch
Due by February 25, 2021#### Epics in Progress: ### Graph Manager API https://github.com/icgc-argo/workflow-graph-manager/issues/7 ### Middleware/Plugins - specifically for us to extend for Ceph storage - for other things too https://github.com/icgc-argo/workflow-roadmap/issues/86 ### Extending to 2nd WES Executor on Openstack - devops-y stuff
Due by March 4, 2021## Goals - Production Deploy of the Program Dashboard Tables Display - QA was completed on Minh's Access Control Feature - Start `Clinical Data in File Repository` - Start `Clinical Data Charts` - Do some Clinical Maintenance ## Work to support this: - Start on some Clinical Maintenance Tickets [Alexis] - Start on the Clinical Chart UI [Ciaran] - Arranger Redesign [Jon] - Initialize a program? - Any work left on ESAD-UK? -
Due by February 11, 2021#### Epics in Progress: ### Graph Manager API https://github.com/icgc-argo/workflow-graph-manager/issues/7 ### Middleware/Plugins - specifically for us to extend for Ceph storage - for other things too https://github.com/icgc-argo/workflow-roadmap/issues/86 ### Extending to 2nd WES Executor on Openstack - devops-y stuff
Due by February 18, 2021- Due by February 4, 2021
Focuses for this Release: - Devops/Maintenance - Workflow Graph/Logs cleanup? - Cleanup Last Workflow UI tasks
Due by January 21, 2021Upcoming Milestones: - DAC demo Jan 25 - Release of Dashboard for Molecular Data
Due by January 28, 2021## Releases and Maintenance - updating dev - ego update cross-scripting ## Workflow Graph Progress: - finish scaffolding (Jon) - logs {alex) - node auth (dusan) ## Vacations off from 14th (Jon) off from 17 (Alex) off from now (Jaser) all Dusan all Rakesh
Due by January 7, 2021### Releases and Maintenance - ICGC portal robots. - Release Molecular Data Infrastructure - finish all auth changes that have piled up ### Workflow Graph Progress: - scaffolding (Jon) - logs {alex) - node auth (dusan)
Due by December 10, 2020- Release Song - Fix Dev Environemnt - Get Empty-dir tested to know if we can proceed to QA - Fix connection between pieces for E2E Wf Graph Run
Due by November 26, 2020- At the end of the sprint, goal is https://github.com/icgc-argo/workflow-roadmap/issues/39 ## Goals for this Sprint: - Test timestamp changes in Song - new tickets to start building out the graph-manager (authoring/publishing) service - Test empty-dir leave room for anything that comes up in planning tomorrow
Due by November 12, 2020### Maintenance: - index DCC portal for Hardeep ### Goals for this Sprint: - At the end of the sprint, goal is https://github.com/icgc-argo/workflow-roadmap/issues/39 - should have timestamps in song - mutating webhooks for empty-dir??
Due by October 29, 2020- At the end of the sprint, goal is https://github.com/icgc-argo/workflow-roadmap/issues/39 - should have timestamps in song - devops done for mutating webhooks for `empty-dir`
Due by October 15, 2020- Due by October 8, 2020
- Due by October 1, 2020
- Due by September 24, 2020
2 Major goals for sprint: - [ ] Deploy New RDPC Versions (Authorization) - [ ] Works towards POC of Pipeline with Nodes/Edges
Due by September 17, 2020### Release Next Steps [Minh + Alexis + Ciaran] - a lot of technical architecture done ### Clinical Exceptions [Bashar] - begin technical architecture ### Dashboard with Genomic Data [Wajiha] ### E2E testing [Ciaran]
Due by September 10, 2020Notes: - Dusan is on vacation this whole sprint - Alex is on vacation on week - Rob is on Canarie this sprint - Still dealing with the collaboratory shutdown
Due by September 3, 2020Sprint Goal: - Spike: To see what functionality we get from out of the box Arranger and implement it - Dev work for the Canarie Doc site.
Due by August 20, 2020- Start on the investigation from workflow graph (automation) service - Finish up with application-to-application level changes needed in rdpc architecture -- merge them PRs - Start the investigated soln for fixing the empty-dir for workflows
Due by August 20, 2020•1/1 issues closed- Continue Release Architecture - Kship tests - some small platform fixes - lectern bug from data submitter?
Due by August 27, 2020The next Major Release will be submitting molecular data: https://wiki.oicr.on.ca/login.action?os_destination=%2Fpages%2Fviewpage.action%3FspaceKey%3Dicgcargotech%26title%3DMolecular%2BData%2BRelease&permissionViolation=true Goals: 1. Get started on Technical Specifications for Release Management 2. Finished up Dictionary Difference View 3. Get started on Platform to RDPC connections
Due by August 13, 2020Overall goal: Techical spike to create flowcharts and state diagrams. Complete the dependencies for App to App token. Carryover work from previous sprints.
Due by August 3, 2020- [ ] Scaffold workflow graph (automation) service - [ ] Design workflow graph data model - [ ] Continue with application-to-application level changes needed in rdpc architecture -- finish score-server changes -- finish song server -- start investigated secret-manager -- start workflow-management - [ ] Start the investigated soln for fixing the empty-dir for workflows
Due by August 6, 2020The next Major Release will be submitting molecular data: https://wiki.oicr.on.ca/login.action?os_destination=%2Fpages%2Fviewpage.action%3FspaceKey%3Dicgcargotech%26title%3DMolecular%2BData%2BRelease&permissionViolation=true Goals: 1. Get started on Technical Specifications for Release Management 2. Finished up Dictionary Difference View 3. Get started on Platform to RDPC connections
Due by July 30, 2020- Finish rdpc-gateway authorization work - Start orchestration service architecture to launch first automated wf - Start application-to-application level changes needed in rdpc architecture -- score-server changes -- song server -- secret-manager? - fixing the empty-dir for workflows
Due by July 23, 2020- Due by July 9, 2020
- Due by July 16, 2020
- [ ] Finish the File Repository Release by Friday - [ ] End-to-End Testing - Assess and Define Architecture for improved, reliable testing - [ ] Rate limiting architecture
Due by July 1, 2020Sprint Goals: - Goal 1: Genomic Playground for Barcelona - Goal 2: CI/CD for rdpc - Goal 3: RDPC development ---- connect song-search to gateway-api through federation ---- integration tests on maestro
Due by June 25, 2020Code Monkeys Sprint 30
Due by June 11, 2020- Due by May 28, 2020
This milestone will be used to track devops and infra tasks related to supporting ARGO Platform and RDPC development.
Due by December 5, 2020- Due by May 14, 2020
Workflows - Update Model T - Wes argo api update - Maestro indexing Infrastructure - Continue on Infrastructure set-up for RDPC and Platform - Ego Security warning - Do we finally start the QC Module?????
Due by April 30, 2020•1/1 issues closedBy May 5th, we should have a fully released platform with BOTH clinical and genomic data submission ready. **Goal 1: Fully working Clinical Data Submission** We still have some placeholder values in the dictionary. These need to be addressed before we make our final 1.0 dictionary release. These include: - Connecting to a drug name database - Adding Primary Id connectors on clinical events to link them (ex treatment -->followup, specimen-->primary_diagnosis etc) - allow arrays of values to be submitted (both for lectern and clinical) **Goal 2: Connected Contact Page to Jira** I have completed the JIRA setup with the IT team. The helpdesk is ready to start accepting issues from the contact page. **Goal 4: Static UI: File Repo + Donor Page View** [Started] - Small docs fixes [Wajiha] - Get started on Donor display ui [Ciaran + Priyonto] - Clinical changes [Jaser and Bashar] - Get started on File Repository [Ann + Wajiha + Jaser] **Goal 5: Platform Infrastructure** - Finish Dashboard up [Minh + Jaser] Bonus Material Dictionary Tree View **lets talk about priority in planning**
Due by April 23, 2020- Due by April 16, 2020•2/2 issues closed
We are working towards the goal of releasing the Platform to Production for Data Submitter (MAY 1st - 1.5 months from now). The features that we need available for this release are: - [ ] Production Song/Score open to Data Submitter (Rob/Kevin) - [ ] The ability to schedule/run workflows (Alex/Alexis) - [ ] Song QC Module (Kevin) - [ ] Secured cluster (Rob/Henro) - [ ] Health checks and monitoring for services (Henro/Jared) - [ ] Validation Tool run by Data submitters (check BAM header && matching payload) -- (https://wiki.oicr.on.ca/display/icgcargotech/Monitoring) Working Towards these Goals: **SONG/SCORE** - [ ] Deploy Expired Token fixes from last sprint - [ ] Double check EXPIRED ICGC token - [ ] Production Song/Score open to Data Submitter (Rob/Kevin) - [ ] QC Module (Kevin) **WORKFLOWS** - [ ] Rob& Alex helping diagnose production run/infrastructure issues - [ ] Alex & Rosi are working on the Workflow Orchestration specs together - basic scheduling/deciding principles - work on how to deal with unhappy path/non-pipeline related workflow scheduling - start first "Hardcoded POC" version of the orchestration for alignment + variant calling - [ ] Alexis working on the argo-wes-api that will feed orchestration **INFRASTRUCTURE** - [ ] Set up platform Staging - [ ] Set up rdpc staging
Due by April 2, 2020We are working towards the goal of releasing the Platform to Production for Data Submitter. The features that we need available for this release are: - Logging in to the platform - All program management - All clinical submission (Registering Samples, Clinical Submission, Dashboard populating with clinical data numbers). - Secured cluster - Health checks and monitoring for services Working Towards these Goals:
Due by March 26, 2020- Due by March 12, 2020
## **Upcoming Dates** - March 9th: Running production workflows by - April 15th: Molecular data submitters can upload data to the RDPC: -- Workflow Orchestration UI -- Logging with Score -- Deign for stable solution to replace the Model T Google Sheet ## **Production Workflow Run** [Alex, Rob] - [x] Intermediate Song deployed and tested - [ ] Get CSV's from ICGC for samples for ESAD-UK - [ ] Import as OCCAMS-GB using Bashars tool into ARGO-PROD Clinical - [ ] Intermediate Song loaded with Esophogeal payload - [ ] V1 of finalized workflow available and tested - [ ] Populate Alex Model T Google Sheet - [ ] Release the hounds! (Run workflows and keep cluster busy) ## ** Prod Support** - [ ] Ego critical vulnerabilities. Hotfix for ICGC in production. ## **Workflow System** [Alexis, Alex] - [ ] Deploy services into RDPC-COLLAB-QA. - [ ] Model T design replacement - [ ] Program dashboard workflow hookup ## **Song QC Module** [Kevin / Rob] - Revisit specs: https://wiki.oicr.on.ca/display/icgcargotech/ARGO+QC+Module+for+Song ## Infrastructure [Rob & Henrich] - [ ] Create ARGO-STAGING - [ ] Level setting security on all non-prod environments to match prod
Due by March 19, 2020