Skip to content

DeepSpeed support [time bounded] #437

@tjhunter

Description

@tjhunter

Is your feature request related to a problem? Please describe.

Investigate DeepSpeed support for WeatherGen.

  • @kacpnowak will do initial investigation
  • align on the best way to integrate it in WG (design doc)
  • full implementation

Consider DeepSpeed in comparison to alternatives, in particular FSDP2.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Organisation

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestinfraIssues related to infrastructureinitiativeLarge piece of work covering multiple sprintmodelRelated to model training or definition (not generic infra)performanceWork related to performance improvements

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions