Skip to content

请问如何加载新模型 #53

@prettyprettyboy

Description

@prettyprettyboy

如果要加载fengshenbang的erlangshen3.9B模型进行训练应该如何配置,transformers 2.10.0不含有megatron-bert架构的config

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions