Skip to content

Benchmark Hugging Face models via Optimum integration #8294

@guangy10

Description

@guangy10

🚀 The feature, motivation and pitch

Model sourcing: huggingface/transformers
Recipes (pte generation and distribution): optimum-executorch

This work is critical as we start adding and validating recipes for non-cpu delegates.

Note this task is to track the infra work. Individual model and delegate enablement is out of scope and will be tracked separately.

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

cc @huydhn @kirklandsign @shoumikhin

Metadata

Metadata

Assignees

Labels

module: benchmarkIssues related to the benchmark infrastructuretriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Projects

Status

Ready

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions