Skip to content

Android LLM runner should avoid having deps on examples/models/{llama/llava} code #10119

@kirklandsign

Description

@kirklandsign

🚀 The feature, motivation and pitch

When we build Android AAR and build the LLM part, right now it depends on examples/models/{llama/llava} code.

https://github.com/pytorch/executorch/blob/main/extension/android/CMakeLists.txt#L138-L150

Ideally, we should depend on production code under extension/llm, not examples/...

cc @cbilgin @larryliu0820

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: androidIssues related to Android code, build, and executionrelease notes: buildChanges related to build, including dependency upgrades, build flags, optimizations, etc.triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Projects

    Status

    In Progress

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions