merge peft model to base for deployment #8916
Unanswered
Nima-Nilchian
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, I have fine-tuned a PEFT model using the NeMo Framework container, following the lora.ipynb notebook example. Now, I want to proceed with NeMo Framework inference container and deploy the fine-tuned model. How can I merge this PEFT model with the base model for deployment? generally how to deploy the PEFT fine-tuned model?
Beta Was this translation helpful? Give feedback.
All reactions