What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model. #176
Description
Hi,
What is minimum resource requirement to fine-tuning Llama-2-7B-32K-beta model with finetune_llama-2-7b-32k-mqa.sh script. Such as disk, memory and vRAM.
Look forward to your response.
Best regards.