chatglm 6b finetuning and alpaca finetuning

deep learning

qwen models finetuning

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on

moss chat finetuning

clue chatyuan finetuning

chatyuan_rlhf_training

Optimizing the Differentiable Search Index (DSI) with data augmentation (Num2Word, Stopwords Removal, POS-MLM) and parameter-efficient fine-tuning (LoRA, QLoRA, AdaLoRA, ConvoLoRA), improving retrieval accuracy and efficiency while reducing memory and computational overhead. Evaluated on the MS MARCO dataset for scalable performance.