Training time and the requirements of GPUs

[harrylin-hyl]

Wonderful work!
I want to know the training time and the requirements of GPUs, which is important for my following research.
Thanks!

[zli12321]

Our training GPU requirement is 8 A100/80GB or 8H20/96GB for 7B model for about two weeks of training. We are currently working on implementing with modelscope/swift that support Lora training which could reduce the training time down to several days and uses more lightweight GPU such as 32GB.