Use of ChatGPT’s training process for other models

[qwertystars]

Can I use other pre trained model like RoBERTa but train it using ChatGPT’s training method using Colossal Ai?

[Camille7777]

Hi @qwertystars Yes, for pre-trained model RoBERTa, we suggest to use the pretrained model from HuggingFace, you can find RoBERTa from here. Our example here #3223