ColossalAI-Examples中webtextdataset #2838
Unanswered
weiwei0519
asked this question in
Community | Q&A
Replies: 1 comment
-
https://github.com/hpcaitech/ColossalAI/blob/main/examples/language/gpt/titans/dataset/webtext.py |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
ColossalAI-Examples中from datasets.webtext import WebtextDataset,这个数据集在哪个package,我尝试安装了openai的dataset,和huggingface的datasets,都没有找到
Beta Was this translation helpful? Give feedback.
All reactions