CreateGPT

Create your own GPT-2 model - train it with your own dataset or load the pre-trained weights.

Requirements

torch==1.12.1
transformers==4.25.1
einops==0.6.0
fancy_einsum==0.0.3
tqdm==4.64.1
wandb==0.13.5

It is the run.ipnyb file uploaded and ready to run in Google Colab.

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
README.md		README.md
data_processing.py		data_processing.py
gpt_model.py		gpt_model.py
load_weights.py		load_weights.py
requirements.txt		requirements.txt
run.ipynb		run.ipynb
sample.py		sample.py