Transformer from scratch, basically rewrited from Andrej Karpathy's lecture code.
GPTFrame is the framework of decoder only transformer, trained on little shakespeare data, can generate to some extent shakespeare style texts.
ReproduceGPT2 is going to implement training method for efficiency that will complexify the model thus empower it to have teeth and to reproduce GPT2.
-
Notifications
You must be signed in to change notification settings - Fork 0
MerlinRaptor/DigGPT
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Transformer from scratch.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published