NLP Tasks using PyTorch, on Google Cloud TPUs
Here are jupyter notebooks where I show a number of NLP tasks sped up using Google Cloud TPUs and PyTorch XLA. This repository is a work in progress! Check back soon for more content.
Notebooks Added
- Language Modeling (DistilGPT Finetuning, WikiText-2)
- Text Classification (DistilBERT Finetuning, Kaggle Toxic Comments Challenge)
All notebooks are runnable on Google Colab TPU Notebooks unless specified.