Transformer-pytorch

The note of "Attention is all you need", and the code of transformer in PyTorch version.
Reference:
Attention is all you need: https://dl.acm.org/doi/10.5555/3295222.3295349
The Annotated Transformer: http://nlp.seas.harvard.edu/2018/04/03/attention.html#positional-encoding
pytorch-Transformer: https://pytorch.org/docs/master/_modules/torch/nn/modules/transformer.html#Transformer
【Transformer】Aurora的文章 - 知乎: https://zhuanlan.zhihu.com/p/403433120