Skip to content

Low accuracy issue #6

@ttl10101

Description

@ttl10101

Hello.
First of all, thank you for sharing the code.
I have one question about your work.
I am wondering if you checked the accuracy after training was completed.
When I do 1 epoch training with the train_wikitext.sh script, the loss is about 7 and the perplexity is about 951.
This value seems to be very different from the value in the paper (17.07 in terms of perplexity), so I wonder if I missed something.
Thank you in advance for your reply.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions