Dependency on torchtext

It seems torchtext is a dependency of esm. However, torchtext is no longer developed and there are no wheels built for aarch64 architectures. This creates an issue when trying to develop software for aarch64 architectures. Is it possible to drop the dependency? 

See those two related issues for context:
https://github.com/pytorch/text/issues/2250
https://github.com/pytorch/text/issues/2208