Model Selection of "nucleotide-transformer"

[Lvchangze]

Dear authors:
I tried to infer your model, Molly-4B, running "scripts/inference_nt_lora.sh".
But I found that the selection of the DNA-BERT model called "nucleotide-transformer" is unclear.
I downloaded model "InstaDeepAI/nucleotide-transformer-500m-human-ref" (https://huggingface.co/InstaDeepAI/nucleotide-transformer-500m-human-ref) on HuggingFace, but it seemed there was a dimension mismatch:

`
size mismatch for dna_rna_model.esm.encoder.layer.0.output.dense.weight: copying a param with shape torch.Size([1024, 4096]) from checkpoint, the shape in current model is torch.Size([1280, 5120]).

size mismatch for dna_rna_model.esm.encoder.layer.0.LayerNorm.weight: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([1280]).

size mismatch for dna_rna_model.esm.encoder.layer.0.LayerNorm.bias: copying a param with shape torch.Size([1024]) from checkpoint, the shape in current model is torch.Size([1280]).
`

[tpoisonooo]

@royal-dargon 看起来需要细化一下使用文档，FYI

[royal-dargon]

The NT version we used is: InstaDeepAI/nucleotide-transformer-v2-500m-multi-species. We will update and improve the README soon. Thank you for your attention.