VIPTR support

[sneakybatman]

Hello,

I see there is no support for viptr models in onnxtr. Is there a plan to add this support?

Thanks.

[felixdittrich92]

Hey :)
Yes we published the pretrained checkpoint in doctr a few hrs ago (so it's available on main branch)
For OnnxTR it's already here #73
But anything with the export wasn't fine so I will check this tomorrow :)

[felixdittrich92]

Anyway the model does still not work well after exporting.

Tried already an newer opset version, keeping the initializers as inputs and so on ..it's not really clear because the diff between the exported and original pytorch model is also < 4e-5 🤔

[felixdittrich92]

Released in v0.7.1

[sneakybatman]

Awesome. Thanks! I will try it out. Do you plan to also release viptr_base or its going to be viptr_tiny only?

[felixdittrich92]

We dropped the base config in docTR because it hasn't worked well - so only the tiny versions is available in docTR and OnnxTR

[sneakybatman]

Makes sense, I faced the same issue when I trained it from scratch. Can you share the performance metrics for the tiny versions? I want to see how they compare specially to parseq.

[sneakybatman]

Nevermind, I found it. Not sure how good it will be for diacritics. I will give it a try to fine tune it. Thanks for all the efforts. :)