Computational resources for inference

[rabeya-akter]

What are the computational requirements for inference? Would inferring this model using a Raspberry Pi 5 with an AI Hat work?

[RetroCirce]

I think the model needs around 1GB GPU memory for inference. It might still be challenging on the edge device as we previously had some attempts on it.