PowerInfer 11x speedup

[iplayfast]

I keep seeing posts about powerinfer https://github.com/SJTU-IPADS/PowerInfer giving an 11x speedup.
From what I understand it keeps often used terms in GPU memory and less often used terms in CPU memory.
It looks like it needs to rework models in order to accomplish this.

Any thoughts?
11x speedup!!!

[iplayfast]

I see it's been already discussed.