using fp16 or mixed precision help for inadequate vram

[parrykhai]

Will mixed-precision be able to accommodate the 10.9gb in 8gb since using fp16 essentially doubles the VRAM.

[zouchuhang]

@parrykhai I haven't tried this. It's worthwhile to give it a try. If it works, you can send a new pull request and I will accept it.