How much GPU power does it consume?

[Song367]

How much GPU power does it consume? Is the GPU memory usage for each model similar to Ollama's?

[github-actions]

👋 Hi! This issue might be similar to existing reports.

This issue is similar to recent issues regarding resource consumption and performance metrics, specifically relating to GPU usage and memory utilization comparisons with other models like Ollama.

Please search through existing issues to see if this has been reported already. If it's indeed a duplicate, feel free to close this issue and add your details to the existing one.

If this is unique, please disregard this message!

This is an automated check to help keep our issue tracker organized.