From 85e839594443bddc6622cf8344e429219d3a90c0 Mon Sep 17 00:00:00 2001 From: Jaime R <71790456+jjrbfi@users.noreply.github.com> Date: Thu, 30 Mar 2023 21:25:21 +0300 Subject: [PATCH] SWAP info added --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index e30452ee0b040..4c364711da82a 100644 --- a/README.md +++ b/README.md @@ -169,6 +169,8 @@ When running the larger models, make sure you have enough disk space to store al As the models are currently fully loaded into memory, you will need adequate disk space to save them and sufficient RAM to load them. At the moment, memory and disk requirements are the same. +We can use [SWAP](https://github.com/ggerganov/llama.cpp/discussions/631) to extend the virtual memory beyond the installed physical memory (RAM), to be able to use larger models if we don't have enought RAM. + | model | original size | quantized size (4-bit) | |-------|---------------|------------------------| | 7B | 13 GB | 3.9 GB |