在本地部署LLM

本repo记录了"在本地设备上部署LLM"的相关问题，包括环境配置、基础概念等，相关内容来自B站up主、知乎（在参考文献中会列出）.

环境配置

在配置LLM之前，需要完成下列事项：

1. 下载< LM Studio >，下载链接为：https://lmstudio.ai，需根据自己使用的平台来选择. I have 2 devices, one is < MacBook Pro M1 16GB+1TB > and another is < 13900kf+RTX4090 24GB >, so i download LM Studio for Windows and for Mac(M series).
2. If you are in < Mainland China >, use < Vscode > to open < path\to\lmstudio > and replace < huggingface.co > with < hf-mirror.com >; Otherwise, just ignore it.
3. Download any models you like, for example I download < DeepSeek-R1-Distill-Qwen-7B >.