@@ -69,23 +69,26 @@ There's more information on the API [here](doc/API.md).
69
69
70
70
## Building
71
71
72
- The build dependencies are:
72
+ If you are building a docker image, you just need Docker installed:
73
+
74
+ * ` DOCKER_REGISTRY=docker.io/user make docker ` - builds a docker container with the
75
+ server binary, tagged to a specific registry
76
+
77
+ If you want to build the server yourself for your specific combination of hardware,
78
+ you can use the ` Makefile ` in the root directory and have the following dependencies
79
+ met:
73
80
74
81
* Go 1.22
75
82
* C++ compiler
76
83
* FFmpeg 6.1 libraries (see [ here] ( doc/build.md ) for more information)
77
84
* For CUDA, you'll need the CUDA toolkit including the ` nvcc ` compiler
78
85
79
- If you want to build the server yourself for your specific combination of hardware,
80
- you can use the ` Makefile ` in the root directory. You'll need go 1.22, ` make ` and
81
- a C++ compiler to build this project. The following ` Makefile ` targets can be used:
86
+ The following ` Makefile ` targets can be used:
82
87
83
88
* ` make server ` - creates the server binary, and places it in the ` build ` directory. Should
84
89
link to Metal on macOS
85
90
* ` GGML_CUDA=1 make server ` - creates the server binary linked to CUDA, and places it
86
91
in the ` build ` directory. Should work for amd64 and arm64 (Jetson) platforms
87
- * ` DOCKER_REGISTRY=docker.io/user make docker ` - builds a docker container with the
88
- server binary, tagged to a specific registry
89
92
90
93
See all the other targets in the ` Makefile ` for more information.
91
94
0 commit comments