@@ -9,8 +9,6 @@ Speech-to-Text in golang. This is an early development version.
9
9
10
10
## Running
11
11
12
- (Note: Docker images are not created yet - this is some forward planning!)
13
-
14
12
You can either run the whisper service as a CLI command or in a docker container.
15
13
There are docker images for arm64 and amd64 (Intel). The arm64 image is built for
16
14
Jetson GPU support specifically, but it will also run on Raspberry Pi's.
@@ -27,11 +25,11 @@ The following command will run the server on port 8080 for an NVIDIA GPU:
27
25
docker run \
28
26
--name whisper-server --rm \
29
27
--runtime nvidia --gpus all \ # When using a NVIDIA GPU
30
- -v whisper:/models -p 8080:8080 -e WHISPER_DATA=/models \
31
- ghcr.io/mutablelogic/go-whisper
28
+ -v whisper:/data -p 8080:80 \
29
+ ghcr.io/mutablelogic/go-whisper:latest
32
30
```
33
31
34
- If you include a ` -debug ` flag at the end, you'll get more verbose output. The API is then
32
+ The API is then
35
33
available at ` http://localhost:8080/v1 ` and it generally conforms to the
36
34
[ OpenAI API] ( https://platform.openai.com/docs/api-reference/audio ) spec.
37
35
@@ -71,19 +69,19 @@ There's more information on the API [here](doc/API.md).
71
69
72
70
## Building
73
71
74
- If you are building a docker image, you just need Docker installed:
72
+ If you are building a docker image, you just need make and docker installed:
75
73
76
74
* ` DOCKER_REGISTRY=docker.io/user make docker ` - builds a docker container with the
77
75
server binary, tagged to a specific registry
78
76
79
- If you want to build the server yourself for your specific combination of hardware,
80
- you can use the ` Makefile ` in the root directory and have the following dependencies
77
+ If you want to build the server yourself for your specific combination of hardware (for example ,
78
+ on MacOS), you can use the ` Makefile ` in the root directory and have the following dependencies
81
79
met:
82
80
83
81
* Go 1.22
84
82
* C++ compiler
85
83
* FFmpeg 6.1 libraries (see [ here] ( doc/build.md ) for more information)
86
- * For CUDA, you'll need the CUDA toolkit including the ` nvcc ` compiler
84
+ * For CUDA, you'll need the CUDA toolkit installed including the ` nvcc ` compiler
87
85
88
86
The following ` Makefile ` targets can be used:
89
87
0 commit comments