Skip to content

Commit de27631

Browse files
NeoZhangJianyuNeo Zhang
authored andcommitted
fix to support multiple GPUs, fix set single device, unify id/device_id/device_index
1 parent a9f3b10 commit de27631

File tree

4 files changed

+453
-221
lines changed

4 files changed

+453
-221
lines changed

ggml/include/ggml-sycl.h

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,12 @@ GGML_API GGML_CALL void ggml_sycl_get_device_description(int device, char *des
3434
GGML_API GGML_CALL int ggml_backend_sycl_get_device_count();
3535
GGML_API GGML_CALL void ggml_backend_sycl_get_device_memory(int device, size_t *free, size_t *total);
3636

37+
GGML_API GGML_CALL int ggml_backend_sycl_get_device_index(int device_id);
38+
GGML_API GGML_CALL void ggml_sycl_set_single_device(int main_gpu_id);
39+
40+
// GGML_API GGML_CALL void ggml_backend_sycl_set_single_device_mode(int main_gpu_id);
41+
// GGML_API GGML_CALL void ggml_backend_sycl_set_mul_device_mode();
42+
3743
// SYCL doesn't support registering host memory, keep here for reference
3844
// GGML_API GGML_CALL bool ggml_backend_sycl_register_host_buffer(void * buffer, size_t size);
3945
// GGML_API GGML_CALL void ggml_backend_sycl_unregister_host_buffer(void * buffer);

0 commit comments

Comments
 (0)