Skip to content

Commit d524341

Browse files
authored
Update README.md
1 parent bb29f2c commit d524341

File tree

1 file changed

+10
-7
lines changed

1 file changed

+10
-7
lines changed

README.md

Lines changed: 10 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -4,13 +4,16 @@ Nucleus is a model server for TensorFlow and generic Python models. It is compat
44

55
Some of Nucleus's features include:
66

7-
1. TensorFlow models
8-
1. Generic Python models (PyTorch, ONNX, Sklearn, MLFlow, Numpy, Pandas, Caffe, etc)
9-
1. Serve models directly from S3 paths
10-
1. Dynamic server-side request batching
11-
1. Multi-model endpoints
12-
1. Automatic model reloading triggered on upstream change (S3 buckets)
13-
1. Model caching based on LRU policy
7+
* Generic Python models (PyTorch, ONNX, Sklearn, MLFlow, Numpy, Pandas, Caffe, etc)
8+
* TensorFlow models
9+
* CPU and GPU support
10+
* Serve models directly from S3 paths
11+
* Multiprocessing and multithreadding
12+
* Multi-model endpoints
13+
* Dynamic server-side request batching
14+
* Automatic model reloading when new model versions are uploaded to S3
15+
* Model caching based on LRU policy (disk and memory)
16+
* HTTP and gRPC support
1417

1518
# Table of contents
1619

0 commit comments

Comments
 (0)