You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+12-31Lines changed: 12 additions & 31 deletions
Original file line number
Diff line number
Diff line change
@@ -22,39 +22,27 @@
22
22
23
23
## Introduction
24
24
25
-
Easy Model Deployer is a lightweight tool designed to simplify the deployment of **Open-Source LLMs** ([Supported Models](docs/en/supported_models.md)) and Custom Models. It provides **OpenAI's Completions API** and [**LangChain Interface**](https://github.com/langchain-ai/langchain). Built for developers who need reliable and scalable model serving without complex setup, it seamlessly integrates with AWS services for efficient model deployment.
25
+
Easy Model Deployer is a lightweight tool designed for simplify deploy **Open-Source LLMs** ([Supported Models](docs/en/supported_models.md)) and Custom Models on AWS. It provides **OpenAI's Completions API** and [**LangChain Interface**](https://github.com/langchain-ai/langchain). Built for developers who need reliable and scalable model serving without complex environment setup.
26
26
27
-

27
+

28
28
29
29
**Key Features**
30
30
31
-
- One-click deployment of models to the cloud (Amazon SageMaker, Amazon ECS, Amazon EC2)
31
+
- One-click deployment of models to AWS (Amazon SageMaker, Amazon ECS, Amazon EC2)
32
32
- Diverse model types (LLMs, VLMs, Embeddings, Vision, etc.)
Install Easy Model Deployer with `pip`, currently support for Python 3.9 and above:
39
+
### Installation
40
40
41
-
```bash
42
-
pip install easy_model_deployer # or pip3 install easy_model_deployer
43
-
emd
44
-
```
45
-
46
-
Visit our [documentation](https://aws-samples.github.io/easy-model-deployer/en/installation/) to learn more.
47
-
48
-
## 🔧 Usage
49
-
50
-
### (Optional) Configure AWS Profile
51
-
52
-
> If you have already configured your AWS credentials using the AWS CLI, you can skip this step.
53
-
54
-
You can configure the AWS profile by EMD. If you don't set any AWS profile, the EMD will use the default credentials in your terminal, you can also configure your credentials by [`aws configure`](https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html#cli-configure-files-methods).
41
+
Install Easy Model Deployer with PyPI, currently support for Python 3.9 or above:
55
42
56
43
```bash
57
-
emd config set-default-profile-name
44
+
pip install easy-model-deployer
45
+
emd
58
46
```
59
47
60
48
### Bootstrap
@@ -67,18 +55,16 @@ For more information, please refer to [Architecture](https://aws-samples.github.
67
55
emd bootstrap
68
56
```
69
57
70
-
> **💡 Tip** Once you upgrade the EMD by `pip`, you need to run this command again.
58
+
> **💡 Tip** Once you upgrade the EMD by `pip`, you need to run this command again to update the environment.
71
59
72
-
### Deploy Model
60
+
### Deploy Models
73
61
74
-
Deploy models with an interactive CLI or one command.
62
+
Deploy models with an interactive CLI or one command line.
75
63
76
64
```bash
77
65
emd deploy
78
66
```
79
67
80
-

81
-
82
68
> **💡 Tip** To view all available parameters, run `emd deploy --help`.
83
69
> When you see the message "Waiting for model: ...", it means the deployment task has started and you can stop the terminal output by pressing `Ctrl+C`.
0 commit comments