Skip to content

Commit 0e78c65

Browse files
Update datasets.md (#158)
Added recommended dataset profiles for four usecases --------- Co-authored-by: Mark Kurtz <mark.j.kurtz@gmail.com>
1 parent 3c33c39 commit 0e78c65

File tree

2 files changed

+7
-1
lines changed

2 files changed

+7
-1
lines changed

docs/datasets.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,13 @@ GuideLLM supports several types of datasets, each with its own advantages and us
3939

4040
Synthetic datasets allow you to generate data on the fly with customizable parameters. This is useful for controlled experiments, stress testing, and simulating specific scenarios. For example, you might want to evaluate how a model handles long prompts or generates outputs with specific characteristics.
4141

42+
For different use cases, here are the recommended dataset profiles to pass as arguments in GuideLLM:
43+
44+
- **Chat**: `--data "prompt_tokens=512,output_tokens=256"`
45+
- **RAG**: `--data "prompt_tokens=4096,output_tokens=512"`
46+
- **Summarization**: `--data "prompt_tokens=1024,output_tokens=256"`
47+
- **Code Generation**: `--data "prompt_tokens=512,output_tokens=512"`
48+
4249
#### Example Commands
4350

4451
```bash

src/guidellm/utils/cli.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,6 @@ def convert(self, value, param, ctx):
4646

4747
self.fail("; ".join(fails) or f"Invalid value: {value}") # noqa: RET503
4848

49-
5049
def get_metavar(self, param: click.Parameter) -> str:
5150
def get_choices(t: click.ParamType) -> str:
5251
meta = t.get_metavar(param)

0 commit comments

Comments
 (0)