Skip to content

Commit 51dff49

Browse files
Update README.md
1 parent e39574e commit 51dff49

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

open_flamingo/eval/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ print(checkpoint_path)
4444

4545
This should place the OpenFlamingo model at the expected location in the evaluation script.
4646

47-
For TextVQA and VizWiz we expect annotations to be formatted differently than the original datasets. We provide the custom annotations in `open_flamingo/open_flamingo/eval/data/`.
47+
For TextVQA and VizWiz we expect annotations to be formatted differently than the original datasets. We provide the custom annotations in `open_flamingo/open_flamingo/eval/data/`. We have also uploaded all the annotation files in a [huggingface dataset](https://huggingface.co/datasets/openflamingo/eval_benchmark/tree/main) for easy access.
4848

4949
# Evaluating using RICES (Retrieval-based In-Context Example Selection)
5050

@@ -65,4 +65,4 @@ python cache_rices_features.py \
6565
--output_dir /path/to/coco/features
6666
```
6767

68-
This will create a directory at `/path/to/coco/features` containing a file named `coco.pkl` with the extracted features. You can then use this directory to evaluate using RICES by passing the `--rices` flag to the evaluation script, specifying the path to the features directory using the `--cached_demonstration_features` flag, and specifying the vision encoder to use for RICES using the `--rices_vision_encoder_path` and `--rices_vision_encoder_pretrained` flags.
68+
This will create a directory at `/path/to/coco/features` containing a file named `coco.pkl` with the extracted features. You can then use this directory to evaluate using RICES by passing the `--rices` flag to the evaluation script, specifying the path to the features directory using the `--cached_demonstration_features` flag, and specifying the vision encoder to use for RICES using the `--rices_vision_encoder_path` and `--rices_vision_encoder_pretrained` flags.

0 commit comments

Comments
 (0)