Skip to content

Commit 5c0f4b2

Browse files
authored
Disable testing bfcl in agentic accuracy demo (#3834)
CVS-177546
1 parent 448a8c3 commit 5c0f4b2

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

demos/continuous_batching/accuracy/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -109,22 +109,22 @@ openai_compatible (model_version=OpenGVLab/InternVL2_5-8B,max_retries=1), gen_kw
109109
Use [Berkeley function call leaderboard ](https://github.com/ShishirPatil/gorilla/tree/main/berkeley-function-call-leaderboard)
110110

111111

112-
```bash
112+
```text
113113
git clone https://github.com/ShishirPatil/gorilla
114114
cd gorilla/berkeley-function-call-leaderboard
115115
git checkout cd9429ccf3d4d04156affe883c495b3b047e6b64
116116
curl -s https://raw.githubusercontent.com/openvinotoolkit/model_server/refs/heads/main/demos/continuous_batching/accuracy/gorilla.patch | git apply -v
117117
pip install -e .
118118
```
119119
The commands below assumes the models is deployed with the name `ovms-model`. It must match the name set in the `bfcl_eval/constants/model_config.py`.
120-
```bash
120+
```text
121121
export OPENAI_BASE_URL=http://localhost:8000/v3
122122
bfcl generate --model ovms-model --test-category simple,multiple --temperature 0.0 --num-threads 100 -o --result-dir model_name_dir
123123
bfcl evaluate --model ovms-model --result-dir model_name_dir
124124
```
125125

126126
Alternatively, use the model name `ovms-model-stream` to run the tests with stream requests. The results should be the same.
127-
```bash
127+
```text
128128
export OPENAI_BASE_URL=http://localhost:8000/v3
129129
bfcl generate --model ovms-model-stream --test-category simple,multiple --temperature 0.0 --num-threads 100 -o --result-dir model_name_dir
130130
bfcl evaluate --model ovms-model-stream --result-dir model_name_dir

0 commit comments

Comments
 (0)