Skip to content

Commit 43710e8

Browse files
authored
[Fix] Fix default port number in benchmark scripts (vllm-project#265)
1 parent 526df28 commit 43710e8

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

benchmarks/benchmark_serving.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -217,7 +217,7 @@ def main(args: argparse.Namespace):
217217
parser.add_argument("--backend", type=str, default="vllm",
218218
choices=["vllm", "tgi"])
219219
parser.add_argument("--host", type=str, default="localhost")
220-
parser.add_argument("--port", type=int, default=8001)
220+
parser.add_argument("--port", type=int, default=8000)
221221
parser.add_argument("--dataset", type=str, required=True,
222222
help="Path to the dataset.")
223223
parser.add_argument("--tokenizer", type=str, required=True,

benchmarks/launch_tgi_server.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/bin/bash
22

3-
PORT=8001
3+
PORT=8000
44
MODEL=$1
55
TOKENS=$2
66

0 commit comments

Comments
 (0)