Skip to content

Commit 3271f69

Browse files
yinggehrmccorm4
andauthored
fix: Lock httpx version to fix L0_openai--trtllm test failures (#7870) (#7881)
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
1 parent 2973a25 commit 3271f69

File tree

2 files changed

+5
-2
lines changed

2 files changed

+5
-2
lines changed

python/openai/openai_frontend/main.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,11 +65,11 @@ def start_kserve_frontends(server, args):
6565
from tritonfrontend import KServeGrpc, KServeHttp
6666

6767
http_options = KServeHttp.Options(address=args.host, port=args.kserve_http_port)
68-
http_service = KServeHttp.Server(server, http_options)
68+
http_service = KServeHttp(server, http_options)
6969
http_service.start()
7070

7171
grpc_options = KServeGrpc.Options(address=args.host, port=args.kserve_grpc_port)
72-
grpc_service = KServeGrpc.Server(server, grpc_options)
72+
grpc_service = KServeGrpc(server, grpc_options)
7373
grpc_service.start()
7474

7575
except ModuleNotFoundError:

python/openai/requirements.txt

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,4 +26,7 @@
2626

2727
# FastAPI Application
2828
fastapi==0.111.1
29+
# Fix httpx version to avoid bug in openai library:
30+
# https://community.openai.com/t/error-with-openai-1-56-0-client-init-got-an-unexpected-keyword-argument-proxies/1040332/3
31+
httpx==0.27.2
2932
openai==1.40.6

0 commit comments

Comments
 (0)