Skip to content

Commit 3df3811

Browse files
committed
[Frontend] OpenAI Responses API supports Tool/Function calling
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
1 parent cd7b3d0 commit 3df3811

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/entrypoints/openai/serving_engine.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1055,12 +1055,12 @@ def _get_model_name(self,
10551055

10561056
def _get_tool_parser(
10571057
self,
1058-
tool_parser_name: str,
1058+
tool_parser_name: Optional[str] = None,
10591059
enable_auto_tools: bool = False
10601060
) -> Optional[Callable[[AnyTokenizer], ToolParser]]:
10611061
"""Get the tool parser based on the name."""
10621062
parser = None
1063-
if not enable_auto_tools:
1063+
if not enable_auto_tools or tool_parser_name is None:
10641064
return parser
10651065
logger.info(
10661066
"\"auto\" tool choice has been enabled please note that while"

0 commit comments

Comments
 (0)