Skip to content

Commit a981a72

Browse files
committed
[Frontend] OpenAI Responses API supports Tool/Function calling
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
1 parent 42d98f9 commit a981a72

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/entrypoints/openai/serving_engine.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1059,12 +1059,12 @@ def _get_model_name(self,
10591059

10601060
def _get_tool_parser(
10611061
self,
1062-
tool_parser_name: str,
1062+
tool_parser_name: Optional[str] = None,
10631063
enable_auto_tools: bool = False
10641064
) -> Optional[Callable[[AnyTokenizer], ToolParser]]:
10651065
"""Get the tool parser based on the name."""
10661066
parser = None
1067-
if not enable_auto_tools:
1067+
if not enable_auto_tools or tool_parser_name is None:
10681068
return parser
10691069
logger.info(
10701070
"\"auto\" tool choice has been enabled please note that while"

0 commit comments

Comments
 (0)