Skip to content

Commit 11dd5cf

Browse files
committed
[Frontend] OpenAI Responses API supports Tool/Function calling
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
1 parent b1b687c commit 11dd5cf

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/entrypoints/openai/serving_engine.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1050,12 +1050,12 @@ def _get_model_name(self,
10501050

10511051
def _get_tool_parser(
10521052
self,
1053-
tool_parser_name: str,
1053+
tool_parser_name: Optional[str] = None,
10541054
enable_auto_tools: bool = False
10551055
) -> Optional[Callable[[AnyTokenizer], ToolParser]]:
10561056
"""Get the tool parser based on the name."""
10571057
parser = None
1058-
if not enable_auto_tools:
1058+
if not enable_auto_tools or tool_parser_name is None:
10591059
return parser
10601060
logger.info(
10611061
"\"auto\" tool choice has been enabled please note that while"

0 commit comments

Comments
 (0)