Seeking advice: Agent ainvote and astrieam execute asynchronously in an infinite loop without outputting any results.

[aliang-123]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

python
from chatglm_LLM import ChatGlm_LLM

import datetime
import json
import os
import re
import traceback

import torch
import uvicorn
from fastapi import FastAPI, Request, HTTPException, APIRouter
from fastapi_utils.cbv import cbv
import asyncio
from langchain.agents import initialize_agent, AgentType,  AgentExecutor
from langchain_core.output_parsers import StrOutputParser
from langchain.tools import StructuredTool

from global_params import logger
# from untils_tools import func_map, tools
from untils_functions.base_info import base_info

# system_info = {
#     "role": "system",
#     "content": '',
#     # "content": "Answer the following questions as best as you can. You have access to the following tools:",
#     # "content": "你是一个工具调用助手，对于用户的问题，你只能调用对应的工具来回答，你应该拒绝回答不需要调用工具的任何问题，你可以调用以下工具：",
#     "tools": tools
# }
async def main():
    messages = [
                {"role": "system",
                "content": """当使用function时，要牢记其参数已经明确定义，不得随意更改或新增。比如processData(x, y, z)，
                    只能接受这三个参数x、y、z，任何额外的参数都是不允许的，并且会导致错误。如果你擅自修改function的参数，就会引发严重错误。"""},
                {"role": "system",
                "content": """当使用function时，请只返回function的必要信息，不要多余。例如processData(x, y, z)，请只返回'processData\n{'x'=x, 'y'=y, 'z'=z}'，不要多余的信息。"""},
                {"role": "system",
                "content": "影城=影院，影城编码=影院编码，影城名称=影院名称"
                }
                ]
    messages.append({"role": "system", "content": "对所有问题，都请使用中文回答"})
    # messages.append({"role": "user", "content": "{input}"})
    messages.append({"role": "placeholder", "content": "{agent_scratchpad}"})

    model_path = os.environ.get('MODEL_PATH')
    chatglm = ChatGlm_LLM(model_path=model_path)

    output_parser = StrOutputParser()

    from langchain_core.prompts import ChatPromptTemplate
    # tool = StructuredTool.from_function(coroutine=base_info, )
    tools = [base_info
            ]
    promat = ChatPromptTemplate.from_messages(messages)
    llm = promat | chatglm | output_parser

    agent = initialize_agent(tools, llm, agent=AgentType.STRUCTURED_CHAT_ZERO_SHOT_REACT_DESCRIPTION, verbose=True, handle_parsing_errors=False)
    # x = await agent.ainvoke('查询北京市海淀区魔影国际影城吉彩店在2023年的总票房')
    async for chunk in agent.astream("查询北京市海淀区魔影国际影城吉彩店在2023年的总票房"):
        # chunks.append(chunk)
        print(chunk, flush=True)
    print('*'*50)
    # print(x)

# app = FastAPI()
# router = APIRouter()
asyncio.run(main())

### Description

As the title suggests, I have created a custom tool that can be called using an agent. I guarantee that the tool is usable. When attempting asynchronous calls, it will repeatedly execute many times and get stuck in a certain place. The program neither ends normally nor reports an error before being launched. The code is as follows:

I saw on the official website that the parameter handle_rasing.errors can be automatically called again when the large model outputs error results. I deliberately turned it off, but it still remains the same.. The final output panel looks like this:

![image](https://github.com/user-attachments/assets/38e5c9f5-fc05-42a3-ad7c-06d078ed3148)
You can see that the program keeps looping and outputting something, and even when I paste it, the program still hasn't ended

### System Info

System Information
------------------
> OS:  Linux
> OS Version:  #1 SMP PREEMPT_DYNAMIC Debian 6.1.115-1 (2024-11-01)
> Python Version:  3.11.2 (main, Nov 30 2024, 21:22:50) [GCC 12.2.0]

Package Information
-------------------
> langchain_core: 0.3.49
> langchain: 0.3.21
> langchain_community: 0.3.20
> langsmith: 0.3.18
> langchain_openai: 0.3.11
> langchain_text_splitters: 0.3.7

Optional packages not installed
-------------------------------
> langserve

Other Dependencies
------------------
> aiohttp<4.0.0,>=3.8.3: Installed. No version info available.
> async-timeout<5.0.0,>=4.0.0;: Installed. No version info available.
> dataclasses-json<0.7,>=0.5.7: Installed. No version info available.
> httpx: 0.28.1
> httpx-sse<1.0.0,>=0.4.0: Installed. No version info available.
> jsonpatch<2.0,>=1.33: Installed. No version info available.
> langchain-anthropic;: Installed. No version info available.
> langchain-aws;: Installed. No version info available.
> langchain-azure-ai;: Installed. No version info available.
> langchain-cohere;: Installed. No version info available.
> langchain-community;: Installed. No version info available.
> langchain-core<1.0.0,>=0.3.45: Installed. No version info available.
> langchain-core<1.0.0,>=0.3.49: Installed. No version info available.
> langchain-deepseek;: Installed. No version info available.
> langchain-fireworks;: Installed. No version info available.
> langchain-google-genai;: Installed. No version info available.
> langchain-google-vertexai;: Installed. No version info available.
> langchain-groq;: Installed. No version info available.
> langchain-huggingface;: Installed. No version info available.
> langchain-mistralai;: Installed. No version info available.
> langchain-ollama;: Installed. No version info available.
> langchain-openai;: Installed. No version info available.
> langchain-text-splitters<1.0.0,>=0.3.7: Installed. No version info available.
> langchain-together;: Installed. No version info available.
> langchain-xai;: Installed. No version info available.
> langchain<1.0.0,>=0.3.21: Installed. No version info available.
> langsmith-pyo3: Installed. No version info available.
> langsmith<0.4,>=0.1.125: Installed. No version info available.
> langsmith<0.4,>=0.1.17: Installed. No version info available.
> numpy<3,>=1.26.2: Installed. No version info available.
> openai-agents: Installed. No version info available.
> openai<2.0.0,>=1.68.2: Installed. No version info available.
> opentelemetry-api: Installed. No version info available.
> opentelemetry-exporter-otlp-proto-http: Installed. No version info available.
> opentelemetry-sdk: Installed. No version info available.
> orjson: 3.10.15
> packaging: 24.2
> packaging<25,>=23.2: Installed. No version info available.
> pydantic: 2.10.6
> pydantic-settings<3.0.0,>=2.4.0: Installed. No version info available.
> pydantic<3.0.0,>=2.5.2;: Installed. No version info available.
> pydantic<3.0.0,>=2.7.4: Installed. No version info available.
> pydantic<3.0.0,>=2.7.4;: Installed. No version info available.
> pytest: 8.3.4
> PyYAML>=5.3: Installed. No version info available.
> requests: 2.32.3
> requests-toolbelt: 1.0.0
> requests<3,>=2: Installed. No version info available.
> rich: 13.9.4
> SQLAlchemy<3,>=1.4: Installed. No version info available.
> tenacity!=8.4.0,<10,>=8.1.0: Installed. No version info available.
> tenacity!=8.4.0,<10.0.0,>=8.1.0: Installed. No version info available.
> tiktoken<1,>=0.7: Installed. No version info available.
> typing-extensions>=4.7: Installed. No version info available.
> zstandard: 0.23.0