Adding a bing search tool to a as_chat_engine model ?

[Pentar0o]

Hi,

I try to add a bing search tool to a as_chat_engine object but it doesn't ask bing so maybe I'm missing something ?
I don't get any errors by executing this code so I'm confused.

There is my code :

Cortana = HuggingFaceLLM(
model_name="meta-llama/Llama-3.2-3B-Instruct",
tokenizer_name="meta-llama/Llama-3.2-3B-Instruct",
context_window=context_size,
model_kwargs={"torch_dtype": torch.bfloat16},
generate_kwargs={"temperature": 0.1, "top_k": 3, "top_p": 0.95},
system_prompt=system_prompt,
device_map="auto",
)

from llama_index.tools.bing_search import BingSearchToolSpec
tool_spec = BingSearchToolSpec(
api_key=subscription_key,
lang="fr-FR")

global_chat_engine = global_index.as_chat_engine(
chat_mode="context",
memory=ChatMemoryBuffer.from_defaults(token_limit=token_limit),
token_limit = token_limit,
llm = Cortana,
streaming=True,
similarity_top_k=1,
system_prompt=system_prompt,
tool_spec = tool_spec,
)

[dosubot[bot]]

To integrate a Bing search tool into your as_chat_engine model, ensure you follow these steps:

1. Import and Setup: Make sure you have imported the necessary modules and set up your API keys correctly.

2. BingSearchToolSpec: Initialize the BingSearchToolSpec with your Bing API key. Ensure the key is valid and correctly set up in Azure.

3. OpenAIAgent: Use the OpenAIAgent to incorporate the tool. Here's a refined example:

   import openai
   from llama_index.agent import OpenAIAgent
   from llama_index.tools.bing_search.base import BingSearchToolSpec
   
   openai.api_key = "sk-your-key"
   bing_tool = BingSearchToolSpec(api_key="your-key")
   
   agent = OpenAIAgent.from_tools(
       bing_tool.to_tool_list(),
       verbose=True,
   )
   
   # Use the agent to perform searches
   print(agent.chat("what's the latest news about superconductors"))

4. Check Integration: Ensure the tool_spec is correctly passed to the as_chat_engine method. If the Bing tool is not being used, verify that the tool_spec parameter is correctly integrated and that the chat engine is set to utilize it.

5. Debugging: If it still doesn't work, add logging or print statements to check if the tool is being called.

By following these steps, you should be able to integrate the Bing search tool successfully ^[1][2].

To continue talking to Dosu, mention @dosu.

[Pentar0o]

I don't want to do this either with OpenAI or an agent but with Huggingface and a VectorStoreIndex.as_chat_engine.