Migrating from v0.0 chains: how to pass verbose flag?

[supreetkt]

In ConversationChain, you can pass verbosity flag:

chain = ConversationChain(
            llm=llm, verbose=verbose, memory=conversation_memory, prompt=prompt_template
        )

how do I pass this using LCEL chains?

[dosubot[bot]]

To pass the verbose flag using LCEL chains when migrating from v0.0 chains, you can set the verbose parameter in the invoke method. Here is how you can do it:

qa_chain.invoke("What are autonomous agents?", verbose=True)

This will enable verbose output for the LCEL chain ^[1].

To continue talking to Dosu, mention @dosu.

[supreetkt]

@dosu
I used the following sample code:

from langchain_core.runnables.history import RunnableWithMessageHistory
from langchain_core.chat_history import InMemoryChatMessageHistory
from langchain_aws.chat_models.bedrock import ChatBedrock
from langchain_core.chat_history import InMemoryChatMessageHistory
from langchain_core.prompts import PromptTemplate


# Define a simple chain
prompt = PromptTemplate(
    input_variables=["question"],
    template="Answer the following question: {question}"
)
chain = prompt | ChatBedrock(model_id="anthropic.claude-v2")

# Define a function to get the chat history for a session
def get_session_history(session_id: str):
    return InMemoryChatMessageHistory(session_id=session_id)

# Wrap the chain with RunnableWithMessageHistory
chain_with_history = RunnableWithMessageHistory(
    chain,
    get_session_history,
    input_messages_key="question",
    history_messages_key="chat_history"
)

# Invoke the wrapped chain with a session ID
response = chain_with_history.invoke(
    {"question": "What is the capital of France?"},
    config={"configurable": {"session_id": "abc123"}}, verbose=True
)

print(response.content)

Per your suggestion, I passed verbose flag with RunnableWithMessageHistory and I got the error: TypeError: RunnableParallel.invoke() got an unexpected keyword argument 'verbose'

[dosubot[bot]]

To pass the verbose flag when using RunnableWithMessageHistory without encountering a TypeError, you need to include the verbose parameter within the config dictionary. Here is the corrected version of your code:

from langchain_core.runnables.history import RunnableWithMessageHistory
from langchain_core.chat_history import InMemoryChatMessageHistory
from langchain_aws.chat_models.bedrock import ChatBedrock
from langchain_core.prompts import PromptTemplate

# Define a simple chain
prompt = PromptTemplate(
    input_variables=["question"],
    template="Answer the following question: {question}"
)
chain = prompt | ChatBedrock(model_id="anthropic.claude-v2")

# Define a function to get the chat history for a session
def get_session_history(session_id: str):
    return InMemoryChatMessageHistory(session_id=session_id)

# Wrap the chain with RunnableWithMessageHistory
chain_with_history = RunnableWithMessageHistory(
    chain,
    get_session_history,
    input_messages_key="question",
    history_messages_key="chat_history"
)

# Invoke the wrapped chain with a session ID and verbose flag
response = chain_with_history.invoke(
    {"question": "What is the capital of France?"},
    config={"configurable": {"session_id": "abc123"}, "verbose": True}
)

print(response.content)

In this example, the verbose flag is included in the config dictionary passed to the invoke method. This should prevent any TypeError related to missing or unexpected parameters ^[1].

To continue talking to Dosu, mention @dosu.

[supreetkt]

@dosu
That didn't work either.

[dosubot[bot]]

To correctly pass the verbose flag when using RunnableWithMessageHistory, ensure that the verbose parameter is included within the config dictionary under the configurable key. Here is the updated code:

from langchain_core.runnables.history import RunnableWithMessageHistory
from langchain_core.chat_history import InMemoryChatMessageHistory
from langchain_aws.chat_models.bedrock import ChatBedrock
from langchain_core.prompts import PromptTemplate

# Define a simple chain
prompt = PromptTemplate(
    input_variables=["question"],
    template="Answer the following question: {question}"
)
chain = prompt | ChatBedrock(model_id="anthropic.claude-v2")

# Define a function to get the chat history for a session
def get_session_history(session_id: str):
    return InMemoryChatMessageHistory(session_id=session_id)

# Wrap the chain with RunnableWithMessageHistory
chain_with_history = RunnableWithMessageHistory(
    chain,
    get_session_history,
    input_messages_key="question",
    history_messages_key="chat_history"
)

# Invoke the wrapped chain with a session ID and verbose flag
response = chain_with_history.invoke(
    {"question": "What is the capital of France?"},
    config={"configurable": {"session_id": "abc123", "verbose": True}}
)

print(response.content)

In this example, the verbose flag is correctly included within the configurable dictionary inside the config parameter ^[1][2].

To continue talking to Dosu, mention @dosu.

[supreetkt]

@dosu
That didn't work as well.

[dosubot[bot]]

To correctly pass the verbose flag when using RunnableWithMessageHistory, you need to include it in the config dictionary, but not under the configurable key. Here is the correct way to do it:

from langchain_core.runnables.history import RunnableWithMessageHistory
from langchain_core.chat_history import InMemoryChatMessageHistory
from langchain_aws.chat_models.bedrock import ChatBedrock
from langchain_core.prompts import PromptTemplate

# Define a simple chain
prompt = PromptTemplate(
    input_variables=["question"],
    template="Answer the following question: {question}"
)
chain = prompt | ChatBedrock(model_id="anthropic.claude-v2")

# Define a function to get the chat history for a session
def get_session_history(session_id: str):
    return InMemoryChatMessageHistory(session_id=session_id)

# Wrap the chain with RunnableWithMessageHistory
chain_with_history = RunnableWithMessageHistory(
    chain,
    get_session_history,
    input_messages_key="question",
    history_messages_key="chat_history"
)

# Invoke the wrapped chain with a session ID and verbose flag
response = chain_with_history.invoke(
    {"question": "What is the capital of France?"},
    config={"configurable": {"session_id": "abc123"}, "verbose": True}
)

print(response.content)

Ensure that the verbose flag is directly within the config dictionary, not nested under configurable ^[1][2][3].

To continue talking to Dosu, mention @dosu.

[supreetkt]

I've tried it both ways. It doesn't work. Please suggest an alternative.