Permission denied on state

[jhammarstedt]

I have different vector databases and I want to be able to dynamically set them and call the VertexAiRagRetrival tool. In the examples I see it's only set from .env but looking at all samples it looks very doable to set it from state. However I keep getting

raise ClientError(status_code, response_json, response)
google.genai.errors.ClientError: 403 PERMISSION_DENIED. {'error': {'code': 403, 'message': 'Permission denied on resource project {vector_db_id}.', 'status': 'PERMISSION_DENIED', 'details': [{'@type': 'type.googleapis.com/google.rpc.ErrorInfo', 'reason': 'CONSUMER_INVALID', 'domain': 'googleapis.com', 'metadata': {'containerInfo': '{vector_db_id}', 'service': 'aiplatform.googleapis.com', 'consumer': 'projects/{vector_db_id}'}}, {'@type': 'type.googleapis.com/google.rpc.LocalizedMessage', 'locale': 'en-US', 'message': 'Permission denied on resource project {vector_db_id}.'}, {'@type': 'type.googleapis.com/google.rpc.Help', 'links': [{'description': 'Google developers console', 'url': 'https://console.developers.google.com'}]}]}}

I use a DatabaseSessionFactory so I have it saved, and the print works fine but I cannot access later.

def get_vector_db_id(callback_context: CallbackContext):
    vector_db_id = callback_context.state.get("vector_db_id")
    print(f"Vector DB ID: {vector_db_id}")
    callback_context.state["vector_db_id"] = vector_db_id


ask_vertex_retrieval = VertexAiRagRetrieval(
    name="retrieve_rag_documentation",
    description=(
        "Use this tool to retrieve documentation and reference materials for the question from the RAG corpus,"
    ),
    rag_resources=[
        rag.RagResource(
            rag_corpus="{vector_db_id}"
        )
    ],
    similarity_top_k=10,
    vector_distance_threshold=0.6,
)


document_search_agent = Agent(
    model="gemini-2.0-flash",
    name="document_search_agent",
    description="Use this agent to search the RAG corpus for information on uploaded documents",
    tools=[
        ask_vertex_retrieval,
    ],
    instruction=prompt,
    before_agent_callback=get_vector_db_id,
)

[boyangsvl]

Using state variables in tool initialization is not supported. You can create your own tool which reads from the state and use that value to create a RAG tool yourself.

[jhammarstedt]

Yea figured as much, thanks for clarifying! Do you have any best practice of doing this/sample somewhere for a generic document tool that sets the corpus_id from state?

[jhammarstedt]

@boyangsvl