🗺 [instrumentation] Amazon Bedrock Agents instrumentation (client-agent-bedrock-time)

[mikeldking]

NPM: https://www.npmjs.com/package/@aws-sdk/client-bedrock-agent-runtime
Docs: https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/javascript_bedrock-agent-runtime_code_examples.html

[mikeldking]

@trevor-laviale-arize can you fill out the details?

[sammyrw234]

Prioritize Anthropic and Nova models here

[arizedatngo]

Getting some requirements for this

[arizedatngo]

SDK and APIs Used

AWS SDK for JavaScript v3: Specifically the @aws-sdk/client-bedrock-agent-runtime package

• NPM: https://www.npmjs.com/package/@aws-sdk/client-bedrock-agent-runtime
• Docs: https://docs.aws.amazon.com/sdk-for-javascript/v3/developer-guide/javascript_bedrock-agent-runtime_code_examples.html

Key APIs to Instrument

• InvokeAgent with response stream - For Bedrock agents
• InvokeModel with response stream - For direct model invocations (used by LangGraph + Bedrock model chat)

Implementation Details
Agent Invocation

Uses InvokeAgentCommand with configuration including:

• agentConfig
• modelSpecificConfigurations
• enableTrace: true
• endSession: false
• inputText: query
• sessionId
• streamingConfigurations with streamFinalResponse: true
• sessionState with session attributes including requestId

Streaming Response Handling

Responses are converted to Node.js readable streams
Uses createReadStreamFromBedrockCompletion() function that:

• Iterates through agentResponse.completion chunks
• Decodes chunks using TextDecoder().decode(chunk.bytes)
• Yields decoded chunks
• Handles trace data with optional onTrace callback
• Wraps in Readable.from() for stream compatibility

Architecture Notes

One of the teams that needs this uses both Bedrock agents and LangGraph agents
LangGraph agents use Bedrock invoke under the hood
All responses are streamed
Anthropic models
Nova models

[arizedatngo]

Note on AWS side, I was curious if difference between boto3 and JS SDK from AWS

"The metrics and traces should be identical between different SDKs. If you are seeing any discrepancies, please highlight them, I will instantly raise it to our development team to look at and help."

[mikeldking]

changing the name to JS Bedrock Agents instrumentation