Skip to content

Feature Request: Support for Model Context Protocol (MCP) #2662

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
nirga opened this issue Feb 18, 2025 · 5 comments · May be fixed by #2829
Open

Feature Request: Support for Model Context Protocol (MCP) #2662

nirga opened this issue Feb 18, 2025 · 5 comments · May be fixed by #2829
Labels
enhancement New feature or request

Comments

@nirga
Copy link
Member

nirga commented Feb 18, 2025

Summary
Add support for the Model Context Protocol (MCP) in openllmetry to enhance compatibility with standardized model context tracking and improve observability for generative AI workflows.

Background
MCP provides a standardized way to define and propagate contextual metadata across AI/ML inference workflows. Integrating MCP with openllmetry can enable better context-aware logging, tracing, and performance analysis.

Proposed Solution
Implement MCP-compatible context propagation in openllmetry, ensuring seamless integration with OpenTelemetry-based tracing.
Map existing openllmetry context attributes to MCP's schema where applicable.
Provide utilities or middleware to facilitate MCP adoption for users of openllmetry.
Ensure compatibility with frameworks like LangChain, LlamaIndex, and other AI model orchestration tools.

Open Questions
What is the best way to structure MCP integration within openllmetry?
Should we provide automatic instrumentation for MCP, or require explicit user adoption?
Are there any existing MCP-compatible libraries we can leverage?

Next Steps
Investigate MCP’s data model and how it aligns with openllmetry.
Design an integration approach (manual vs. automatic context propagation).
Implement a prototype and test with supported AI model frameworks.
Gather feedback from users and iterate.

@dosubot dosubot bot added the enhancement New feature or request label Feb 18, 2025
@gyliu513
Copy link
Contributor

@gyliu513
Copy link
Contributor

gyliu513 commented Apr 3, 2025

Hey @nirga , our IBM team want to contribute a PR for this, what do you think?

@RATIBHA-Moogi ^^

@fali007
Copy link

fali007 commented Apr 8, 2025

Thankyou @gyliu513 ,
We would be more than happy to add mcp observability into traceloop. Will share a draft PR at most by end of the week. We are following the semantic conventions discussed here

@gyliu513
Copy link
Contributor

gyliu513 commented Apr 8, 2025

@fali007 Yes, traceloop first, then we can check how to contribute to otel/mcp to be a standard.

@gyliu513
Copy link
Contributor

Some discussion in MCP modelcontextprotocol/modelcontextprotocol#269

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants