Skip to content

.Net: [WIP] OTel model diagnostics: streaming APIs #6242

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

TaoChenOSU
Copy link
Contributor

@TaoChenOSU TaoChenOSU commented May 14, 2024

Motivation and Context

Previously (#6150) we added support for OTel (LLM semantic conventions) to non-streaming APIs in the AI connectors. This PR adds that to streaming APIs.

Description

  1. Add OTel (LLM semantic conventions) to streaming APIs.
  2. Update the telemetry sample to use streaming APIs along with non-streaming ones..

Contribution Checklist

@TaoChenOSU TaoChenOSU self-assigned this May 14, 2024
@TaoChenOSU TaoChenOSU requested a review from a team as a code owner May 14, 2024 06:05
@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code kernel Issues or pull requests impacting the core kernel labels May 14, 2024
@github-actions github-actions bot changed the title [WIP] OTel model diagnostics: streaming APIs .Net: [WIP] OTel model diagnostics: streaming APIs May 14, 2024
@TaoChenOSU TaoChenOSU requested a review from stephentoub May 14, 2024 22:05
@TaoChenOSU TaoChenOSU added this pull request to the merge queue May 15, 2024
Merged via the queue into microsoft:main with commit b99b77f May 15, 2024
15 checks passed
@TaoChenOSU TaoChenOSU deleted the taochen/otel-model-diagnostics-streaming branch May 15, 2024 19:55
LudoCorporateShark pushed a commit to LudoCorporateShark/semantic-kernel that referenced this pull request Aug 25, 2024
### Motivation and Context

<!-- Thank you for your contribution to the semantic-kernel repo!
Please help reviewers and future users, providing the following
information:
  1. Why is this change required?
  2. What problem does it solve?
  3. What scenario does it contribute to?
  4. If it fixes an open issue, please link to the issue here.
-->
Previously (microsoft#6150) we
added support for OTel (LLM semantic conventions) to non-streaming APIs
in the AI connectors. This PR adds that to streaming APIs.

### Description

<!-- Describe your changes, the overall approach, the underlying design.
These notes will help understanding how your code works. Thanks! -->
1. Add OTel (LLM semantic conventions) to streaming APIs.
2. Update the telemetry sample to use streaming APIs along with
non-streaming ones..

### Contribution Checklist

<!-- Before submitting this PR, please make sure: -->

- [ ] The code builds clean without any errors or warnings
- [ ] The PR follows the [SK Contribution
Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
and the [pre-submission formatting
script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
raises no violations
- [ ] All unit tests pass, and I have added new tests where possible
- [ ] I didn't break anyone 😄
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kernel Issues or pull requests impacting the core kernel .NET Issue or Pull requests regarding .NET code
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants