feat: Add support for `usage` in the OpenAI frontend TRT-LLM backend#8326

Draft

pskiran1 wants to merge 10 commits intomainfrom

spolisetty_openai_usage_trtllm

Commits on Jul 15, 2025

Enable usage for tensorrt-llm backend
pskiran1
committed

Commits on Jul 18, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Jul 20, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Jul 28, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Aug 2, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Aug 18, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Sep 3, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Sep 29, 2025

Merge branch 'main' of https://github.com/triton-inference-server/server into spolisetty_openai_usage_trtllm
pskiran1
committed

Commits on Sep 30, 2025

Update tests to use ensemble model
pskiran1
committed

Commits on Oct 6, 2025

Undo test changes
pskiran1
committed