Fix token usage / cost often being underreported

[chrarnoldus]

Kilo Code PR: Kilo-Org/kilocode#1447

Description

Roo Code often underreports the total cost of a task, because the cost of some requests are missing. For example:

The first $0.00677 request is missing its cost in the UI, while requests 2-4 are not. Also the total cost (should be $0.0816) is off.

This is because a request is abandoned before the usage block has been processed when an LLM tries to use multiple tools (only one is allowed in the rules):

Roo-Code/src/core/task/Task.ts

Line 1430 in 714fafd

if (this.didAlreadyUseTool) {

(this code is inherited from Cline)

Test Procedure

Run tasks with a variety of providers and models and verify all requests have a cost reported. Kimi K2 seems to be especially affected. Sonnet 4 sometimes, Gemini 2.5 Pro not so much.

I did test this with OpenRouter and costs are reported more reliably than before. Also tested with Anthropic and Ollama for regressions.

Pre-Submission Checklist

• Issue Linked: This PR is linked to an approved GitHub Issue (see "Related GitHub Issue" above).
• Scope: My changes are focused on the linked issue (one major feature/fix per PR).
• Self-Review: I have performed a thorough self-review of my code.
• Testing: New and/or updated tests have been added to cover my changes (if applicable).
• Documentation Impact: I have considered if my changes require documentation updates (see "Documentation Updates" section below).
• Contribution Guidelines: I have read and agree to the Contributor Guidelines.

Screenshots / Videos

In this screenshot all costs are reported and the tally is correct ($0.0591):

Additional Notes

I'll add some comments to the code.

Get in Touch

Christiaan in shared Slack

---

Important

Fixes underreporting of token usage and cost in Task.ts by processing all request chunks and updating usage data even if requests are interrupted.

• Behavior:
  • Fixes underreporting of token usage and cost in Task class in Task.ts by ensuring all request chunks are processed.
  • Adds drainStreamInBackgroundToFindAllUsage() to process remaining chunks and update usage data even if a request is interrupted.
• Functions:
  • Modifies recursivelyMakeClineRequests() to handle incomplete requests by processing all chunks in the background.
  • Updates updateApiReqMsg() to include all token and cost data.
• Misc:
  • Removes redundant TelemetryService call for capturing LLM completion in the main loop, now handled in the background task.

^{This description was created by for 60f0a03. You can customize this summary. It will automatically update as commits are pushed.}

[chrarnoldus]

The comment calls out OpenRouter specifically, but I think if seen usage being misreported with other providers as well.

[chrarnoldus]

Not sure if calling this is enough... I think it won't update the UI if the usage arrives after the task finished (you need to reopen the task).

[chrarnoldus]

I have seen this happen, but so far only with OpenRouter routing to BaseTen.