Tools to generate buildfarm statistics #1285
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Jose Luis Rivero <jrivero@honurobotics.com>
|
I was able to generate statistics by merging the times for the different labels:
|
…ng/release-tools into jrivero/statistics_analysis
|
Context: nightly node creation starts at 09:00 server time (UTC) and the nightly and can run for four and a half hours until building the whole family (ends around 2:30). During that time the two Linux GPU nodes are busy full time. That is generating a 18.75% of Usage on each node linux-gpu each day. Range from 2025-03-12 18:55:02 ... 2025-03-31 23:55:01 . Using the filter out of status different of Busy/Idle in 6b9c3c6
And busy times by hour.
The busy times raise at the times of the nightlies, that is consistent with the expectation. I'm still a bit surprised about the high rates on weekends. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Still in the form of python notebooks. Not to be merge but can be played with if someone is interested.
Download the data from: https://build.osrfoundation.org/job/_agent_usage_statistics/ws/agent_data.csv/*view*/ (need to be logged into Jenkins).
Probably the most useful data right now is the usage over the weekend since we don't have a full week logged yet from Monday to Friday in the log.
For the weekdays, still more data needs to be fetched but:
Need to group times by label to obtain an absolute measure.