-
Notifications
You must be signed in to change notification settings - Fork 99
1912/3 update bechmark tests #1915
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: 1912/2-use-new-json-input
Are you sure you want to change the base?
1912/3 update bechmark tests #1915
Conversation
7fb9a5a
to
855e43e
Compare
c801b03
to
1011d52
Compare
855e43e
to
4e70d06
Compare
1011d52
to
09dbcb7
Compare
09dbcb7
to
d00af3d
Compare
4e70d06
to
291303c
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for this massive effort 😄 Just a handful of clarification questions and comments on the resulting changes
Running with 2 warm iterations and 1 running iterations | ||
The random seed for right hand sides is 42 | ||
Running cg with 1000 iterations and residual goal of 1.000000e-06 | ||
Running with 1000 iterations and residual goal of 1.000000e-06 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
double spaces here?
Running test case stencil(100, 7pt) | ||
|
||
Running test case | ||
{"operator":{"stencil":{"name":"7pt","size":100}},"preconditioner":{"type":"preconditioner::Jacobi","max_block_size":32,"storage_optimization":[0,0],"skip_sorting":true},"format":"csr"} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's again one of these places where I think giving names to inputs and benchmarks would be useful
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do you mean something like just printing the number of the json input?
Otherwise, I think we can't simplify the json representation, since we don't know what the important (i.e. changing between cases) part is.
} | ||
"repetitions": 1 | ||
}, | ||
"completed": true |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For my understanding: what happens, if individual benchmarks in here throw exceptions? Is completed then false for everything?
291303c
to
ee9aa01
Compare
d00af3d
to
2756446
Compare
This PR updates the benchmark tests with the new input.