Skip to content

Conversation

MarcelKoch
Copy link
Member

This PR updates the benchmark tests with the new input.

@MarcelKoch MarcelKoch self-assigned this Aug 15, 2025
@ginkgo-bot ginkgo-bot added reg:testing This is related to testing. reg:benchmarking This is related to benchmarking. labels Aug 15, 2025
@MarcelKoch MarcelKoch changed the title [bench] update tests 1912/3 update bechmark tests Aug 15, 2025
@MarcelKoch MarcelKoch force-pushed the 1912/3-update-benchmark-tests branch from 7fb9a5a to 855e43e Compare August 15, 2025 10:42
@MarcelKoch MarcelKoch force-pushed the 1912/2-use-new-json-input branch from c801b03 to 1011d52 Compare August 15, 2025 10:42
@MarcelKoch MarcelKoch force-pushed the 1912/3-update-benchmark-tests branch from 855e43e to 4e70d06 Compare August 19, 2025 14:35
@MarcelKoch MarcelKoch force-pushed the 1912/2-use-new-json-input branch from 1011d52 to 09dbcb7 Compare August 19, 2025 14:35
@MarcelKoch MarcelKoch force-pushed the 1912/2-use-new-json-input branch from 09dbcb7 to d00af3d Compare September 29, 2025 10:35
@MarcelKoch MarcelKoch force-pushed the 1912/3-update-benchmark-tests branch from 4e70d06 to 291303c Compare September 29, 2025 10:35
Copy link
Member

@upsj upsj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this massive effort 😄 Just a handful of clarification questions and comments on the resulting changes

Running with 2 warm iterations and 1 running iterations
The random seed for right hand sides is 42
Running cg with 1000 iterations and residual goal of 1.000000e-06
Running with 1000 iterations and residual goal of 1.000000e-06
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

double spaces here?

Running test case stencil(100, 7pt)

Running test case
{"operator":{"stencil":{"name":"7pt","size":100}},"preconditioner":{"type":"preconditioner::Jacobi","max_block_size":32,"storage_optimization":[0,0],"skip_sorting":true},"format":"csr"}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's again one of these places where I think giving names to inputs and benchmarks would be useful

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you mean something like just printing the number of the json input?

Otherwise, I think we can't simplify the json representation, since we don't know what the important (i.e. changing between cases) part is.

}
"repetitions": 1
},
"completed": true
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For my understanding: what happens, if individual benchmarks in here throw exceptions? Is completed then false for everything?

@MarcelKoch MarcelKoch force-pushed the 1912/3-update-benchmark-tests branch from 291303c to ee9aa01 Compare September 30, 2025 08:09
@MarcelKoch MarcelKoch force-pushed the 1912/2-use-new-json-input branch from d00af3d to 2756446 Compare September 30, 2025 08:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

reg:benchmarking This is related to benchmarking. reg:testing This is related to testing.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants