Evaluate using Profile-Guided Optimization (PGO) and Post-Link Optimization (PLO)

[zamazan4ik]

Hi!

Recently I checked Profile-Guided Optimization (PGO) improvements on multiple projects including many projects (including logging solutions like Vector and fluent-bit) - the results are available in the awesome-pgo repo. Since PGO has helped in many cases, I think it would be a good idea to try optimizing arkflow by applying PGO to it.

I can suggest the following things to do:

• We need to perform PGO benchmarks on arkflow. If it shows improvements - add a note about possible improvements to the documentation. Providing an easier way (e.g. a build option) to build scripts to build arkflow with PGO can be useful for the end-users too.
• It will be a good idea to integrate building with PGO into your CI pipelines. In this case, users will get already PGO-optimized binaries from the website

Here you can find different materials about PGO: benchmarks for multiple apps, examples of how PGO is already integrated with various projects, PGO support in multiple Rust compilers, and some PGO-related pieces of advice.

After PGO, I suggest evaluating the Post-Link Optimization (with tools like LLVM BOLT) - it can give more aggressive optimizations even after PGO. However, starting with regular PGO will be easier to do.

Thank you.

[chenquan]

Sorry, I didn't notice your discussion before. Thank you for your suggestion. Could you initiate PR to help me imPRove it?

[zamazan4ik]

Could you initiate PR to help me imPRove it?

I don't think that I'll have enough type soon to prepare at least a prototype with PGO for arkflow. Maybe one day... ;)