Look at the metadata extension of probot

[smover]

This probot extension: https://github.com/probot/metadata saves metadata in the comments on github.

Metadata can be used to store more context directly in the comment, instead of navigating the chain of messages upward.