Skip to content

improve evaluate outputs #453

@wsnoble

Description

@wsnoble

Currently, the evaluate option simply adds three lines to the log file, like this:

2025-04-11 17:32:38,752 INFO [casanovo/MainProcess] model_runner.log_metrics : Peptide Precision: 49.23% 2025-04-11 17:32:38,753 INFO [casanovo/MainProcess] model_runner.log_metrics : Amino Acid Precision: 71.18% 2025-04-11 17:32:38,753 INFO [casanovo/MainProcess] model_runner.log_metrics : Amino Acid Recall: 71.28%

I think we should also report average precision, and we should output a separate TSV file that allows for plotting of the precision-coverage curve. This could include the Casanovo score, ground truth and predicted peptides, correct/incorrect label, and the precision.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions