Skip to content

Request for Evaluation Code and Metrics #5

@adamlin120

Description

@adamlin120

Hello,

I recently read your interesting paper. The results look very promising and I'm excited to try out the COEDIT models.

In Section 4 "Experimental Setup" of the paper, several evaluation datasets and metrics are described. However, I didn't see the code for computing these metrics or the full evaluation pipeline provided in the linked GitHub repo.

Would it be possible for you to please open-source the code you used to evaluate the models and compute the reported metrics? Having access to the exact evaluation scripts and metric implementations would help ensure reproducibility and make it easier for others to benchmark against COEDIT and validate the results.

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions