Using FLARE22 for MedSAM evaluation

[thuyduongcoding]

Hi,

Thank you for your impressive work on MedSAM—I'm truly amazed by the work you have done.

I’m currently planning to evaluate MedSAM using the FLARE22 dataset (for evaluation only, without any retraining). However, I want to make sure that this evaluation is valid. My concern is that whether MedSAM may have been trained on FLARE22, which could compromise the fairness of the evaluation.

I reviewed the supplementary materials but did not find FLARE22 listed among the training datasets. So may I assume that the FLARE22 was not used during MedSAM’s training?

Thank you!