Skip to content

Reproduction Issue: Consistently Lower Accuracy on CIFAR10 #15

@sehyun03

Description

@sehyun03

Hi, I sincerely appreciate you sharing your code with the community.

While attempting to reproduce your results, I encountered an issue where I consistently achieved 3-5% lower accuracy across each baseline method, as shown below:

image

I followed the exact configuration specified in the Readme. Here are the details:

python3 main_split.py --epochs 200 --epochs-csi 1000 --epochs-mqnet 100 --datset 'CIFAR10' --n-class 10 --n-query 500 \
                      --method 'MQNet' --mqnet-mode 'LL' --ssl-save True --ood-rate 0.6

I suspect the issue might be related to the versions of the packages used. Could you kindly share the specific environment and package versions you used to achieve your published results?

Here's the environment I used, for reference:

mqnet.txt

Thank you for your assistance!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions