can't reproduce TSVM Results #5
Description
Hi i tried to reproduce TSVM results but there is drop in performance of 2%
2025-08-13 19:43:28,416][root][INFO] - Final image preprocessing configuration
set: {'size': (224, 224), 'mode': 'RGB', 'mean': (0.48145466, 0.4578275, 0.40821
073), 'std': (0.26862954, 0.26130258, 0.27577711), 'interpolation': 'bicubic', '
resize_mode': 'shortest', 'fill_color': 0}
[2025-08-13 19:43:28,416][root][INFO] - Model ViT-B-32 creation process complete
.
Loading classification head for ViT-B-32 on SUN397Val from models/checkpoints/Vi
T-B-32/head_SUN397Val.pt
Done evaluating on SUN397. Accuracy: 66.50%. Total time: 64.64s
Loading classification head for ViT-B-32 on CarsVal from models/checkpoints/ViT-
B-32/head_CarsVal.pt
Done evaluating on Cars. Accuracy: 70.92%. Total time: 13.28s
Loading classification head for ViT-B-32 on RESISC45Val from models/checkpoints/ViT-B-32/head_RESISC45Val.pt
Done evaluating on RESISC45. Accuracy: 85.62%. Total time: 6.47s
Loading classification head for ViT-B-32 on EuroSATVal from models/checkpoints/V
iT-B-32/head_EuroSATVal.pt
Done evaluating on EuroSAT. Accuracy: 93.67%. Total time: 3.13s
Loading classification head for ViT-B-32 on SVHNVal from models/checkpoints/ViT-
B-32/head_SVHNVal.pt
Done evaluating on SVHN. Accuracy: 91.06%. Total time: 27.98s Loading classification head for ViT-B-32 on GTSRBVal from models/checkpoints/ViT
-B-32/head_GTSRBVal.pt "taylor7.livia.etsmtl." 19:19 13-Aug-25
Done evaluating on GTSRB. Accuracy: 91.77%. Total time: 12.66s
Loading classification head for ViT-B-32 on MNISTVal from models/checkpoints/ViT
-B-32/head_MNISTVal.pt
Done evaluating on MNIST. Accuracy: 99.20%. Total time: 9.64s
Loading classification head for ViT-B-32 on DTDVal from models/checkpoints/ViT-B
-32/head_DTDVal.pt
Done evaluating on DTD. Accuracy: 66.49%. Total time: 2.36s
Total evaluation time: 141.58s
====================
Test normalized accuracy: 0.8953714698723907
Test absolute accuracy: 0.831540484799576