How to reproduce experimental results #769
Unanswered
ReCodeLife
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have trained on a server and obtained a checkpoint. However, when I tried to reproduce the results on my local machine, I found a significant difference in accuracy. So, I attempted to reproduce the effect with a minimal experiment.
When training on my local machine
I achieved an accuracy/top1 of 88.4281.
#some output 09/19 14:13:28 - mmengine - INFO - Exp name: mae-right-p16_linear-8xb128-coslr-90e_style_20230919_140433 09/19 14:13:28 - mmengine - INFO - Saving checkpoint at 1 epochs 09/19 14:13:36 - mmengine - INFO - Epoch(val) [1][100/633] eta: 0:00:36 time: 0.0563 data_time: 0.0004 memory: 2750 09/19 14:13:43 - mmengine - INFO - Epoch(val) [1][200/633] eta: 0:00:28 time: 0.0630 data_time: 0.0004 memory: 1701 09/19 14:13:49 - mmengine - INFO - Epoch(val) [1][300/633] eta: 0:00:21 time: 0.0750 data_time: 0.0138 memory: 1701 09/19 14:13:55 - mmengine - INFO - Epoch(val) [1][400/633] eta: 0:00:14 time: 0.0648 data_time: 0.0050 memory: 1701 09/19 14:14:01 - mmengine - INFO - Epoch(val) [1][500/633] eta: 0:00:08 time: 0.0565 data_time: 0.0003 memory: 1701 09/19 14:14:08 - mmengine - INFO - Epoch(val) [1][600/633] eta: 0:00:02 time: 0.0596 data_time: 0.0003 memory: 1701 09/19 14:14:09 - mmengine - INFO - Epoch(val) [1][633/633] accuracy/top1: 88.4281 09/19 14:14:11 - mmengine - INFO - The best checkpoint with 88.4281 accuracy/top1 at 1 epoch is saved to best_accuracy/top1_epoch_1.pth.
But when I use test code multiple times
I have always obtained an accuracy/top1 of 88.4722.
Although the change is small, it does present different results. Is this reasonable, or did I make a mistake?
Beta Was this translation helpful? Give feedback.
All reactions