-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathnohup.out
More file actions
1399 lines (1399 loc) · 228 KB
/
nohup.out
File metadata and controls
1399 lines (1399 loc) · 228 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
True
Not using distributed mode
Namespace(out_ch1=5, out_ch2=4, lr=0.0001, batch_size=8, weight_decay=0, epochs=10000, lr_drop=1000, clip_max_norm=0.1, tasks={'MR': {'lab_values': [0, 1, 2, 3, 4, 5], 'out_channels': 4}}, model='MSCMR', frozen_weights=None, in_channels=1, position_embedding='learned', num_pool=4, return_interm=True, enc_layers=6, dec_layers=6, dim_feedforward=2048, hidden_dim=256, embedding_size=16, patch_size=4, num_queries=256, dropout=0.5, nheads=8, pre_norm=True, multiDice_loss_coef=1, CrossEntropy_loss_coef=1, Rv=1, Lv=1, Myo=1, Avg=1, MSCMR_dataset='MSCMR_scribble_v2', output_dir_MSCMR='/data/kzhang/Modelmix_MSCMR_MyoPS_5shot/MSCMR/', device='cuda', GPU_ids='4,7', seed=42, resume_backbone1='', resume_head1='', resume_backbone3='/data/kzhang/Modelmix_MSCMR_MyoPS_5shot/MSCMR/selected_checkpoint.pth', start_epoch=0, eval=False, num_workers=0, world_size=1, dist_url='env://', distributed=False)
Start training
myops: loss1: 1.0861432552337646 loss1 mix: 1.0874154567718506 invariant mix: -0.9432489275932312
MSCMR: loss3: 1.0424643754959106 loss3 mix: 1.0660096406936646 invariant mix MSCMR: -0.938064455986023
Epoch: [0] [ 0/176] eta: 0:33:04 lr: 0.000100 loss: 0.2483 (0.2483) loss_multiDice: 0.7942 (0.7942) loss_CrossEntropy: 0.2483 (0.2483) time: 11.2769 data: 11.2769 max mem: 8870
Epoch: [0] [ 10/176] eta: 0:19:20 lr: 0.000100 loss: 0.1217 (0.1308) loss_multiDice: 0.8179 (0.8255) loss_CrossEntropy: 0.1217 (0.1308) time: 6.9894 data: 6.9894 max mem: 10279
Epoch: [0] [ 20/176] eta: 0:19:49 lr: 0.000100 loss: 0.0942 (0.1073) loss_multiDice: 0.8173 (0.8194) loss_CrossEntropy: 0.0942 (0.1073) time: 7.6231 data: 7.6231 max mem: 10279
Epoch: [0] [ 30/176] eta: 0:17:47 lr: 0.000100 loss: 0.0762 (0.1037) loss_multiDice: 0.8158 (0.8209) loss_CrossEntropy: 0.0762 (0.1037) time: 7.3103 data: 7.3103 max mem: 10279
Epoch: [0] [ 40/176] eta: 0:18:06 lr: 0.000100 loss: 0.0988 (0.1029) loss_multiDice: 0.8131 (0.8185) loss_CrossEntropy: 0.0988 (0.1029) time: 7.9909 data: 7.9909 max mem: 10281
Epoch: [0] [ 50/176] eta: 0:13:43 lr: 0.000100 loss: 0.1054 (0.1033) loss_multiDice: 0.8168 (0.8191) loss_CrossEntropy: 0.1054 (0.1033) time: 6.5327 data: 6.5327 max mem: 10281
Epoch: [0] [ 60/176] eta: 0:13:11 lr: 0.000100 loss: 0.1118 (0.1028) loss_multiDice: 0.8124 (0.8180) loss_CrossEntropy: 0.1118 (0.1028) time: 6.8242 data: 6.8242 max mem: 10282
Epoch: [0] [ 70/176] eta: 0:11:42 lr: 0.000100 loss: 0.0955 (0.1035) loss_multiDice: 0.8110 (0.8165) loss_CrossEntropy: 0.0955 (0.1035) time: 6.6268 data: 6.6268 max mem: 10282
Epoch: [0] [ 80/176] eta: 0:11:23 lr: 0.000100 loss: 0.0852 (0.1004) loss_multiDice: 0.8020 (0.8133) loss_CrossEntropy: 0.0852 (0.1004) time: 7.1213 data: 7.1213 max mem: 10282
Epoch: [0] [ 90/176] eta: 0:10:19 lr: 0.000100 loss: 0.0833 (0.1001) loss_multiDice: 0.8016 (0.8135) loss_CrossEntropy: 0.0833 (0.1001) time: 7.2024 data: 7.2024 max mem: 10282
Epoch: [0] [100/176] eta: 0:04:56 lr: 0.000100 loss: 0.1130 (0.1023) loss_multiDice: 0.8017 (0.8123) loss_CrossEntropy: 0.1130 (0.1023) time: 3.8955 data: 3.8955 max mem: 10282
Epoch: [0] [110/176] eta: 0:06:06 lr: 0.000100 loss: 0.0999 (0.1005) loss_multiDice: 0.7965 (0.8120) loss_CrossEntropy: 0.0999 (0.1005) time: 5.5587 data: 5.5587 max mem: 10283
Epoch: [0] [120/176] eta: 0:06:46 lr: 0.000100 loss: 0.0793 (0.0993) loss_multiDice: 0.8206 (0.8120) loss_CrossEntropy: 0.0793 (0.0993) time: 7.2610 data: 7.2610 max mem: 10283
Epoch: [0] [130/176] eta: 0:05:34 lr: 0.000100 loss: 0.0798 (0.0983) loss_multiDice: 0.8259 (0.8133) loss_CrossEntropy: 0.0798 (0.0983) time: 7.2757 data: 7.2757 max mem: 10283
Epoch: [0] [140/176] eta: 0:04:00 lr: 0.000100 loss: 0.0905 (0.0982) loss_multiDice: 0.8122 (0.8123) loss_CrossEntropy: 0.0905 (0.0982) time: 6.6899 data: 6.6899 max mem: 10283
Epoch: [0] [150/176] eta: 0:03:00 lr: 0.000100 loss: 0.0797 (0.0969) loss_multiDice: 0.8036 (0.8117) loss_CrossEntropy: 0.0797 (0.0969) time: 6.9367 data: 6.9367 max mem: 10284
Epoch: [0] [160/176] eta: 0:01:53 lr: 0.000100 loss: 0.0774 (0.0981) loss_multiDice: 0.8123 (0.8121) loss_CrossEntropy: 0.0774 (0.0981) time: 7.0951 data: 7.0951 max mem: 10285
Epoch: [0] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0846 (0.0979) loss_multiDice: 0.8196 (0.8126) loss_CrossEntropy: 0.0846 (0.0979) time: 7.0313 data: 7.0313 max mem: 10285
Epoch: [0] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0866 (0.0984) loss_multiDice: 0.8107 (0.8126) loss_CrossEntropy: 0.0866 (0.0984) time: 6.8897 data: 6.8897 max mem: 10285
Test: [ 0/75] eta: 0:00:43 loss: 0.2035 (0.2035) loss_multiDice: 0.1462 (0.1462) loss_CrossEntropy: 0.2035 (0.2035) Avg: 0.0457 (0.0457) time: 0.5818 data: 0.3815 max mem: 10285
Test: [10/75] eta: 0:00:33 loss: 0.2089 (0.2207) loss_multiDice: 0.1417 (0.1413) loss_CrossEntropy: 0.2089 (0.2207) Avg: 0.5781 (0.5740) time: 0.5093 data: 0.3779 max mem: 10285
Test: [20/75] eta: 0:00:13 loss: 0.2464 (0.2616) loss_multiDice: 0.1428 (0.1438) loss_CrossEntropy: 0.2464 (0.2616) Avg: 0.6146 (0.5841) time: 0.2423 data: 0.1756 max mem: 10285
Test: [30/75] eta: 0:00:12 loss: 0.3132 (0.2667) loss_multiDice: 0.1105 (0.1301) loss_CrossEntropy: 0.3132 (0.2667) Avg: 0.6771 (0.6358) time: 0.2721 data: 0.2189 max mem: 10285
Test: [40/75] eta: 0:00:12 loss: 0.1880 (0.2421) loss_multiDice: 0.0875 (0.1166) loss_CrossEntropy: 0.1880 (0.2421) Avg: 0.8248 (0.6925) time: 0.3671 data: 0.2793 max mem: 10285
Test: [50/75] eta: 0:00:08 loss: 0.1530 (0.2287) loss_multiDice: 0.0849 (0.1110) loss_CrossEntropy: 0.1530 (0.2287) Avg: 0.8518 (0.6788) time: 0.3449 data: 0.2687 max mem: 10285
Test: [60/75] eta: 0:00:05 loss: 0.1494 (0.2158) loss_multiDice: 0.0927 (0.1077) loss_CrossEntropy: 0.1494 (0.2158) Avg: 0.6405 (0.6975) time: 0.3977 data: 0.3166 max mem: 10285
Test: [70/75] eta: 0:00:01 loss: 0.1616 (0.2109) loss_multiDice: 0.0995 (0.1082) loss_CrossEntropy: 0.1616 (0.2109) Avg: 0.7319 (0.6912) time: 0.2458 data: 0.1762 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.1658 (0.2140) loss_multiDice: 0.1035 (0.1090) loss_CrossEntropy: 0.1658 (0.2140) Avg: 0.6823 (0.6889) time: 0.2990 data: 0.2206 max mem: 10285
Test: Total time: 0:00:28 (0.3823 s / it)
Averaged stats: loss: 0.1658 (0.2140) loss_multiDice: 0.1035 (0.1090) loss_CrossEntropy: 0.1658 (0.2140) Avg: 0.6823 (0.6889)
MSCMR dice score: 0.6889491978287697
Update MSCMR best model!
myops: loss1: 1.0054211616516113 loss1 mix: 1.0163103342056274 invariant mix: -0.8484157919883728
MSCMR: loss3: 0.8745118975639343 loss3 mix: 0.7270715236663818 invariant mix MSCMR: -0.9445522427558899
Epoch: [1] [ 0/176] eta: 0:20:25 lr: 0.000100 loss: 0.0884 (0.0884) loss_multiDice: 0.7861 (0.7861) loss_CrossEntropy: 0.0884 (0.0884) time: 6.9609 data: 6.9609 max mem: 10285
Epoch: [1] [ 10/176] eta: 0:16:51 lr: 0.000100 loss: 0.0830 (0.0793) loss_multiDice: 0.7894 (0.7958) loss_CrossEntropy: 0.0830 (0.0793) time: 6.0954 data: 6.0955 max mem: 10285
Epoch: [1] [ 20/176] eta: 0:14:12 lr: 0.000100 loss: 0.0837 (0.0851) loss_multiDice: 0.7910 (0.8036) loss_CrossEntropy: 0.0837 (0.0851) time: 5.4653 data: 5.4653 max mem: 10285
Epoch: [1] [ 30/176] eta: 0:17:04 lr: 0.000100 loss: 0.0922 (0.0901) loss_multiDice: 0.8161 (0.8096) loss_CrossEntropy: 0.0922 (0.0901) time: 7.0184 data: 7.0184 max mem: 10285
Epoch: [1] [ 40/176] eta: 0:15:45 lr: 0.000100 loss: 0.0872 (0.0901) loss_multiDice: 0.8301 (0.8150) loss_CrossEntropy: 0.0872 (0.0901) time: 6.9548 data: 6.9548 max mem: 10285
Epoch: [1] [ 50/176] eta: 0:14:01 lr: 0.000100 loss: 0.0886 (0.0912) loss_multiDice: 0.8392 (0.8179) loss_CrossEntropy: 0.0886 (0.0912) time: 6.6797 data: 6.6797 max mem: 10285
Epoch: [1] [ 60/176] eta: 0:13:35 lr: 0.000100 loss: 0.0886 (0.0908) loss_multiDice: 0.8237 (0.8174) loss_CrossEntropy: 0.0886 (0.0908) time: 7.0272 data: 7.0272 max mem: 10285
Epoch: [1] [ 70/176] eta: 0:10:28 lr: 0.000100 loss: 0.0786 (0.0894) loss_multiDice: 0.8099 (0.8172) loss_CrossEntropy: 0.0786 (0.0894) time: 5.9315 data: 5.9315 max mem: 10285
Epoch: [1] [ 80/176] eta: 0:11:47 lr: 0.000100 loss: 0.0867 (0.0933) loss_multiDice: 0.8152 (0.8181) loss_CrossEntropy: 0.0867 (0.0933) time: 7.3746 data: 7.3746 max mem: 10285
Epoch: [1] [ 90/176] eta: 0:09:48 lr: 0.000100 loss: 0.1140 (0.0972) loss_multiDice: 0.8152 (0.8173) loss_CrossEntropy: 0.1140 (0.0972) time: 6.8404 data: 6.8404 max mem: 10285
Epoch: [1] [100/176] eta: 0:08:49 lr: 0.000100 loss: 0.1193 (0.0991) loss_multiDice: 0.8034 (0.8172) loss_CrossEntropy: 0.1193 (0.0991) time: 6.9731 data: 6.9731 max mem: 10285
Epoch: [1] [110/176] eta: 0:07:17 lr: 0.000100 loss: 0.1131 (0.1000) loss_multiDice: 0.7969 (0.8153) loss_CrossEntropy: 0.1131 (0.1000) time: 6.6306 data: 6.6306 max mem: 10285
Epoch: [1] [120/176] eta: 0:05:28 lr: 0.000100 loss: 0.1064 (0.1005) loss_multiDice: 0.8124 (0.8163) loss_CrossEntropy: 0.1064 (0.1005) time: 5.8715 data: 5.8715 max mem: 10285
Epoch: [1] [130/176] eta: 0:05:42 lr: 0.000100 loss: 0.0793 (0.0984) loss_multiDice: 0.8199 (0.8154) loss_CrossEntropy: 0.0793 (0.0984) time: 7.4431 data: 7.4431 max mem: 10285
Epoch: [1] [140/176] eta: 0:04:03 lr: 0.000100 loss: 0.0697 (0.0977) loss_multiDice: 0.8065 (0.8153) loss_CrossEntropy: 0.0697 (0.0977) time: 6.7694 data: 6.7694 max mem: 10285
Epoch: [1] [150/176] eta: 0:02:55 lr: 0.000100 loss: 0.0699 (0.0959) loss_multiDice: 0.8065 (0.8149) loss_CrossEntropy: 0.0699 (0.0959) time: 6.7628 data: 6.7628 max mem: 10285
Epoch: [1] [160/176] eta: 0:01:49 lr: 0.000100 loss: 0.0699 (0.0951) loss_multiDice: 0.8022 (0.8140) loss_CrossEntropy: 0.0699 (0.0951) time: 6.8250 data: 6.8250 max mem: 10285
Epoch: [1] [170/176] eta: 0:00:40 lr: 0.000100 loss: 0.0794 (0.0948) loss_multiDice: 0.8022 (0.8138) loss_CrossEntropy: 0.0794 (0.0948) time: 6.7762 data: 6.7762 max mem: 10285
Epoch: [1] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0877 (0.0943) loss_multiDice: 0.8045 (0.8139) loss_CrossEntropy: 0.0877 (0.0943) time: 7.0839 data: 7.0839 max mem: 10285
Test: [ 0/75] eta: 0:00:23 loss: 0.2026 (0.2026) loss_multiDice: 0.1423 (0.1423) loss_CrossEntropy: 0.2026 (0.2026) Avg: 0.0461 (0.0461) time: 0.3149 data: 0.2474 max mem: 10285
Test: [10/75] eta: 0:00:30 loss: 0.2108 (0.2221) loss_multiDice: 0.1370 (0.1414) loss_CrossEntropy: 0.2108 (0.2221) Avg: 0.6601 (0.6146) time: 0.4692 data: 0.3517 max mem: 10285
Test: [20/75] eta: 0:00:16 loss: 0.2407 (0.2626) loss_multiDice: 0.1402 (0.1439) loss_CrossEntropy: 0.2407 (0.2626) Avg: 0.6529 (0.6213) time: 0.2970 data: 0.2207 max mem: 10285
Test: [30/75] eta: 0:00:18 loss: 0.2385 (0.2467) loss_multiDice: 0.1019 (0.1272) loss_CrossEntropy: 0.2385 (0.2467) Avg: 0.7668 (0.6892) time: 0.4016 data: 0.2993 max mem: 10285
Test: [40/75] eta: 0:00:13 loss: 0.1546 (0.2219) loss_multiDice: 0.0857 (0.1144) loss_CrossEntropy: 0.1546 (0.2219) Avg: 0.8867 (0.7406) time: 0.3947 data: 0.2876 max mem: 10285
Test: [50/75] eta: 0:00:10 loss: 0.1491 (0.2125) loss_multiDice: 0.0857 (0.1097) loss_CrossEntropy: 0.1491 (0.2125) Avg: 0.8771 (0.7247) time: 0.4165 data: 0.3209 max mem: 10285
Test: [60/75] eta: 0:00:06 loss: 0.1474 (0.1992) loss_multiDice: 0.0908 (0.1057) loss_CrossEntropy: 0.1474 (0.1992) Avg: 0.8189 (0.7423) time: 0.4385 data: 0.3603 max mem: 10285
Test: [70/75] eta: 0:00:01 loss: 0.1585 (0.2024) loss_multiDice: 0.0968 (0.1096) loss_CrossEntropy: 0.1585 (0.2024) Avg: 0.7694 (0.7235) time: 0.3174 data: 0.2472 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.1807 (0.2116) loss_multiDice: 0.1195 (0.1127) loss_CrossEntropy: 0.1807 (0.2116) Avg: 0.5529 (0.7090) time: 0.4649 data: 0.3589 max mem: 10285
Test: Total time: 0:00:27 (0.3712 s / it)
Averaged stats: loss: 0.1807 (0.2116) loss_multiDice: 0.1195 (0.1127) loss_CrossEntropy: 0.1807 (0.2116) Avg: 0.5529 (0.7090)
MSCMR dice score: 0.7090041887263457
Update MSCMR best model!
Update MSCMR high dice score model!
myops: loss1: 0.9964878559112549 loss1 mix: 0.9918416142463684 invariant mix: -0.9723307490348816
MSCMR: loss3: 0.8815435171127319 loss3 mix: 0.7470855116844177 invariant mix MSCMR: -0.8614029288291931
Epoch: [2] [ 0/176] eta: 0:19:45 lr: 0.000100 loss: 0.0930 (0.0930) loss_multiDice: 0.7885 (0.7885) loss_CrossEntropy: 0.0930 (0.0930) time: 6.7335 data: 6.7335 max mem: 10285
Epoch: [2] [ 10/176] eta: 0:19:04 lr: 0.000100 loss: 0.0734 (0.0802) loss_multiDice: 0.8190 (0.8115) loss_CrossEntropy: 0.0734 (0.0802) time: 6.8916 data: 6.8916 max mem: 10285
Epoch: [2] [ 20/176] eta: 0:17:32 lr: 0.000100 loss: 0.0905 (0.0901) loss_multiDice: 0.8190 (0.8085) loss_CrossEntropy: 0.0905 (0.0901) time: 6.7454 data: 6.7454 max mem: 10285
Epoch: [2] [ 30/176] eta: 0:17:15 lr: 0.000100 loss: 0.0918 (0.0936) loss_multiDice: 0.8191 (0.8135) loss_CrossEntropy: 0.0918 (0.0936) time: 7.0942 data: 7.0942 max mem: 10285
Epoch: [2] [ 40/176] eta: 0:16:17 lr: 0.000100 loss: 0.0918 (0.0962) loss_multiDice: 0.8314 (0.8201) loss_CrossEntropy: 0.0918 (0.0962) time: 7.1859 data: 7.1859 max mem: 10285
Epoch: [2] [ 50/176] eta: 0:16:53 lr: 0.000100 loss: 0.0886 (0.0966) loss_multiDice: 0.8215 (0.8180) loss_CrossEntropy: 0.0886 (0.0966) time: 8.0456 data: 8.0456 max mem: 10285
Epoch: [2] [ 60/176] eta: 0:13:26 lr: 0.000100 loss: 0.0833 (0.0957) loss_multiDice: 0.8153 (0.8159) loss_CrossEntropy: 0.0833 (0.0957) time: 6.9496 data: 6.9496 max mem: 10285
Epoch: [2] [ 70/176] eta: 0:12:21 lr: 0.000100 loss: 0.0945 (0.0951) loss_multiDice: 0.8153 (0.8150) loss_CrossEntropy: 0.0945 (0.0951) time: 6.9980 data: 6.9980 max mem: 10285
Epoch: [2] [ 80/176] eta: 0:11:41 lr: 0.000100 loss: 0.0800 (0.0934) loss_multiDice: 0.7979 (0.8129) loss_CrossEntropy: 0.0800 (0.0934) time: 7.3033 data: 7.3033 max mem: 10285
Epoch: [2] [ 90/176] eta: 0:05:12 lr: 0.000100 loss: 0.0660 (0.0907) loss_multiDice: 0.8068 (0.8127) loss_CrossEntropy: 0.0660 (0.0907) time: 3.6366 data: 3.6366 max mem: 10285
Epoch: [2] [100/176] eta: 0:08:45 lr: 0.000100 loss: 0.0759 (0.0913) loss_multiDice: 0.8068 (0.8117) loss_CrossEntropy: 0.0759 (0.0913) time: 6.9099 data: 6.9099 max mem: 10285
Epoch: [2] [110/176] eta: 0:05:22 lr: 0.000100 loss: 0.0787 (0.0899) loss_multiDice: 0.8102 (0.8118) loss_CrossEntropy: 0.0787 (0.0899) time: 4.8805 data: 4.8805 max mem: 10285
Epoch: [2] [120/176] eta: 0:05:58 lr: 0.000100 loss: 0.0817 (0.0908) loss_multiDice: 0.8112 (0.8115) loss_CrossEntropy: 0.0817 (0.0908) time: 6.4047 data: 6.4047 max mem: 10285
Epoch: [2] [130/176] eta: 0:05:29 lr: 0.000100 loss: 0.1002 (0.0914) loss_multiDice: 0.8151 (0.8118) loss_CrossEntropy: 0.1002 (0.0914) time: 7.1596 data: 7.1596 max mem: 10285
Epoch: [2] [140/176] eta: 0:04:22 lr: 0.000100 loss: 0.0904 (0.0926) loss_multiDice: 0.8151 (0.8128) loss_CrossEntropy: 0.0904 (0.0926) time: 7.2965 data: 7.2965 max mem: 10285
Epoch: [2] [150/176] eta: 0:03:11 lr: 0.000100 loss: 0.0819 (0.0917) loss_multiDice: 0.8314 (0.8135) loss_CrossEntropy: 0.0819 (0.0917) time: 7.3528 data: 7.3528 max mem: 10285
Epoch: [2] [160/176] eta: 0:01:45 lr: 0.000100 loss: 0.0839 (0.0923) loss_multiDice: 0.8314 (0.8136) loss_CrossEntropy: 0.0839 (0.0923) time: 6.5968 data: 6.5968 max mem: 10285
Epoch: [2] [170/176] eta: 0:00:39 lr: 0.000100 loss: 0.0846 (0.0918) loss_multiDice: 0.7982 (0.8123) loss_CrossEntropy: 0.0846 (0.0918) time: 6.6580 data: 6.6580 max mem: 10285
Epoch: [2] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0839 (0.0917) loss_multiDice: 0.7977 (0.8123) loss_CrossEntropy: 0.0839 (0.0917) time: 6.9454 data: 6.9454 max mem: 10285
Test: [ 0/75] eta: 0:00:24 loss: 0.2170 (0.2170) loss_multiDice: 0.1448 (0.1448) loss_CrossEntropy: 0.2170 (0.2170) Avg: 0.0455 (0.0455) time: 0.3210 data: 0.2511 max mem: 10285
Test: [10/75] eta: 0:00:22 loss: 0.2060 (0.2070) loss_multiDice: 0.1287 (0.1333) loss_CrossEntropy: 0.2060 (0.2070) Avg: 0.6502 (0.6014) time: 0.3406 data: 0.2763 max mem: 10285
Test: [20/75] eta: 0:00:16 loss: 0.2107 (0.2360) loss_multiDice: 0.1269 (0.1322) loss_CrossEntropy: 0.2107 (0.2360) Avg: 0.6612 (0.6304) time: 0.3061 data: 0.2242 max mem: 10285
Test: [30/75] eta: 0:00:17 loss: 0.2316 (0.2242) loss_multiDice: 0.0917 (0.1177) loss_CrossEntropy: 0.2316 (0.2242) Avg: 0.7534 (0.6925) time: 0.3806 data: 0.2954 max mem: 10285
Test: [40/75] eta: 0:00:12 loss: 0.1458 (0.2031) loss_multiDice: 0.0816 (0.1062) loss_CrossEntropy: 0.1458 (0.2031) Avg: 0.8739 (0.7405) time: 0.3668 data: 0.2783 max mem: 10285
Test: [50/75] eta: 0:00:08 loss: 0.1347 (0.1919) loss_multiDice: 0.0783 (0.1007) loss_CrossEntropy: 0.1347 (0.1919) Avg: 0.8739 (0.7270) time: 0.3454 data: 0.2999 max mem: 10285
Test: [60/75] eta: 0:00:05 loss: 0.1347 (0.1832) loss_multiDice: 0.0849 (0.0984) loss_CrossEntropy: 0.1347 (0.1832) Avg: 0.7837 (0.7404) time: 0.3781 data: 0.2966 max mem: 10285
Test: [70/75] eta: 0:00:01 loss: 0.1502 (0.1819) loss_multiDice: 0.0976 (0.0999) loss_CrossEntropy: 0.1502 (0.1819) Avg: 0.7857 (0.7295) time: 0.2904 data: 0.2136 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.1665 (0.1862) loss_multiDice: 0.1008 (0.1014) loss_CrossEntropy: 0.1665 (0.1862) Avg: 0.6708 (0.7243) time: 0.4239 data: 0.3297 max mem: 10285
Test: Total time: 0:00:27 (0.3671 s / it)
Averaged stats: loss: 0.1665 (0.1862) loss_multiDice: 0.1008 (0.1014) loss_CrossEntropy: 0.1665 (0.1862) Avg: 0.6708 (0.7243)
MSCMR dice score: 0.7243089516460895
Update MSCMR best model!
Update MSCMR high dice score model!
myops: loss1: 0.9683101773262024 loss1 mix: 0.9937019944190979 invariant mix: -0.904296875
MSCMR: loss3: 0.8903738260269165 loss3 mix: 0.7098363041877747 invariant mix MSCMR: -0.8931978940963745
Epoch: [3] [ 0/176] eta: 0:16:05 lr: 0.000100 loss: 0.0745 (0.0745) loss_multiDice: 0.8159 (0.8159) loss_CrossEntropy: 0.0745 (0.0745) time: 5.4879 data: 5.4879 max mem: 10285
Epoch: [3] [ 10/176] eta: 0:19:03 lr: 0.000100 loss: 0.0742 (0.0700) loss_multiDice: 0.8159 (0.8144) loss_CrossEntropy: 0.0742 (0.0700) time: 6.8884 data: 6.8884 max mem: 10285
Epoch: [3] [ 20/176] eta: 0:17:39 lr: 0.000100 loss: 0.0782 (0.0836) loss_multiDice: 0.8024 (0.8119) loss_CrossEntropy: 0.0782 (0.0836) time: 6.7906 data: 6.7906 max mem: 10285
Epoch: [3] [ 30/176] eta: 0:17:26 lr: 0.000100 loss: 0.0897 (0.0900) loss_multiDice: 0.8152 (0.8161) loss_CrossEntropy: 0.0897 (0.0900) time: 7.1666 data: 7.1666 max mem: 10285
Epoch: [3] [ 40/176] eta: 0:14:32 lr: 0.000100 loss: 0.0962 (0.0938) loss_multiDice: 0.8276 (0.8188) loss_CrossEntropy: 0.0962 (0.0938) time: 6.4128 data: 6.4128 max mem: 10285
Epoch: [3] [ 50/176] eta: 0:07:28 lr: 0.000100 loss: 0.0941 (0.0935) loss_multiDice: 0.8148 (0.8187) loss_CrossEntropy: 0.0941 (0.0935) time: 3.5609 data: 3.5609 max mem: 10285
Epoch: [3] [ 60/176] eta: 0:14:40 lr: 0.000100 loss: 0.0941 (0.0955) loss_multiDice: 0.8127 (0.8169) loss_CrossEntropy: 0.0941 (0.0955) time: 7.5878 data: 7.5878 max mem: 10285
Epoch: [3] [ 70/176] eta: 0:12:26 lr: 0.000100 loss: 0.0807 (0.0925) loss_multiDice: 0.8035 (0.8141) loss_CrossEntropy: 0.0807 (0.0925) time: 7.0412 data: 7.0412 max mem: 10285
Epoch: [3] [ 80/176] eta: 0:10:03 lr: 0.000100 loss: 0.0744 (0.0911) loss_multiDice: 0.8035 (0.8127) loss_CrossEntropy: 0.0744 (0.0911) time: 6.2893 data: 6.2893 max mem: 10285
Epoch: [3] [ 90/176] eta: 0:09:48 lr: 0.000100 loss: 0.0835 (0.0902) loss_multiDice: 0.8053 (0.8124) loss_CrossEntropy: 0.0835 (0.0902) time: 6.8469 data: 6.8469 max mem: 10285
Epoch: [3] [100/176] eta: 0:08:46 lr: 0.000100 loss: 0.0793 (0.0906) loss_multiDice: 0.8015 (0.8123) loss_CrossEntropy: 0.0793 (0.0906) time: 6.9261 data: 6.9261 max mem: 10285
Epoch: [3] [110/176] eta: 0:07:23 lr: 0.000100 loss: 0.0793 (0.0902) loss_multiDice: 0.8062 (0.8123) loss_CrossEntropy: 0.0793 (0.0902) time: 6.7167 data: 6.7167 max mem: 10285
Epoch: [3] [120/176] eta: 0:06:34 lr: 0.000100 loss: 0.0796 (0.0914) loss_multiDice: 0.8067 (0.8111) loss_CrossEntropy: 0.0796 (0.0914) time: 7.0515 data: 7.0515 max mem: 10285
Epoch: [3] [130/176] eta: 0:05:18 lr: 0.000100 loss: 0.0809 (0.0913) loss_multiDice: 0.7981 (0.8113) loss_CrossEntropy: 0.0809 (0.0913) time: 6.9223 data: 6.9223 max mem: 10285
Epoch: [3] [140/176] eta: 0:04:09 lr: 0.000100 loss: 0.0768 (0.0905) loss_multiDice: 0.8112 (0.8118) loss_CrossEntropy: 0.0768 (0.0905) time: 6.9355 data: 6.9355 max mem: 10285
Epoch: [3] [150/176] eta: 0:02:58 lr: 0.000100 loss: 0.0651 (0.0897) loss_multiDice: 0.8189 (0.8121) loss_CrossEntropy: 0.0651 (0.0897) time: 6.8585 data: 6.8585 max mem: 10285
Epoch: [3] [160/176] eta: 0:01:58 lr: 0.000100 loss: 0.0658 (0.0895) loss_multiDice: 0.8114 (0.8129) loss_CrossEntropy: 0.0658 (0.0895) time: 7.4339 data: 7.4339 max mem: 10285
Epoch: [3] [170/176] eta: 0:00:45 lr: 0.000100 loss: 0.0658 (0.0886) loss_multiDice: 0.8114 (0.8129) loss_CrossEntropy: 0.0658 (0.0886) time: 7.5201 data: 7.5201 max mem: 10285
Epoch: [3] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0755 (0.0889) loss_multiDice: 0.8105 (0.8129) loss_CrossEntropy: 0.0755 (0.0889) time: 7.1072 data: 7.1072 max mem: 10285
Test: [ 0/75] eta: 0:00:26 loss: 0.2216 (0.2216) loss_multiDice: 0.1592 (0.1592) loss_CrossEntropy: 0.2216 (0.2216) Avg: 0.0457 (0.0457) time: 0.3557 data: 0.2618 max mem: 10285
Test: [10/75] eta: 0:00:28 loss: 0.2455 (0.2625) loss_multiDice: 0.1592 (0.1625) loss_CrossEntropy: 0.2455 (0.2625) Avg: 0.5643 (0.5239) time: 0.4444 data: 0.3545 max mem: 10285
Test: [20/75] eta: 0:00:16 loss: 0.2786 (0.2846) loss_multiDice: 0.1567 (0.1564) loss_CrossEntropy: 0.2786 (0.2846) Avg: 0.5848 (0.5822) time: 0.3040 data: 0.2564 max mem: 10285
Test: [30/75] eta: 0:00:22 loss: 0.2171 (0.2563) loss_multiDice: 0.1134 (0.1369) loss_CrossEntropy: 0.2171 (0.2563) Avg: 0.7356 (0.6594) time: 0.4907 data: 0.3863 max mem: 10285
Test: [40/75] eta: 0:00:07 loss: 0.1586 (0.2271) loss_multiDice: 0.0925 (0.1228) loss_CrossEntropy: 0.1586 (0.2271) Avg: 0.8867 (0.7183) time: 0.2140 data: 0.1368 max mem: 10285
Test: [50/75] eta: 0:00:11 loss: 0.1471 (0.2153) loss_multiDice: 0.0925 (0.1178) loss_CrossEntropy: 0.1471 (0.2153) Avg: 0.8867 (0.7056) time: 0.4748 data: 0.3879 max mem: 10285
Test: [60/75] eta: 0:00:05 loss: 0.1571 (0.2059) loss_multiDice: 0.1084 (0.1155) loss_CrossEntropy: 0.1571 (0.2059) Avg: 0.7467 (0.7199) time: 0.3334 data: 0.2573 max mem: 10285
Test: [70/75] eta: 0:00:01 loss: 0.1841 (0.2100) loss_multiDice: 0.1165 (0.1186) loss_CrossEntropy: 0.1841 (0.2100) Avg: 0.6575 (0.7007) time: 0.3686 data: 0.3014 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.2164 (0.2136) loss_multiDice: 0.1297 (0.1198) loss_CrossEntropy: 0.2164 (0.2136) Avg: 0.6553 (0.6973) time: 0.2186 data: 0.1787 max mem: 10285
Test: Total time: 0:00:27 (0.3717 s / it)
Averaged stats: loss: 0.2164 (0.2136) loss_multiDice: 0.1297 (0.1198) loss_CrossEntropy: 0.2164 (0.2136) Avg: 0.6553 (0.6973)
MSCMR dice score: 0.6972565593322119
myops: loss1: 0.9605028033256531 loss1 mix: 0.9920209050178528 invariant mix: -0.8734809160232544
MSCMR: loss3: 0.8377923369407654 loss3 mix: 0.6858496069908142 invariant mix MSCMR: -0.9222622513771057
Epoch: [4] [ 0/176] eta: 0:21:18 lr: 0.000100 loss: 0.0577 (0.0577) loss_multiDice: 0.7801 (0.7801) loss_CrossEntropy: 0.0577 (0.0577) time: 7.2649 data: 7.2649 max mem: 10285
Epoch: [4] [ 10/176] eta: 0:18:54 lr: 0.000100 loss: 0.0683 (0.0931) loss_multiDice: 0.8165 (0.8079) loss_CrossEntropy: 0.0683 (0.0931) time: 6.8365 data: 6.8365 max mem: 10285
Epoch: [4] [ 20/176] eta: 0:17:19 lr: 0.000100 loss: 0.0860 (0.0864) loss_multiDice: 0.8174 (0.8147) loss_CrossEntropy: 0.0860 (0.0864) time: 6.6656 data: 6.6656 max mem: 10285
Epoch: [4] [ 30/176] eta: 0:17:00 lr: 0.000100 loss: 0.0860 (0.0880) loss_multiDice: 0.8273 (0.8204) loss_CrossEntropy: 0.0860 (0.0880) time: 6.9874 data: 6.9874 max mem: 10285
Epoch: [4] [ 40/176] eta: 0:11:38 lr: 0.000100 loss: 0.0817 (0.0879) loss_multiDice: 0.8215 (0.8190) loss_CrossEntropy: 0.0817 (0.0879) time: 5.1371 data: 5.1371 max mem: 10285
Epoch: [4] [ 50/176] eta: 0:14:28 lr: 0.000100 loss: 0.0783 (0.0866) loss_multiDice: 0.8117 (0.8153) loss_CrossEntropy: 0.0783 (0.0866) time: 6.8902 data: 6.8902 max mem: 10285
Epoch: [4] [ 60/176] eta: 0:12:18 lr: 0.000100 loss: 0.0805 (0.0874) loss_multiDice: 0.8097 (0.8153) loss_CrossEntropy: 0.0805 (0.0874) time: 6.3662 data: 6.3662 max mem: 10285
Epoch: [4] [ 70/176] eta: 0:13:44 lr: 0.000100 loss: 0.0780 (0.0847) loss_multiDice: 0.8060 (0.8132) loss_CrossEntropy: 0.0780 (0.0847) time: 7.7830 data: 7.7830 max mem: 10285
Epoch: [4] [ 80/176] eta: 0:12:03 lr: 0.000100 loss: 0.0648 (0.0839) loss_multiDice: 0.7923 (0.8117) loss_CrossEntropy: 0.0648 (0.0839) time: 7.5409 data: 7.5409 max mem: 10285
Epoch: [4] [ 90/176] eta: 0:10:31 lr: 0.000100 loss: 0.0694 (0.0833) loss_multiDice: 0.7969 (0.8111) loss_CrossEntropy: 0.0694 (0.0833) time: 7.3473 data: 7.3473 max mem: 10285
Epoch: [4] [100/176] eta: 0:08:02 lr: 0.000100 loss: 0.0791 (0.0838) loss_multiDice: 0.8001 (0.8101) loss_CrossEntropy: 0.0791 (0.0838) time: 6.3450 data: 6.3450 max mem: 10285
Epoch: [4] [110/176] eta: 0:08:02 lr: 0.000100 loss: 0.0825 (0.0849) loss_multiDice: 0.7932 (0.8078) loss_CrossEntropy: 0.0825 (0.0849) time: 7.3059 data: 7.3059 max mem: 10285
Epoch: [4] [120/176] eta: 0:06:15 lr: 0.000100 loss: 0.0794 (0.0850) loss_multiDice: 0.8072 (0.8087) loss_CrossEntropy: 0.0794 (0.0850) time: 6.6986 data: 6.6986 max mem: 10285
Epoch: [4] [130/176] eta: 0:05:24 lr: 0.000100 loss: 0.0804 (0.0862) loss_multiDice: 0.8153 (0.8099) loss_CrossEntropy: 0.0804 (0.0862) time: 7.0571 data: 7.0571 max mem: 10285
Epoch: [4] [140/176] eta: 0:04:01 lr: 0.000100 loss: 0.0755 (0.0854) loss_multiDice: 0.8210 (0.8106) loss_CrossEntropy: 0.0755 (0.0854) time: 6.7150 data: 6.7150 max mem: 10285
Epoch: [4] [150/176] eta: 0:02:58 lr: 0.000100 loss: 0.0705 (0.0850) loss_multiDice: 0.8129 (0.8097) loss_CrossEntropy: 0.0705 (0.0850) time: 6.8497 data: 6.8497 max mem: 10285
Epoch: [4] [160/176] eta: 0:01:41 lr: 0.000100 loss: 0.0802 (0.0856) loss_multiDice: 0.8000 (0.8092) loss_CrossEntropy: 0.0802 (0.0856) time: 6.3533 data: 6.3533 max mem: 10285
Epoch: [4] [170/176] eta: 0:00:44 lr: 0.000100 loss: 0.0769 (0.0847) loss_multiDice: 0.8014 (0.8094) loss_CrossEntropy: 0.0769 (0.0847) time: 7.3837 data: 7.3837 max mem: 10285
Epoch: [4] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0744 (0.0844) loss_multiDice: 0.8195 (0.8101) loss_CrossEntropy: 0.0744 (0.0844) time: 7.0925 data: 7.0925 max mem: 10285
Test: [ 0/75] eta: 0:00:35 loss: 0.2051 (0.2051) loss_multiDice: 0.1286 (0.1286) loss_CrossEntropy: 0.2051 (0.2051) Avg: 0.0395 (0.0395) time: 0.4762 data: 0.3480 max mem: 10285
Test: [10/75] eta: 0:00:24 loss: 0.1977 (0.2014) loss_multiDice: 0.1286 (0.1285) loss_CrossEntropy: 0.1977 (0.2014) Avg: 0.7077 (0.6222) time: 0.3734 data: 0.2992 max mem: 10285
Test: [20/75] eta: 0:00:25 loss: 0.1977 (0.2182) loss_multiDice: 0.1242 (0.1226) loss_CrossEntropy: 0.1977 (0.2182) Avg: 0.7077 (0.6590) time: 0.4625 data: 0.3498 max mem: 10285
Test: [30/75] eta: 0:00:14 loss: 0.1835 (0.1998) loss_multiDice: 0.0777 (0.1051) loss_CrossEntropy: 0.1835 (0.1998) Avg: 0.8428 (0.7187) time: 0.3309 data: 0.2607 max mem: 10285
Test: [40/75] eta: 0:00:14 loss: 0.1189 (0.1789) loss_multiDice: 0.0635 (0.0936) loss_CrossEntropy: 0.1189 (0.1789) Avg: 0.8968 (0.7630) time: 0.4194 data: 0.3217 max mem: 10285
Test: [50/75] eta: 0:00:09 loss: 0.1138 (0.1723) loss_multiDice: 0.0613 (0.0894) loss_CrossEntropy: 0.1138 (0.1723) Avg: 0.8968 (0.7446) time: 0.3965 data: 0.2699 max mem: 10285
Test: [60/75] eta: 0:00:06 loss: 0.1274 (0.1657) loss_multiDice: 0.0810 (0.0893) loss_CrossEntropy: 0.1274 (0.1657) Avg: 0.7587 (0.7537) time: 0.4101 data: 0.3359 max mem: 10285
Test: [70/75] eta: 0:00:02 loss: 0.1513 (0.1671) loss_multiDice: 0.0972 (0.0927) loss_CrossEntropy: 0.1513 (0.1671) Avg: 0.7494 (0.7414) time: 0.4584 data: 0.3554 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.1611 (0.1722) loss_multiDice: 0.1083 (0.0942) loss_CrossEntropy: 0.1611 (0.1722) Avg: 0.7147 (0.7375) time: 0.3912 data: 0.2941 max mem: 10285
Test: Total time: 0:00:30 (0.4114 s / it)
Averaged stats: loss: 0.1611 (0.1722) loss_multiDice: 0.1083 (0.0942) loss_CrossEntropy: 0.1611 (0.1722) Avg: 0.7147 (0.7375)
MSCMR dice score: 0.7375183364748955
Update MSCMR best model!
Update MSCMR high dice score model!
myops: loss1: 0.9468065500259399 loss1 mix: 0.9783675074577332 invariant mix: -0.8359329700469971
MSCMR: loss3: 0.8308475017547607 loss3 mix: 0.7735997438430786 invariant mix MSCMR: -0.969619870185852
Epoch: [5] [ 0/176] eta: 0:21:45 lr: 0.000100 loss: 0.0457 (0.0457) loss_multiDice: 0.7852 (0.7852) loss_CrossEntropy: 0.0457 (0.0457) time: 7.4189 data: 7.4189 max mem: 10285
Epoch: [5] [ 10/176] eta: 0:19:31 lr: 0.000100 loss: 0.0798 (0.0876) loss_multiDice: 0.8082 (0.8145) loss_CrossEntropy: 0.0798 (0.0876) time: 7.0590 data: 7.0590 max mem: 10285
Epoch: [5] [ 20/176] eta: 0:17:31 lr: 0.000100 loss: 0.0905 (0.0955) loss_multiDice: 0.8106 (0.8123) loss_CrossEntropy: 0.0905 (0.0955) time: 6.7379 data: 6.7379 max mem: 10285
Epoch: [5] [ 30/176] eta: 0:17:37 lr: 0.000100 loss: 0.0811 (0.0912) loss_multiDice: 0.8088 (0.8124) loss_CrossEntropy: 0.0811 (0.0912) time: 7.2447 data: 7.2447 max mem: 10285
Epoch: [5] [ 40/176] eta: 0:16:40 lr: 0.000100 loss: 0.0722 (0.0855) loss_multiDice: 0.8023 (0.8089) loss_CrossEntropy: 0.0722 (0.0855) time: 7.3593 data: 7.3593 max mem: 10285
Epoch: [5] [ 50/176] eta: 0:15:09 lr: 0.000100 loss: 0.0592 (0.0856) loss_multiDice: 0.8013 (0.8111) loss_CrossEntropy: 0.0592 (0.0856) time: 7.2146 data: 7.2146 max mem: 10285
Epoch: [5] [ 60/176] eta: 0:13:33 lr: 0.000100 loss: 0.0914 (0.0882) loss_multiDice: 0.8248 (0.8131) loss_CrossEntropy: 0.0914 (0.0882) time: 7.0111 data: 7.0111 max mem: 10285
Epoch: [5] [ 70/176] eta: 0:11:41 lr: 0.000100 loss: 0.0844 (0.0875) loss_multiDice: 0.8106 (0.8118) loss_CrossEntropy: 0.0844 (0.0875) time: 6.6149 data: 6.6149 max mem: 10285
Epoch: [5] [ 80/176] eta: 0:11:08 lr: 0.000100 loss: 0.0788 (0.0893) loss_multiDice: 0.8103 (0.8116) loss_CrossEntropy: 0.0788 (0.0893) time: 6.9596 data: 6.9596 max mem: 10285
Epoch: [5] [ 90/176] eta: 0:10:49 lr: 0.000100 loss: 0.0680 (0.0875) loss_multiDice: 0.8090 (0.8108) loss_CrossEntropy: 0.0680 (0.0875) time: 7.5544 data: 7.5544 max mem: 10285
Epoch: [5] [100/176] eta: 0:08:11 lr: 0.000100 loss: 0.0695 (0.0877) loss_multiDice: 0.8056 (0.8105) loss_CrossEntropy: 0.0695 (0.0877) time: 6.4652 data: 6.4652 max mem: 10285
Epoch: [5] [110/176] eta: 0:04:35 lr: 0.000100 loss: 0.0880 (0.0885) loss_multiDice: 0.8078 (0.8102) loss_CrossEntropy: 0.0880 (0.0885) time: 4.1809 data: 4.1809 max mem: 10285
Epoch: [5] [120/176] eta: 0:01:09 lr: 0.000100 loss: 0.0888 (0.0883) loss_multiDice: 0.8078 (0.8104) loss_CrossEntropy: 0.0888 (0.0883) time: 1.2359 data: 1.2359 max mem: 10285
Epoch: [5] [130/176] eta: 0:04:26 lr: 0.000100 loss: 0.0888 (0.0890) loss_multiDice: 0.8054 (0.8104) loss_CrossEntropy: 0.0888 (0.0890) time: 5.7997 data: 5.7997 max mem: 10285
Epoch: [5] [140/176] eta: 0:03:25 lr: 0.000100 loss: 0.0940 (0.0889) loss_multiDice: 0.8174 (0.8112) loss_CrossEntropy: 0.0940 (0.0889) time: 5.7085 data: 5.7085 max mem: 10285
Epoch: [5] [150/176] eta: 0:02:20 lr: 0.000100 loss: 0.0917 (0.0889) loss_multiDice: 0.8226 (0.8111) loss_CrossEntropy: 0.0917 (0.0889) time: 5.3895 data: 5.3895 max mem: 10285
Epoch: [5] [160/176] eta: 0:00:36 lr: 0.000100 loss: 0.0748 (0.0881) loss_multiDice: 0.8216 (0.8120) loss_CrossEntropy: 0.0748 (0.0881) time: 2.3114 data: 2.3114 max mem: 10285
Epoch: [5] [170/176] eta: 0:00:31 lr: 0.000100 loss: 0.0709 (0.0890) loss_multiDice: 0.8188 (0.8116) loss_CrossEntropy: 0.0709 (0.0890) time: 5.2145 data: 5.2145 max mem: 10285
Epoch: [5] [175/176] eta: 0:00:05 lr: 0.000100 loss: 0.0929 (0.0888) loss_multiDice: 0.8200 (0.8114) loss_CrossEntropy: 0.0929 (0.0888) time: 5.4619 data: 5.4619 max mem: 10285
Test: [ 0/75] eta: 0:00:16 loss: 0.2210 (0.2210) loss_multiDice: 0.1528 (0.1528) loss_CrossEntropy: 0.2210 (0.2210) Avg: 0.0449 (0.0449) time: 0.2138 data: 0.1524 max mem: 10285
Test: [10/75] eta: 0:00:16 loss: 0.2087 (0.2147) loss_multiDice: 0.1319 (0.1345) loss_CrossEntropy: 0.2087 (0.2147) Avg: 0.6415 (0.5833) time: 0.2534 data: 0.1971 max mem: 10285
Test: [20/75] eta: 0:00:14 loss: 0.2377 (0.2508) loss_multiDice: 0.1313 (0.1332) loss_CrossEntropy: 0.2377 (0.2508) Avg: 0.6051 (0.6030) time: 0.2621 data: 0.1983 max mem: 10285
Test: [30/75] eta: 0:00:10 loss: 0.1940 (0.2276) loss_multiDice: 0.0849 (0.1123) loss_CrossEntropy: 0.1940 (0.2276) Avg: 0.7391 (0.6761) time: 0.2328 data: 0.1800 max mem: 10285
Test: [40/75] eta: 0:00:10 loss: 0.1464 (0.2035) loss_multiDice: 0.0631 (0.0997) loss_CrossEntropy: 0.1464 (0.2035) Avg: 0.8744 (0.7274) time: 0.2911 data: 0.2305 max mem: 10285
Test: [50/75] eta: 0:00:05 loss: 0.1121 (0.1887) loss_multiDice: 0.0655 (0.0941) loss_CrossEntropy: 0.1121 (0.1887) Avg: 0.8551 (0.7179) time: 0.2280 data: 0.1835 max mem: 10285
Test: [60/75] eta: 0:00:04 loss: 0.0988 (0.1725) loss_multiDice: 0.0631 (0.0884) loss_CrossEntropy: 0.0988 (0.1725) Avg: 0.7996 (0.7378) time: 0.3029 data: 0.2397 max mem: 10285
Test: [70/75] eta: 0:00:01 loss: 0.1082 (0.1727) loss_multiDice: 0.0775 (0.0900) loss_CrossEntropy: 0.1082 (0.1727) Avg: 0.7555 (0.7266) time: 0.2542 data: 0.1937 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.1390 (0.1788) loss_multiDice: 0.0935 (0.0917) loss_CrossEntropy: 0.1390 (0.1788) Avg: 0.6487 (0.7185) time: 0.2513 data: 0.1897 max mem: 10285
Test: Total time: 0:00:20 (0.2781 s / it)
Averaged stats: loss: 0.1390 (0.1788) loss_multiDice: 0.0935 (0.0917) loss_CrossEntropy: 0.1390 (0.1788) Avg: 0.6487 (0.7185)
MSCMR dice score: 0.7184854193528494
Update MSCMR high dice score model!
myops: loss1: 0.9643281698226929 loss1 mix: 0.991203248500824 invariant mix: -0.9204639196395874
MSCMR: loss3: 0.8154334425926208 loss3 mix: 0.6672778725624084 invariant mix MSCMR: -0.9516973495483398
Epoch: [6] [ 0/176] eta: 0:15:47 lr: 0.000100 loss: 0.0485 (0.0485) loss_multiDice: 0.7669 (0.7669) loss_CrossEntropy: 0.0485 (0.0485) time: 5.3824 data: 5.3824 max mem: 10285
Epoch: [6] [ 10/176] eta: 0:17:05 lr: 0.000100 loss: 0.0777 (0.0853) loss_multiDice: 0.8047 (0.7997) loss_CrossEntropy: 0.0777 (0.0853) time: 6.1789 data: 6.1789 max mem: 10285
Epoch: [6] [ 20/176] eta: 0:14:14 lr: 0.000100 loss: 0.1053 (0.1032) loss_multiDice: 0.8184 (0.8147) loss_CrossEntropy: 0.1053 (0.1032) time: 5.4775 data: 5.4775 max mem: 10285
Epoch: [6] [ 30/176] eta: 0:09:53 lr: 0.000100 loss: 0.0959 (0.0982) loss_multiDice: 0.8239 (0.8147) loss_CrossEntropy: 0.0959 (0.0982) time: 4.0673 data: 4.0673 max mem: 10285
Epoch: [6] [ 40/176] eta: 0:06:05 lr: 0.000100 loss: 0.0843 (0.0982) loss_multiDice: 0.8104 (0.8132) loss_CrossEntropy: 0.0843 (0.0982) time: 2.6898 data: 2.6898 max mem: 10285
Epoch: [6] [ 50/176] eta: 0:11:06 lr: 0.000100 loss: 0.0836 (0.0977) loss_multiDice: 0.8019 (0.8130) loss_CrossEntropy: 0.0836 (0.0977) time: 5.2869 data: 5.2869 max mem: 10285
Epoch: [6] [ 60/176] eta: 0:10:04 lr: 0.000100 loss: 0.0700 (0.0941) loss_multiDice: 0.8019 (0.8111) loss_CrossEntropy: 0.0700 (0.0941) time: 5.2138 data: 5.2138 max mem: 10285
Epoch: [6] [ 70/176] eta: 0:02:21 lr: 0.000100 loss: 0.0701 (0.0918) loss_multiDice: 0.8031 (0.8102) loss_CrossEntropy: 0.0701 (0.0918) time: 1.3390 data: 1.3390 max mem: 10285
Epoch: [6] [ 80/176] eta: 0:01:55 lr: 0.000100 loss: 0.0701 (0.0913) loss_multiDice: 0.8072 (0.8110) loss_CrossEntropy: 0.0701 (0.0913) time: 1.2027 data: 1.2027 max mem: 10285
Epoch: [6] [ 90/176] eta: 0:07:55 lr: 0.000100 loss: 0.0783 (0.0904) loss_multiDice: 0.8123 (0.8101) loss_CrossEntropy: 0.0783 (0.0904) time: 5.5330 data: 5.5330 max mem: 10285
Epoch: [6] [100/176] eta: 0:07:32 lr: 0.000100 loss: 0.0682 (0.0873) loss_multiDice: 0.8017 (0.8096) loss_CrossEntropy: 0.0682 (0.0873) time: 5.9551 data: 5.9551 max mem: 10285
Epoch: [6] [110/176] eta: 0:05:52 lr: 0.000100 loss: 0.0599 (0.0871) loss_multiDice: 0.8076 (0.8102) loss_CrossEntropy: 0.0599 (0.0871) time: 5.3391 data: 5.3391 max mem: 10285
Epoch: [6] [120/176] eta: 0:04:25 lr: 0.000100 loss: 0.0691 (0.0871) loss_multiDice: 0.8151 (0.8102) loss_CrossEntropy: 0.0691 (0.0871) time: 4.7382 data: 4.7382 max mem: 10285
Epoch: [6] [130/176] eta: 0:03:59 lr: 0.000100 loss: 0.0744 (0.0864) loss_multiDice: 0.8217 (0.8114) loss_CrossEntropy: 0.0744 (0.0864) time: 5.2113 data: 5.2113 max mem: 10285
Epoch: [6] [140/176] eta: 0:03:32 lr: 0.000100 loss: 0.0715 (0.0861) loss_multiDice: 0.8303 (0.8122) loss_CrossEntropy: 0.0715 (0.0861) time: 5.9085 data: 5.9085 max mem: 10285
Epoch: [6] [150/176] eta: 0:01:43 lr: 0.000100 loss: 0.0715 (0.0860) loss_multiDice: 0.8205 (0.8130) loss_CrossEntropy: 0.0715 (0.0860) time: 3.9870 data: 3.9870 max mem: 10285
Epoch: [6] [160/176] eta: 0:01:29 lr: 0.000100 loss: 0.0777 (0.0854) loss_multiDice: 0.8012 (0.8126) loss_CrossEntropy: 0.0777 (0.0854) time: 5.5921 data: 5.5921 max mem: 10285
Epoch: [6] [170/176] eta: 0:00:27 lr: 0.000100 loss: 0.0685 (0.0860) loss_multiDice: 0.7917 (0.8112) loss_CrossEntropy: 0.0685 (0.0860) time: 4.5470 data: 4.5470 max mem: 10285
Epoch: [6] [175/176] eta: 0:00:05 lr: 0.000100 loss: 0.0685 (0.0855) loss_multiDice: 0.7917 (0.8110) loss_CrossEntropy: 0.0685 (0.0855) time: 5.5294 data: 5.5294 max mem: 10285
Test: [ 0/75] eta: 0:00:09 loss: 0.1471 (0.1471) loss_multiDice: 0.0993 (0.0993) loss_CrossEntropy: 0.1471 (0.1471) Avg: 0.0633 (0.0633) time: 0.1282 data: 0.0824 max mem: 10285
Test: [10/75] eta: 0:00:18 loss: 0.1603 (0.1723) loss_multiDice: 0.1026 (0.1038) loss_CrossEntropy: 0.1603 (0.1723) Avg: 0.6227 (0.6077) time: 0.2854 data: 0.2272 max mem: 10285
Test: [20/75] eta: 0:00:22 loss: 0.1892 (0.2219) loss_multiDice: 0.1026 (0.1031) loss_CrossEntropy: 0.1892 (0.2219) Avg: 0.6227 (0.6220) time: 0.4120 data: 0.3106 max mem: 10285
Test: [30/75] eta: 0:00:01 loss: 0.2453 (0.2132) loss_multiDice: 0.0727 (0.0900) loss_CrossEntropy: 0.2453 (0.2132) Avg: 0.7820 (0.6907) time: 0.0370 data: 0.0065 max mem: 10285
Test: [40/75] eta: 0:00:13 loss: 0.1374 (0.1919) loss_multiDice: 0.0527 (0.0795) loss_CrossEntropy: 0.1374 (0.1919) Avg: 0.8783 (0.7380) time: 0.3736 data: 0.2854 max mem: 10285
Test: [50/75] eta: 0:00:05 loss: 0.1041 (0.1765) loss_multiDice: 0.0458 (0.0735) loss_CrossEntropy: 0.1041 (0.1765) Avg: 0.8559 (0.7274) time: 0.2002 data: 0.1591 max mem: 10285
Test: [60/75] eta: 0:00:00 loss: 0.0815 (0.1640) loss_multiDice: 0.0475 (0.0715) loss_CrossEntropy: 0.0815 (0.1640) Avg: 0.8351 (0.7459) time: 0.0485 data: 0.0303 max mem: 10285
Test: [70/75] eta: 0:00:01 loss: 0.1204 (0.1621) loss_multiDice: 0.0742 (0.0732) loss_CrossEntropy: 0.1204 (0.1621) Avg: 0.7596 (0.7306) time: 0.2437 data: 0.1769 max mem: 10285
Test: [74/75] eta: 0:00:00 loss: 0.1343 (0.1695) loss_multiDice: 0.0766 (0.0750) loss_CrossEntropy: 0.1343 (0.1695) Avg: 0.5896 (0.7212) time: 0.2159 data: 0.1850 max mem: 10285
Test: Total time: 0:00:16 (0.2174 s / it)
Averaged stats: loss: 0.1343 (0.1695) loss_multiDice: 0.0766 (0.0750) loss_CrossEntropy: 0.1343 (0.1695) Avg: 0.5896 (0.7212)
MSCMR dice score: 0.7211730782190958
Update MSCMR high dice score model!
myops: loss1: 0.9289067387580872 loss1 mix: 0.9851133227348328 invariant mix: -0.84765625
MSCMR: loss3: 0.999195396900177 loss3 mix: 0.9304577112197876 invariant mix MSCMR: -0.917862057685852
Epoch: [7] [ 0/176] eta: 0:03:28 lr: 0.000100 loss: 0.1473 (0.1473) loss_multiDice: 0.8518 (0.8518) loss_CrossEntropy: 0.1473 (0.1473) time: 1.1846 data: 1.1846 max mem: 10285
Epoch: [7] [ 10/176] eta: 0:10:37 lr: 0.000100 loss: 0.0844 (0.0928) loss_multiDice: 0.8268 (0.8282) loss_CrossEntropy: 0.0844 (0.0928) time: 3.8414 data: 3.8414 max mem: 10285
Epoch: [7] [ 20/176] eta: 0:14:50 lr: 0.000100 loss: 0.0738 (0.0862) loss_multiDice: 0.8251 (0.8206) loss_CrossEntropy: 0.0738 (0.0862) time: 5.7062 data: 5.7062 max mem: 10285
Epoch: [7] [ 30/176] eta: 0:10:36 lr: 0.000100 loss: 0.0738 (0.0890) loss_multiDice: 0.7993 (0.8095) loss_CrossEntropy: 0.0738 (0.0890) time: 4.3591 data: 4.3591 max mem: 10285
Epoch: [7] [ 40/176] eta: 0:13:24 lr: 0.000100 loss: 0.0765 (0.0880) loss_multiDice: 0.7979 (0.8135) loss_CrossEntropy: 0.0765 (0.0880) time: 5.9152 data: 5.9152 max mem: 10285
Epoch: [7] [ 50/176] eta: 0:12:14 lr: 0.000100 loss: 0.0765 (0.0873) loss_multiDice: 0.8166 (0.8160) loss_CrossEntropy: 0.0765 (0.0873) time: 5.8326 data: 5.8326 max mem: 10285
Epoch: [7] [ 60/176] eta: 0:10:20 lr: 0.000100 loss: 0.0646 (0.0844) loss_multiDice: 0.8155 (0.8158) loss_CrossEntropy: 0.0646 (0.0844) time: 5.3528 data: 5.3528 max mem: 10285
Epoch: [7] [ 70/176] eta: 0:09:20 lr: 0.000100 loss: 0.0671 (0.0834) loss_multiDice: 0.8127 (0.8145) loss_CrossEntropy: 0.0671 (0.0834) time: 5.2846 data: 5.2846 max mem: 10285
Epoch: [7] [ 80/176] eta: 0:03:22 lr: 0.000100 loss: 0.0708 (0.0852) loss_multiDice: 0.8050 (0.8137) loss_CrossEntropy: 0.0708 (0.0852) time: 2.1067 data: 2.1067 max mem: 10285
Epoch: [7] [ 90/176] eta: 0:07:20 lr: 0.000100 loss: 0.0734 (0.0849) loss_multiDice: 0.8107 (0.8125) loss_CrossEntropy: 0.0734 (0.0849) time: 5.1173 data: 5.1173 max mem: 10285
Epoch: [7] [100/176] eta: 0:07:38 lr: 0.000100 loss: 0.0749 (0.0840) loss_multiDice: 0.8017 (0.8112) loss_CrossEntropy: 0.0749 (0.0840) time: 6.0265 data: 6.0265 max mem: 10285
Epoch: [7] [110/176] eta: 0:04:57 lr: 0.000100 loss: 0.0763 (0.0837) loss_multiDice: 0.7995 (0.8103) loss_CrossEntropy: 0.0763 (0.0837) time: 4.5001 data: 4.5001 max mem: 10285
Epoch: [7] [120/176] eta: 0:05:17 lr: 0.000100 loss: 0.0763 (0.0830) loss_multiDice: 0.8069 (0.8113) loss_CrossEntropy: 0.0763 (0.0830) time: 5.6680 data: 5.6680 max mem: 10288
Epoch: [7] [130/176] eta: 0:04:15 lr: 0.000100 loss: 0.0738 (0.0828) loss_multiDice: 0.8245 (0.8120) loss_CrossEntropy: 0.0738 (0.0828) time: 5.5493 data: 5.5493 max mem: 10288
Epoch: [7] [140/176] eta: 0:01:45 lr: 0.000100 loss: 0.0769 (0.0832) loss_multiDice: 0.8067 (0.8106) loss_CrossEntropy: 0.0769 (0.0832) time: 2.9192 data: 2.9192 max mem: 10288
Epoch: [7] [150/176] eta: 0:02:34 lr: 0.000100 loss: 0.0873 (0.0832) loss_multiDice: 0.8060 (0.8107) loss_CrossEntropy: 0.0873 (0.0832) time: 5.9487 data: 5.9487 max mem: 10288
Epoch: [7] [160/176] eta: 0:01:19 lr: 0.000100 loss: 0.0737 (0.0823) loss_multiDice: 0.7973 (0.8097) loss_CrossEntropy: 0.0737 (0.0823) time: 4.9547 data: 4.9547 max mem: 10288
Epoch: [7] [170/176] eta: 0:00:22 lr: 0.000100 loss: 0.0810 (0.0834) loss_multiDice: 0.8013 (0.8103) loss_CrossEntropy: 0.0810 (0.0834) time: 3.7212 data: 3.7212 max mem: 10288
Epoch: [7] [175/176] eta: 0:00:05 lr: 0.000100 loss: 0.0750 (0.0833) loss_multiDice: 0.8056 (0.8105) loss_CrossEntropy: 0.0750 (0.0833) time: 5.6780 data: 5.6780 max mem: 10288
Test: [ 0/75] eta: 0:00:13 loss: 0.1726 (0.1726) loss_multiDice: 0.1344 (0.1344) loss_CrossEntropy: 0.1726 (0.1726) Avg: 0.0524 (0.0524) time: 0.1819 data: 0.1392 max mem: 10288
Test: [10/75] eta: 0:00:02 loss: 0.1989 (0.1946) loss_multiDice: 0.1344 (0.1359) loss_CrossEntropy: 0.1989 (0.1946) Avg: 0.6850 (0.6333) time: 0.0334 data: 0.0107 max mem: 10288
Test: [20/75] eta: 0:00:19 loss: 0.2101 (0.2085) loss_multiDice: 0.1294 (0.1312) loss_CrossEntropy: 0.2101 (0.2085) Avg: 0.7125 (0.6704) time: 0.3560 data: 0.2677 max mem: 10288
Test: [30/75] eta: 0:00:06 loss: 0.1672 (0.1878) loss_multiDice: 0.0823 (0.1128) loss_CrossEntropy: 0.1672 (0.1878) Avg: 0.8504 (0.7316) time: 0.1538 data: 0.1240 max mem: 10288
Test: [40/75] eta: 0:00:01 loss: 0.1172 (0.1679) loss_multiDice: 0.0691 (0.0998) loss_CrossEntropy: 0.1172 (0.1679) Avg: 0.9052 (0.7747) time: 0.0524 data: 0.0225 max mem: 10288
Test: [50/75] eta: 0:00:08 loss: 0.1149 (0.1595) loss_multiDice: 0.0718 (0.0959) loss_CrossEntropy: 0.1149 (0.1595) Avg: 0.8811 (0.7595) time: 0.3333 data: 0.2488 max mem: 10288
Test: [60/75] eta: 0:00:00 loss: 0.1228 (0.1540) loss_multiDice: 0.0901 (0.0946) loss_CrossEntropy: 0.1228 (0.1540) Avg: 0.8385 (0.7717) time: 0.0558 data: 0.0385 max mem: 10288
Test: [70/75] eta: 0:00:00 loss: 0.1469 (0.1586) loss_multiDice: 0.0951 (0.0982) loss_CrossEntropy: 0.1469 (0.1586) Avg: 0.7452 (0.7523) time: 0.0613 data: 0.0258 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1679 (0.1643) loss_multiDice: 0.1124 (0.1003) loss_CrossEntropy: 0.1679 (0.1643) Avg: 0.6849 (0.7449) time: 0.1734 data: 0.1239 max mem: 10288
Test: Total time: 0:00:12 (0.1663 s / it)
Averaged stats: loss: 0.1679 (0.1643) loss_multiDice: 0.1124 (0.1003) loss_CrossEntropy: 0.1679 (0.1643) Avg: 0.6849 (0.7449)
MSCMR dice score: 0.7449474651614825
Update MSCMR best model!
Update MSCMR high dice score model!
myops: loss1: 0.9432271718978882 loss1 mix: 0.9633957743644714 invariant mix: -0.979600727558136
MSCMR: loss3: 0.8681116700172424 loss3 mix: 0.7524466514587402 invariant mix MSCMR: -0.9239624738693237
Epoch: [8] [ 0/176] eta: 0:14:42 lr: 0.000100 loss: 0.1204 (0.1204) loss_multiDice: 0.7477 (0.7477) loss_CrossEntropy: 0.1204 (0.1204) time: 5.0126 data: 5.0126 max mem: 10288
Epoch: [8] [ 10/176] eta: 0:15:23 lr: 0.000100 loss: 0.0673 (0.0707) loss_multiDice: 0.8225 (0.8061) loss_CrossEntropy: 0.0673 (0.0707) time: 5.5631 data: 5.5631 max mem: 10288
Epoch: [8] [ 20/176] eta: 0:06:38 lr: 0.000100 loss: 0.0677 (0.0792) loss_multiDice: 0.8027 (0.8065) loss_CrossEntropy: 0.0677 (0.0792) time: 2.5530 data: 2.5530 max mem: 10288
Epoch: [8] [ 30/176] eta: 0:13:40 lr: 0.000100 loss: 0.0709 (0.0782) loss_multiDice: 0.8002 (0.8058) loss_CrossEntropy: 0.0709 (0.0782) time: 5.6169 data: 5.6169 max mem: 10288
Epoch: [8] [ 40/176] eta: 0:13:24 lr: 0.000100 loss: 0.0774 (0.0835) loss_multiDice: 0.7961 (0.8050) loss_CrossEntropy: 0.0774 (0.0835) time: 5.9145 data: 5.9145 max mem: 10288
Epoch: [8] [ 50/176] eta: 0:12:28 lr: 0.000100 loss: 0.0816 (0.0838) loss_multiDice: 0.7961 (0.8058) loss_CrossEntropy: 0.0816 (0.0838) time: 5.9430 data: 5.9430 max mem: 10288
Epoch: [8] [ 60/176] eta: 0:04:41 lr: 0.000100 loss: 0.0765 (0.0840) loss_multiDice: 0.8044 (0.8055) loss_CrossEntropy: 0.0765 (0.0840) time: 2.4276 data: 2.4276 max mem: 10288
Epoch: [8] [ 70/176] eta: 0:05:18 lr: 0.000100 loss: 0.0755 (0.0842) loss_multiDice: 0.8044 (0.8054) loss_CrossEntropy: 0.0755 (0.0842) time: 3.0047 data: 3.0047 max mem: 10288
Epoch: [8] [ 80/176] eta: 0:02:14 lr: 0.000100 loss: 0.0643 (0.0809) loss_multiDice: 0.8044 (0.8056) loss_CrossEntropy: 0.0643 (0.0809) time: 1.3960 data: 1.3960 max mem: 10288
Epoch: [8] [ 90/176] eta: 0:07:17 lr: 0.000100 loss: 0.0636 (0.0811) loss_multiDice: 0.7975 (0.8052) loss_CrossEntropy: 0.0636 (0.0811) time: 5.0925 data: 5.0925 max mem: 10288
Epoch: [8] [100/176] eta: 0:07:08 lr: 0.000100 loss: 0.0777 (0.0811) loss_multiDice: 0.8047 (0.8062) loss_CrossEntropy: 0.0777 (0.0811) time: 5.6376 data: 5.6376 max mem: 10288
Epoch: [8] [110/176] eta: 0:03:03 lr: 0.000100 loss: 0.0798 (0.0827) loss_multiDice: 0.8152 (0.8064) loss_CrossEntropy: 0.0798 (0.0827) time: 2.7776 data: 2.7776 max mem: 10288
Epoch: [8] [120/176] eta: 0:02:47 lr: 0.000100 loss: 0.0778 (0.0813) loss_multiDice: 0.8152 (0.8062) loss_CrossEntropy: 0.0778 (0.0813) time: 2.9912 data: 2.9912 max mem: 10288
Epoch: [8] [130/176] eta: 0:04:15 lr: 0.000100 loss: 0.0658 (0.0801) loss_multiDice: 0.7990 (0.8059) loss_CrossEntropy: 0.0658 (0.0801) time: 5.5591 data: 5.5591 max mem: 10288
Epoch: [8] [140/176] eta: 0:03:24 lr: 0.000100 loss: 0.0765 (0.0808) loss_multiDice: 0.8140 (0.8073) loss_CrossEntropy: 0.0765 (0.0808) time: 5.6942 data: 5.6942 max mem: 10288
Epoch: [8] [150/176] eta: 0:02:43 lr: 0.000100 loss: 0.0765 (0.0803) loss_multiDice: 0.8140 (0.8068) loss_CrossEntropy: 0.0765 (0.0803) time: 6.2811 data: 6.2811 max mem: 10288
Epoch: [8] [160/176] eta: 0:01:27 lr: 0.000100 loss: 0.0695 (0.0801) loss_multiDice: 0.7938 (0.8065) loss_CrossEntropy: 0.0695 (0.0801) time: 5.4912 data: 5.4912 max mem: 10288
Epoch: [8] [170/176] eta: 0:00:14 lr: 0.000100 loss: 0.0695 (0.0794) loss_multiDice: 0.8010 (0.8068) loss_CrossEntropy: 0.0695 (0.0794) time: 2.3860 data: 2.3860 max mem: 10288
Epoch: [8] [175/176] eta: 0:00:05 lr: 0.000100 loss: 0.0665 (0.0788) loss_multiDice: 0.8010 (0.8065) loss_CrossEntropy: 0.0665 (0.0788) time: 5.8322 data: 5.8322 max mem: 10288
Test: [ 0/75] eta: 0:00:18 loss: 0.1815 (0.1815) loss_multiDice: 0.1245 (0.1245) loss_CrossEntropy: 0.1815 (0.1815) Avg: 0.0415 (0.0415) time: 0.2409 data: 0.1862 max mem: 10288
Test: [10/75] eta: 0:00:24 loss: 0.2121 (0.2302) loss_multiDice: 0.1324 (0.1330) loss_CrossEntropy: 0.2121 (0.2302) Avg: 0.6202 (0.5827) time: 0.3773 data: 0.2958 max mem: 10288
Test: [20/75] eta: 0:00:02 loss: 0.2566 (0.2799) loss_multiDice: 0.1268 (0.1317) loss_CrossEntropy: 0.2566 (0.2799) Avg: 0.6143 (0.5992) time: 0.0413 data: 0.0072 max mem: 10288
Test: [30/75] eta: 0:00:16 loss: 0.2800 (0.2667) loss_multiDice: 0.0827 (0.1138) loss_CrossEntropy: 0.2800 (0.2667) Avg: 0.7669 (0.6706) time: 0.3754 data: 0.3006 max mem: 10288
Test: [40/75] eta: 0:00:06 loss: 0.1691 (0.2402) loss_multiDice: 0.0661 (0.1002) loss_CrossEntropy: 0.1691 (0.2402) Avg: 0.8693 (0.7203) time: 0.1759 data: 0.1390 max mem: 10288
Test: [50/75] eta: 0:00:06 loss: 0.1644 (0.2267) loss_multiDice: 0.0614 (0.0951) loss_CrossEntropy: 0.1644 (0.2267) Avg: 0.8518 (0.7067) time: 0.2466 data: 0.1626 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.1353 (0.2101) loss_multiDice: 0.0749 (0.0917) loss_CrossEntropy: 0.1353 (0.2101) Avg: 0.8165 (0.7268) time: 0.4116 data: 0.2939 max mem: 10288
Test: [70/75] eta: 0:00:00 loss: 0.1585 (0.2099) loss_multiDice: 0.0918 (0.0947) loss_CrossEntropy: 0.1585 (0.2099) Avg: 0.7526 (0.7135) time: 0.0339 data: 0.0134 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1786 (0.2163) loss_multiDice: 0.1010 (0.0960) loss_CrossEntropy: 0.1786 (0.2163) Avg: 0.6368 (0.7071) time: 0.0492 data: 0.0194 max mem: 10288
Test: Total time: 0:00:17 (0.2275 s / it)
Averaged stats: loss: 0.1786 (0.2163) loss_multiDice: 0.1010 (0.0960) loss_CrossEntropy: 0.1786 (0.2163) Avg: 0.6368 (0.7071)
MSCMR dice score: 0.7070766154925029
Update MSCMR high dice score model!
myops: loss1: 0.9438930153846741 loss1 mix: 0.9751041531562805 invariant mix: -0.8287760615348816
MSCMR: loss3: 0.84529709815979 loss3 mix: 0.7074484825134277 invariant mix MSCMR: -0.8816478252410889
Epoch: [9] [ 0/176] eta: 0:09:41 lr: 0.000100 loss: 0.0419 (0.0419) loss_multiDice: 0.8034 (0.8034) loss_CrossEntropy: 0.0419 (0.0419) time: 3.3025 data: 3.3025 max mem: 10288
Epoch: [9] [ 10/176] eta: 0:16:13 lr: 0.000100 loss: 0.0798 (0.0979) loss_multiDice: 0.8034 (0.8022) loss_CrossEntropy: 0.0798 (0.0979) time: 5.8663 data: 5.8663 max mem: 10288
Epoch: [9] [ 20/176] eta: 0:05:27 lr: 0.000100 loss: 0.0798 (0.0987) loss_multiDice: 0.7961 (0.7965) loss_CrossEntropy: 0.0798 (0.0987) time: 2.1001 data: 2.1001 max mem: 10288
Epoch: [9] [ 30/176] eta: 0:09:06 lr: 0.000100 loss: 0.0878 (0.0958) loss_multiDice: 0.7963 (0.8043) loss_CrossEntropy: 0.0878 (0.0958) time: 3.7456 data: 3.7456 max mem: 10288
Epoch: [9] [ 40/176] eta: 0:12:07 lr: 0.000100 loss: 0.0903 (0.0947) loss_multiDice: 0.8027 (0.8042) loss_CrossEntropy: 0.0903 (0.0947) time: 5.3497 data: 5.3497 max mem: 10288
Epoch: [9] [ 50/176] eta: 0:12:16 lr: 0.000100 loss: 0.0894 (0.0948) loss_multiDice: 0.8026 (0.8053) loss_CrossEntropy: 0.0894 (0.0948) time: 5.8425 data: 5.8425 max mem: 10288
Epoch: [9] [ 60/176] eta: 0:12:04 lr: 0.000100 loss: 0.0805 (0.0929) loss_multiDice: 0.8146 (0.8075) loss_CrossEntropy: 0.0805 (0.0929) time: 6.2456 data: 6.2456 max mem: 10288
Epoch: [9] [ 70/176] eta: 0:05:47 lr: 0.000100 loss: 0.0693 (0.0909) loss_multiDice: 0.8216 (0.8098) loss_CrossEntropy: 0.0693 (0.0909) time: 3.2756 data: 3.2756 max mem: 10288
Epoch: [9] [ 80/176] eta: 0:06:44 lr: 0.000100 loss: 0.0597 (0.0886) loss_multiDice: 0.8027 (0.8083) loss_CrossEntropy: 0.0597 (0.0886) time: 4.2158 data: 4.2158 max mem: 10288
Epoch: [9] [ 90/176] eta: 0:01:42 lr: 0.000100 loss: 0.0589 (0.0862) loss_multiDice: 0.8014 (0.8079) loss_CrossEntropy: 0.0589 (0.0862) time: 1.1889 data: 1.1889 max mem: 10288
Epoch: [9] [100/176] eta: 0:06:14 lr: 0.000100 loss: 0.0702 (0.0860) loss_multiDice: 0.8043 (0.8087) loss_CrossEntropy: 0.0702 (0.0860) time: 4.9306 data: 4.9306 max mem: 10288
Epoch: [9] [110/176] eta: 0:05:21 lr: 0.000100 loss: 0.0731 (0.0846) loss_multiDice: 0.8043 (0.8098) loss_CrossEntropy: 0.0731 (0.0846) time: 4.8659 data: 4.8659 max mem: 10288
Epoch: [9] [120/176] eta: 0:05:07 lr: 0.000100 loss: 0.0752 (0.0845) loss_multiDice: 0.8042 (0.8095) loss_CrossEntropy: 0.0752 (0.0845) time: 5.4893 data: 5.4893 max mem: 10288
Epoch: [9] [130/176] eta: 0:03:15 lr: 0.000100 loss: 0.0740 (0.0829) loss_multiDice: 0.8048 (0.8092) loss_CrossEntropy: 0.0740 (0.0829) time: 4.2481 data: 4.2481 max mem: 10288
Epoch: [9] [140/176] eta: 0:01:53 lr: 0.000100 loss: 0.0727 (0.0833) loss_multiDice: 0.8074 (0.8096) loss_CrossEntropy: 0.0727 (0.0833) time: 3.1484 data: 3.1484 max mem: 10288
Epoch: [9] [150/176] eta: 0:02:27 lr: 0.000100 loss: 0.0783 (0.0841) loss_multiDice: 0.8129 (0.8100) loss_CrossEntropy: 0.0783 (0.0841) time: 5.6823 data: 5.6823 max mem: 10288
Epoch: [9] [160/176] eta: 0:00:20 lr: 0.000100 loss: 0.0731 (0.0844) loss_multiDice: 0.8139 (0.8109) loss_CrossEntropy: 0.0731 (0.0844) time: 1.2608 data: 1.2608 max mem: 10288
Epoch: [9] [170/176] eta: 0:00:33 lr: 0.000100 loss: 0.0709 (0.0843) loss_multiDice: 0.8242 (0.8119) loss_CrossEntropy: 0.0709 (0.0843) time: 5.5936 data: 5.5936 max mem: 10288
Epoch: [9] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0709 (0.0844) loss_multiDice: 0.8224 (0.8120) loss_CrossEntropy: 0.0709 (0.0844) time: 6.0880 data: 6.0880 max mem: 10288
Test: [ 0/75] eta: 0:00:22 loss: 0.1744 (0.1744) loss_multiDice: 0.1161 (0.1161) loss_CrossEntropy: 0.1744 (0.1744) Avg: 0.0333 (0.0333) time: 0.2962 data: 0.2341 max mem: 10288
Test: [10/75] eta: 0:00:25 loss: 0.1648 (0.1729) loss_multiDice: 0.1099 (0.1074) loss_CrossEntropy: 0.1648 (0.1729) Avg: 0.7004 (0.5896) time: 0.3994 data: 0.2978 max mem: 10288
Test: [20/75] eta: 0:00:16 loss: 0.1717 (0.1984) loss_multiDice: 0.0982 (0.1021) loss_CrossEntropy: 0.1717 (0.1984) Avg: 0.6895 (0.6337) time: 0.2975 data: 0.2309 max mem: 10288
Test: [30/75] eta: 0:00:16 loss: 0.1750 (0.1863) loss_multiDice: 0.0590 (0.0863) loss_CrossEntropy: 0.1750 (0.1863) Avg: 0.8330 (0.7025) time: 0.3752 data: 0.3084 max mem: 10288
Test: [40/75] eta: 0:00:06 loss: 0.1165 (0.1679) loss_multiDice: 0.0539 (0.0777) loss_CrossEntropy: 0.1165 (0.1679) Avg: 0.8916 (0.7490) time: 0.1910 data: 0.1517 max mem: 10288
Test: [50/75] eta: 0:00:09 loss: 0.1026 (0.1566) loss_multiDice: 0.0499 (0.0730) loss_CrossEntropy: 0.1026 (0.1566) Avg: 0.8712 (0.7368) time: 0.3778 data: 0.2868 max mem: 10288
Test: [60/75] eta: 0:00:03 loss: 0.0711 (0.1431) loss_multiDice: 0.0485 (0.0688) loss_CrossEntropy: 0.0711 (0.1431) Avg: 0.8420 (0.7520) time: 0.2509 data: 0.2000 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1012 (0.1463) loss_multiDice: 0.0660 (0.0712) loss_CrossEntropy: 0.1012 (0.1463) Avg: 0.7628 (0.7301) time: 0.3387 data: 0.2622 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1290 (0.1535) loss_multiDice: 0.0709 (0.0738) loss_CrossEntropy: 0.1290 (0.1535) Avg: 0.6090 (0.7208) time: 0.1950 data: 0.1659 max mem: 10288
Test: Total time: 0:00:22 (0.2976 s / it)
Averaged stats: loss: 0.1290 (0.1535) loss_multiDice: 0.0709 (0.0738) loss_CrossEntropy: 0.1290 (0.1535) Avg: 0.6090 (0.7208)
MSCMR dice score: 0.7208165552715461
Update MSCMR high dice score model!
myops: loss1: 0.923290491104126 loss1 mix: 0.9314665794372559 invariant mix: -0.9750434160232544
MSCMR: loss3: 0.9126628637313843 loss3 mix: 0.8333991169929504 invariant mix MSCMR: -0.8483465909957886
Epoch: [10] [ 0/176] eta: 0:17:31 lr: 0.000100 loss: 0.0744 (0.0744) loss_multiDice: 0.8382 (0.8382) loss_CrossEntropy: 0.0744 (0.0744) time: 5.9768 data: 5.9768 max mem: 10288
Epoch: [10] [ 10/176] eta: 0:15:14 lr: 0.000100 loss: 0.0790 (0.0903) loss_multiDice: 0.8131 (0.8152) loss_CrossEntropy: 0.0790 (0.0903) time: 5.5101 data: 5.5101 max mem: 10288
Epoch: [10] [ 20/176] eta: 0:14:59 lr: 0.000100 loss: 0.0790 (0.0841) loss_multiDice: 0.8131 (0.8068) loss_CrossEntropy: 0.0790 (0.0841) time: 5.7684 data: 5.7684 max mem: 10288
Epoch: [10] [ 30/176] eta: 0:14:02 lr: 0.000100 loss: 0.0766 (0.0815) loss_multiDice: 0.8207 (0.8130) loss_CrossEntropy: 0.0766 (0.0815) time: 5.7711 data: 5.7711 max mem: 10288
Epoch: [10] [ 40/176] eta: 0:12:46 lr: 0.000100 loss: 0.0643 (0.0769) loss_multiDice: 0.7990 (0.8097) loss_CrossEntropy: 0.0643 (0.0769) time: 5.6345 data: 5.6345 max mem: 10288
Epoch: [10] [ 50/176] eta: 0:10:52 lr: 0.000100 loss: 0.0646 (0.0802) loss_multiDice: 0.7990 (0.8074) loss_CrossEntropy: 0.0646 (0.0802) time: 5.1792 data: 5.1792 max mem: 10288
Epoch: [10] [ 60/176] eta: 0:10:46 lr: 0.000100 loss: 0.0665 (0.0798) loss_multiDice: 0.8029 (0.8089) loss_CrossEntropy: 0.0665 (0.0798) time: 5.5761 data: 5.5761 max mem: 10288
Epoch: [10] [ 70/176] eta: 0:10:39 lr: 0.000100 loss: 0.0662 (0.0800) loss_multiDice: 0.8060 (0.8085) loss_CrossEntropy: 0.0662 (0.0800) time: 6.0357 data: 6.0357 max mem: 10288
Epoch: [10] [ 80/176] eta: 0:08:54 lr: 0.000100 loss: 0.0748 (0.0806) loss_multiDice: 0.8060 (0.8091) loss_CrossEntropy: 0.0748 (0.0806) time: 5.5626 data: 5.5626 max mem: 10288
Epoch: [10] [ 90/176] eta: 0:08:21 lr: 0.000100 loss: 0.0712 (0.0805) loss_multiDice: 0.8034 (0.8085) loss_CrossEntropy: 0.0712 (0.0805) time: 5.8276 data: 5.8276 max mem: 10288
Epoch: [10] [100/176] eta: 0:02:26 lr: 0.000100 loss: 0.0722 (0.0797) loss_multiDice: 0.8003 (0.8080) loss_CrossEntropy: 0.0722 (0.0797) time: 1.9337 data: 1.9337 max mem: 10288
Epoch: [10] [110/176] eta: 0:06:15 lr: 0.000100 loss: 0.0780 (0.0822) loss_multiDice: 0.7987 (0.8080) loss_CrossEntropy: 0.0780 (0.0822) time: 5.6911 data: 5.6911 max mem: 10288
Epoch: [10] [120/176] eta: 0:02:19 lr: 0.000100 loss: 0.0830 (0.0828) loss_multiDice: 0.7987 (0.8090) loss_CrossEntropy: 0.0830 (0.0828) time: 2.4864 data: 2.4864 max mem: 10288
Epoch: [10] [130/176] eta: 0:05:29 lr: 0.000100 loss: 0.0764 (0.0822) loss_multiDice: 0.8102 (0.8088) loss_CrossEntropy: 0.0764 (0.0822) time: 7.1567 data: 7.1567 max mem: 10288
Epoch: [10] [140/176] eta: 0:04:38 lr: 0.000100 loss: 0.0697 (0.0819) loss_multiDice: 0.8022 (0.8093) loss_CrossEntropy: 0.0697 (0.0819) time: 7.7225 data: 7.7225 max mem: 10288
Epoch: [10] [150/176] eta: 0:02:46 lr: 0.000100 loss: 0.0697 (0.0821) loss_multiDice: 0.8072 (0.8101) loss_CrossEntropy: 0.0697 (0.0821) time: 6.3924 data: 6.3924 max mem: 10288
Epoch: [10] [160/176] eta: 0:01:58 lr: 0.000100 loss: 0.0720 (0.0820) loss_multiDice: 0.8077 (0.8099) loss_CrossEntropy: 0.0720 (0.0820) time: 7.3762 data: 7.3762 max mem: 10288
Epoch: [10] [170/176] eta: 0:00:44 lr: 0.000100 loss: 0.0662 (0.0815) loss_multiDice: 0.8123 (0.8106) loss_CrossEntropy: 0.0662 (0.0815) time: 7.4426 data: 7.4426 max mem: 10288
Epoch: [10] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0672 (0.0809) loss_multiDice: 0.8124 (0.8104) loss_CrossEntropy: 0.0672 (0.0809) time: 7.4713 data: 7.4713 max mem: 10288
Test: [ 0/75] eta: 0:00:30 loss: 0.2295 (0.2295) loss_multiDice: 0.1533 (0.1533) loss_CrossEntropy: 0.2295 (0.2295) Avg: 0.0361 (0.0361) time: 0.4121 data: 0.3077 max mem: 10288
Test: [10/75] eta: 0:00:25 loss: 0.2295 (0.2376) loss_multiDice: 0.1523 (0.1521) loss_CrossEntropy: 0.2295 (0.2376) Avg: 0.5973 (0.5686) time: 0.3997 data: 0.3056 max mem: 10288
Test: [20/75] eta: 0:00:18 loss: 0.2426 (0.2638) loss_multiDice: 0.1482 (0.1428) loss_CrossEntropy: 0.2426 (0.2638) Avg: 0.6265 (0.6165) time: 0.3311 data: 0.2508 max mem: 10288
Test: [30/75] eta: 0:00:15 loss: 0.2334 (0.2404) loss_multiDice: 0.0867 (0.1207) loss_CrossEntropy: 0.2334 (0.2404) Avg: 0.8255 (0.6914) time: 0.3337 data: 0.2784 max mem: 10288
Test: [40/75] eta: 0:00:12 loss: 0.1389 (0.2141) loss_multiDice: 0.0708 (0.1069) loss_CrossEntropy: 0.1389 (0.2141) Avg: 0.8943 (0.7429) time: 0.3660 data: 0.2964 max mem: 10288
Test: [50/75] eta: 0:00:10 loss: 0.1239 (0.1988) loss_multiDice: 0.0720 (0.1005) loss_CrossEntropy: 0.1239 (0.1988) Avg: 0.8794 (0.7320) time: 0.4392 data: 0.3237 max mem: 10288
Test: [60/75] eta: 0:00:05 loss: 0.1239 (0.1864) loss_multiDice: 0.0839 (0.0975) loss_CrossEntropy: 0.1239 (0.1864) Avg: 0.7911 (0.7459) time: 0.3598 data: 0.2763 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1410 (0.1919) loss_multiDice: 0.0958 (0.1022) loss_CrossEntropy: 0.1410 (0.1919) Avg: 0.6720 (0.7203) time: 0.3489 data: 0.2860 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1990 (0.1982) loss_multiDice: 0.1232 (0.1044) loss_CrossEntropy: 0.1990 (0.1982) Avg: 0.5554 (0.7117) time: 0.2296 data: 0.1743 max mem: 10288
Test: Total time: 0:00:26 (0.3596 s / it)
Averaged stats: loss: 0.1990 (0.1982) loss_multiDice: 0.1232 (0.1044) loss_CrossEntropy: 0.1990 (0.1982) Avg: 0.5554 (0.7117)
MSCMR dice score: 0.7117214126884938
Update MSCMR high dice score model!
myops: loss1: 0.9190550446510315 loss1 mix: 0.9973039627075195 invariant mix: -0.991319477558136
MSCMR: loss3: 0.8359803557395935 loss3 mix: 0.8382548093795776 invariant mix MSCMR: -0.9548074007034302
Epoch: [11] [ 0/176] eta: 0:18:06 lr: 0.000100 loss: 0.0531 (0.0531) loss_multiDice: 0.7829 (0.7829) loss_CrossEntropy: 0.0531 (0.0531) time: 6.1760 data: 6.1760 max mem: 10288
Epoch: [11] [ 10/176] eta: 0:21:15 lr: 0.000100 loss: 0.1110 (0.1051) loss_multiDice: 0.8541 (0.8395) loss_CrossEntropy: 0.1110 (0.1051) time: 7.6862 data: 7.6862 max mem: 10288
Epoch: [11] [ 20/176] eta: 0:18:49 lr: 0.000100 loss: 0.0886 (0.0969) loss_multiDice: 0.8221 (0.8276) loss_CrossEntropy: 0.0886 (0.0969) time: 7.2421 data: 7.2421 max mem: 10288
Epoch: [11] [ 30/176] eta: 0:17:59 lr: 0.000100 loss: 0.0764 (0.0924) loss_multiDice: 0.8199 (0.8236) loss_CrossEntropy: 0.0764 (0.0924) time: 7.3924 data: 7.3924 max mem: 10288
Epoch: [11] [ 40/176] eta: 0:11:15 lr: 0.000100 loss: 0.0749 (0.0919) loss_multiDice: 0.8053 (0.8196) loss_CrossEntropy: 0.0749 (0.0919) time: 4.9686 data: 4.9686 max mem: 10288
Epoch: [11] [ 50/176] eta: 0:13:06 lr: 0.000100 loss: 0.0711 (0.0887) loss_multiDice: 0.8019 (0.8167) loss_CrossEntropy: 0.0711 (0.0887) time: 6.2442 data: 6.2442 max mem: 10288
Epoch: [11] [ 60/176] eta: 0:12:26 lr: 0.000100 loss: 0.0664 (0.0864) loss_multiDice: 0.7996 (0.8135) loss_CrossEntropy: 0.0664 (0.0864) time: 6.4363 data: 6.4363 max mem: 10288
Epoch: [11] [ 70/176] eta: 0:11:42 lr: 0.000100 loss: 0.0626 (0.0842) loss_multiDice: 0.8003 (0.8115) loss_CrossEntropy: 0.0626 (0.0842) time: 6.6278 data: 6.6278 max mem: 10288
Epoch: [11] [ 80/176] eta: 0:10:37 lr: 0.000100 loss: 0.0823 (0.0881) loss_multiDice: 0.8088 (0.8120) loss_CrossEntropy: 0.0823 (0.0881) time: 6.6398 data: 6.6398 max mem: 10288
Epoch: [11] [ 90/176] eta: 0:09:27 lr: 0.000100 loss: 0.0849 (0.0893) loss_multiDice: 0.8150 (0.8128) loss_CrossEntropy: 0.0849 (0.0893) time: 6.5941 data: 6.5941 max mem: 10288
Epoch: [11] [100/176] eta: 0:05:25 lr: 0.000100 loss: 0.0791 (0.0879) loss_multiDice: 0.8074 (0.8119) loss_CrossEntropy: 0.0791 (0.0879) time: 4.2804 data: 4.2804 max mem: 10288
Epoch: [11] [110/176] eta: 0:07:02 lr: 0.000100 loss: 0.0642 (0.0863) loss_multiDice: 0.8049 (0.8108) loss_CrossEntropy: 0.0642 (0.0863) time: 6.4065 data: 6.4065 max mem: 10288
Epoch: [11] [120/176] eta: 0:06:34 lr: 0.000100 loss: 0.0642 (0.0853) loss_multiDice: 0.8001 (0.8107) loss_CrossEntropy: 0.0642 (0.0853) time: 7.0438 data: 7.0438 max mem: 10288
Epoch: [11] [130/176] eta: 0:05:02 lr: 0.000100 loss: 0.0571 (0.0830) loss_multiDice: 0.8079 (0.8111) loss_CrossEntropy: 0.0571 (0.0830) time: 6.5804 data: 6.5804 max mem: 10288
Epoch: [11] [140/176] eta: 0:03:37 lr: 0.000100 loss: 0.0568 (0.0820) loss_multiDice: 0.8079 (0.8116) loss_CrossEntropy: 0.0568 (0.0820) time: 6.0499 data: 6.0499 max mem: 10288
Epoch: [11] [150/176] eta: 0:03:16 lr: 0.000100 loss: 0.0625 (0.0812) loss_multiDice: 0.8078 (0.8117) loss_CrossEntropy: 0.0625 (0.0812) time: 7.5495 data: 7.5495 max mem: 10288
Epoch: [11] [160/176] eta: 0:01:57 lr: 0.000100 loss: 0.0718 (0.0810) loss_multiDice: 0.7971 (0.8104) loss_CrossEntropy: 0.0718 (0.0810) time: 7.3560 data: 7.3560 max mem: 10288
Epoch: [11] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0804 (0.0807) loss_multiDice: 0.7994 (0.8113) loss_CrossEntropy: 0.0804 (0.0807) time: 7.0049 data: 7.0049 max mem: 10288
Epoch: [11] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0704 (0.0812) loss_multiDice: 0.8222 (0.8112) loss_CrossEntropy: 0.0704 (0.0812) time: 6.9788 data: 6.9788 max mem: 10288
Test: [ 0/75] eta: 0:00:30 loss: 0.2096 (0.2096) loss_multiDice: 0.1405 (0.1405) loss_CrossEntropy: 0.2096 (0.2096) Avg: 0.0351 (0.0351) time: 0.4087 data: 0.3264 max mem: 10288
Test: [10/75] eta: 0:00:29 loss: 0.1957 (0.2053) loss_multiDice: 0.1343 (0.1312) loss_CrossEntropy: 0.1957 (0.2053) Avg: 0.6914 (0.5985) time: 0.4593 data: 0.3665 max mem: 10288
Test: [20/75] eta: 0:00:22 loss: 0.1957 (0.2224) loss_multiDice: 0.1325 (0.1292) loss_CrossEntropy: 0.1957 (0.2224) Avg: 0.6969 (0.6397) time: 0.4152 data: 0.3337 max mem: 10288
Test: [30/75] eta: 0:00:16 loss: 0.1566 (0.1972) loss_multiDice: 0.0914 (0.1127) loss_CrossEntropy: 0.1566 (0.1972) Avg: 0.8491 (0.7075) time: 0.3588 data: 0.3010 max mem: 10288
Test: [40/75] eta: 0:00:11 loss: 0.1128 (0.1720) loss_multiDice: 0.0715 (0.0992) loss_CrossEntropy: 0.1128 (0.1720) Avg: 0.9047 (0.7585) time: 0.3195 data: 0.2490 max mem: 10288
Test: [50/75] eta: 0:00:09 loss: 0.1036 (0.1627) loss_multiDice: 0.0668 (0.0950) loss_CrossEntropy: 0.1036 (0.1627) Avg: 0.8853 (0.7440) time: 0.3975 data: 0.3197 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.1151 (0.1569) loss_multiDice: 0.0870 (0.0940) loss_CrossEntropy: 0.1151 (0.1569) Avg: 0.7884 (0.7527) time: 0.4594 data: 0.3876 max mem: 10288
Test: [70/75] eta: 0:00:02 loss: 0.1579 (0.1652) loss_multiDice: 0.1100 (0.0977) loss_CrossEntropy: 0.1579 (0.1652) Avg: 0.6661 (0.7288) time: 0.4649 data: 0.3634 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.2085 (0.1697) loss_multiDice: 0.1140 (0.0995) loss_CrossEntropy: 0.2085 (0.1697) Avg: 0.6307 (0.7217) time: 0.2657 data: 0.1938 max mem: 10288
Test: Total time: 0:00:28 (0.3767 s / it)
Averaged stats: loss: 0.2085 (0.1697) loss_multiDice: 0.1140 (0.0995) loss_CrossEntropy: 0.2085 (0.1697) Avg: 0.6307 (0.7217)
MSCMR dice score: 0.7216903927425543
Update MSCMR high dice score model!
myops: loss1: 0.9334680438041687 loss1 mix: 0.9669064879417419 invariant mix: -0.8386501669883728
MSCMR: loss3: 0.9024127125740051 loss3 mix: 0.7597247362136841 invariant mix MSCMR: -0.9046512842178345
Epoch: [12] [ 0/176] eta: 0:20:27 lr: 0.000100 loss: 0.0687 (0.0687) loss_multiDice: 0.8337 (0.8337) loss_CrossEntropy: 0.0687 (0.0687) time: 6.9725 data: 6.9725 max mem: 10288
Epoch: [12] [ 10/176] eta: 0:18:09 lr: 0.000100 loss: 0.0967 (0.0843) loss_multiDice: 0.8337 (0.8252) loss_CrossEntropy: 0.0967 (0.0843) time: 6.5633 data: 6.5633 max mem: 10288
Epoch: [12] [ 20/176] eta: 0:17:02 lr: 0.000100 loss: 0.0690 (0.0821) loss_multiDice: 0.8111 (0.8168) loss_CrossEntropy: 0.0690 (0.0821) time: 6.5523 data: 6.5523 max mem: 10288
Epoch: [12] [ 30/176] eta: 0:16:03 lr: 0.000100 loss: 0.0654 (0.0790) loss_multiDice: 0.8097 (0.8176) loss_CrossEntropy: 0.0654 (0.0790) time: 6.6007 data: 6.6007 max mem: 10288
Epoch: [12] [ 40/176] eta: 0:17:32 lr: 0.000100 loss: 0.0688 (0.0783) loss_multiDice: 0.8097 (0.8146) loss_CrossEntropy: 0.0688 (0.0783) time: 7.7354 data: 7.7355 max mem: 10288
Epoch: [12] [ 50/176] eta: 0:12:23 lr: 0.000100 loss: 0.0756 (0.0797) loss_multiDice: 0.8000 (0.8127) loss_CrossEntropy: 0.0756 (0.0797) time: 5.8985 data: 5.8985 max mem: 10288
Epoch: [12] [ 60/176] eta: 0:13:26 lr: 0.000100 loss: 0.0773 (0.0797) loss_multiDice: 0.8030 (0.8117) loss_CrossEntropy: 0.0773 (0.0797) time: 6.9555 data: 6.9555 max mem: 10288
Epoch: [12] [ 70/176] eta: 0:11:29 lr: 0.000100 loss: 0.0631 (0.0772) loss_multiDice: 0.8051 (0.8102) loss_CrossEntropy: 0.0631 (0.0772) time: 6.5094 data: 6.5094 max mem: 10288
Epoch: [12] [ 80/176] eta: 0:10:21 lr: 0.000100 loss: 0.0631 (0.0778) loss_multiDice: 0.8051 (0.8095) loss_CrossEntropy: 0.0631 (0.0778) time: 6.4754 data: 6.4754 max mem: 10288
Epoch: [12] [ 90/176] eta: 0:09:38 lr: 0.000100 loss: 0.0716 (0.0769) loss_multiDice: 0.7986 (0.8094) loss_CrossEntropy: 0.0716 (0.0769) time: 6.7317 data: 6.7317 max mem: 10288
Epoch: [12] [100/176] eta: 0:08:57 lr: 0.000100 loss: 0.0735 (0.0785) loss_multiDice: 0.8219 (0.8118) loss_CrossEntropy: 0.0735 (0.0785) time: 7.0743 data: 7.0743 max mem: 10288
Epoch: [12] [110/176] eta: 0:07:50 lr: 0.000100 loss: 0.0835 (0.0794) loss_multiDice: 0.8296 (0.8128) loss_CrossEntropy: 0.0835 (0.0794) time: 7.1231 data: 7.1231 max mem: 10288
Epoch: [12] [120/176] eta: 0:06:35 lr: 0.000100 loss: 0.0622 (0.0787) loss_multiDice: 0.8025 (0.8118) loss_CrossEntropy: 0.0622 (0.0787) time: 7.0536 data: 7.0536 max mem: 10288
Epoch: [12] [130/176] eta: 0:05:24 lr: 0.000100 loss: 0.0571 (0.0772) loss_multiDice: 0.7991 (0.8109) loss_CrossEntropy: 0.0571 (0.0772) time: 7.0628 data: 7.0628 max mem: 10288
Epoch: [12] [140/176] eta: 0:04:24 lr: 0.000100 loss: 0.0613 (0.0774) loss_multiDice: 0.8093 (0.8110) loss_CrossEntropy: 0.0613 (0.0774) time: 7.3488 data: 7.3488 max mem: 10288
Epoch: [12] [150/176] eta: 0:02:53 lr: 0.000100 loss: 0.0627 (0.0760) loss_multiDice: 0.8137 (0.8104) loss_CrossEntropy: 0.0627 (0.0760) time: 6.6723 data: 6.6723 max mem: 10288
Epoch: [12] [160/176] eta: 0:01:50 lr: 0.000100 loss: 0.0627 (0.0767) loss_multiDice: 0.8135 (0.8110) loss_CrossEntropy: 0.0627 (0.0767) time: 6.9002 data: 6.9002 max mem: 10288
Epoch: [12] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0759 (0.0776) loss_multiDice: 0.8092 (0.8106) loss_CrossEntropy: 0.0759 (0.0776) time: 7.0145 data: 7.0145 max mem: 10288
Epoch: [12] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0745 (0.0772) loss_multiDice: 0.8070 (0.8110) loss_CrossEntropy: 0.0745 (0.0772) time: 7.2212 data: 7.2212 max mem: 10288
Test: [ 0/75] eta: 0:00:02 loss: 0.1687 (0.1687) loss_multiDice: 0.1237 (0.1237) loss_CrossEntropy: 0.1687 (0.1687) Avg: 0.0428 (0.0428) time: 0.0394 data: 0.0169 max mem: 10288
Test: [10/75] eta: 0:00:25 loss: 0.1542 (0.1573) loss_multiDice: 0.1108 (0.1100) loss_CrossEntropy: 0.1542 (0.1573) Avg: 0.7539 (0.6534) time: 0.3928 data: 0.2792 max mem: 10288
Test: [20/75] eta: 0:00:02 loss: 0.1753 (0.1874) loss_multiDice: 0.1092 (0.1075) loss_CrossEntropy: 0.1753 (0.1874) Avg: 0.7557 (0.6884) time: 0.0406 data: 0.0096 max mem: 10288
Test: [30/75] eta: 0:00:18 loss: 0.1963 (0.1815) loss_multiDice: 0.0766 (0.0959) loss_CrossEntropy: 0.1963 (0.1815) Avg: 0.8422 (0.7361) time: 0.4046 data: 0.3091 max mem: 10288
Test: [40/75] eta: 0:00:15 loss: 0.1053 (0.1609) loss_multiDice: 0.0653 (0.0853) loss_CrossEntropy: 0.1053 (0.1609) Avg: 0.8927 (0.7801) time: 0.4372 data: 0.3508 max mem: 10288
Test: [50/75] eta: 0:00:11 loss: 0.0966 (0.1509) loss_multiDice: 0.0613 (0.0810) loss_CrossEntropy: 0.0966 (0.1509) Avg: 0.8981 (0.7649) time: 0.4678 data: 0.3689 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.0939 (0.1412) loss_multiDice: 0.0655 (0.0783) loss_CrossEntropy: 0.0939 (0.1412) Avg: 0.8701 (0.7752) time: 0.4135 data: 0.2897 max mem: 10288
Test: [70/75] eta: 0:00:02 loss: 0.1046 (0.1430) loss_multiDice: 0.0736 (0.0814) loss_CrossEntropy: 0.1046 (0.1430) Avg: 0.8018 (0.7606) time: 0.4194 data: 0.3267 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1317 (0.1474) loss_multiDice: 0.0931 (0.0831) loss_CrossEntropy: 0.1317 (0.1474) Avg: 0.6837 (0.7546) time: 0.3879 data: 0.3045 max mem: 10288
Test: Total time: 0:00:24 (0.3217 s / it)
Averaged stats: loss: 0.1317 (0.1474) loss_multiDice: 0.0931 (0.0831) loss_CrossEntropy: 0.1317 (0.1474) Avg: 0.6837 (0.7546)
MSCMR dice score: 0.7545749484499296
Update MSCMR best model!
Update MSCMR high dice score model!
myops: loss1: 0.914473831653595 loss1 mix: 0.9678010940551758 invariant mix: -0.8414713740348816
MSCMR: loss3: 0.9117539525032043 loss3 mix: 0.8946685194969177 invariant mix MSCMR: -0.9574880599975586
Epoch: [13] [ 0/176] eta: 0:10:40 lr: 0.000100 loss: 0.1181 (0.1181) loss_multiDice: 0.7936 (0.7936) loss_CrossEntropy: 0.1181 (0.1181) time: 3.6384 data: 3.6384 max mem: 10288
Epoch: [13] [ 10/176] eta: 0:15:35 lr: 0.000100 loss: 0.0513 (0.0583) loss_multiDice: 0.7936 (0.7894) loss_CrossEntropy: 0.0513 (0.0583) time: 5.6355 data: 5.6355 max mem: 10288
Epoch: [13] [ 20/176] eta: 0:18:18 lr: 0.000100 loss: 0.0534 (0.0656) loss_multiDice: 0.7913 (0.7970) loss_CrossEntropy: 0.0534 (0.0656) time: 7.0432 data: 7.0432 max mem: 10288
Epoch: [13] [ 30/176] eta: 0:17:15 lr: 0.000100 loss: 0.0749 (0.0670) loss_multiDice: 0.7951 (0.7967) loss_CrossEntropy: 0.0749 (0.0670) time: 7.0918 data: 7.0918 max mem: 10288
Epoch: [13] [ 40/176] eta: 0:15:46 lr: 0.000100 loss: 0.0749 (0.0722) loss_multiDice: 0.8071 (0.8014) loss_CrossEntropy: 0.0749 (0.0722) time: 6.9621 data: 6.9621 max mem: 10288
Epoch: [13] [ 50/176] eta: 0:15:23 lr: 0.000100 loss: 0.0706 (0.0720) loss_multiDice: 0.8102 (0.8019) loss_CrossEntropy: 0.0706 (0.0720) time: 7.3315 data: 7.3315 max mem: 10288
Epoch: [13] [ 60/176] eta: 0:13:42 lr: 0.000100 loss: 0.0672 (0.0745) loss_multiDice: 0.8009 (0.8030) loss_CrossEntropy: 0.0672 (0.0745) time: 7.0944 data: 7.0944 max mem: 10288
Epoch: [13] [ 70/176] eta: 0:12:08 lr: 0.000100 loss: 0.0664 (0.0730) loss_multiDice: 0.8010 (0.8034) loss_CrossEntropy: 0.0664 (0.0730) time: 6.8751 data: 6.8751 max mem: 10288
Epoch: [13] [ 80/176] eta: 0:10:30 lr: 0.000100 loss: 0.0664 (0.0723) loss_multiDice: 0.8067 (0.8042) loss_CrossEntropy: 0.0664 (0.0723) time: 6.5684 data: 6.5684 max mem: 10288
Epoch: [13] [ 90/176] eta: 0:09:28 lr: 0.000100 loss: 0.0722 (0.0740) loss_multiDice: 0.8130 (0.8047) loss_CrossEntropy: 0.0722 (0.0740) time: 6.6079 data: 6.6079 max mem: 10288
Epoch: [13] [100/176] eta: 0:08:32 lr: 0.000100 loss: 0.0768 (0.0749) loss_multiDice: 0.8123 (0.8054) loss_CrossEntropy: 0.0768 (0.0749) time: 6.7425 data: 6.7425 max mem: 10288
Epoch: [13] [110/176] eta: 0:07:58 lr: 0.000100 loss: 0.0849 (0.0758) loss_multiDice: 0.8012 (0.8044) loss_CrossEntropy: 0.0849 (0.0758) time: 7.2450 data: 7.2450 max mem: 10288
Epoch: [13] [120/176] eta: 0:07:13 lr: 0.000100 loss: 0.0722 (0.0752) loss_multiDice: 0.8010 (0.8050) loss_CrossEntropy: 0.0722 (0.0752) time: 7.7448 data: 7.7448 max mem: 10288
Epoch: [13] [130/176] eta: 0:05:02 lr: 0.000100 loss: 0.0691 (0.0750) loss_multiDice: 0.8176 (0.8059) loss_CrossEntropy: 0.0691 (0.0750) time: 6.5744 data: 6.5744 max mem: 10288
Epoch: [13] [140/176] eta: 0:04:33 lr: 0.000100 loss: 0.0605 (0.0742) loss_multiDice: 0.8176 (0.8062) loss_CrossEntropy: 0.0605 (0.0742) time: 7.5874 data: 7.5874 max mem: 10288
Epoch: [13] [150/176] eta: 0:03:23 lr: 0.000100 loss: 0.0569 (0.0749) loss_multiDice: 0.8135 (0.8069) loss_CrossEntropy: 0.0569 (0.0749) time: 7.8309 data: 7.8309 max mem: 10288
Epoch: [13] [160/176] eta: 0:01:41 lr: 0.000100 loss: 0.0815 (0.0760) loss_multiDice: 0.8135 (0.8075) loss_CrossEntropy: 0.0815 (0.0760) time: 6.3607 data: 6.3607 max mem: 10288
Epoch: [13] [170/176] eta: 0:00:37 lr: 0.000100 loss: 0.0765 (0.0755) loss_multiDice: 0.8135 (0.8073) loss_CrossEntropy: 0.0765 (0.0755) time: 6.1984 data: 6.1984 max mem: 10288
Epoch: [13] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0875 (0.0762) loss_multiDice: 0.8135 (0.8073) loss_CrossEntropy: 0.0875 (0.0762) time: 6.5515 data: 6.5515 max mem: 10288
Test: [ 0/75] eta: 0:00:25 loss: 0.1994 (0.1994) loss_multiDice: 0.1352 (0.1352) loss_CrossEntropy: 0.1994 (0.1994) Avg: 0.0365 (0.0365) time: 0.3455 data: 0.2684 max mem: 10288
Test: [10/75] eta: 0:00:22 loss: 0.2022 (0.2001) loss_multiDice: 0.1180 (0.1236) loss_CrossEntropy: 0.2022 (0.2001) Avg: 0.6816 (0.6063) time: 0.3486 data: 0.2792 max mem: 10288
Test: [20/75] eta: 0:00:22 loss: 0.1938 (0.2032) loss_multiDice: 0.1150 (0.1141) loss_CrossEntropy: 0.1938 (0.2032) Avg: 0.7359 (0.6587) time: 0.4177 data: 0.3108 max mem: 10288
Test: [30/75] eta: 0:00:16 loss: 0.1828 (0.1936) loss_multiDice: 0.0743 (0.0992) loss_CrossEntropy: 0.1828 (0.1936) Avg: 0.8306 (0.7137) time: 0.3570 data: 0.2753 max mem: 10288
Test: [40/75] eta: 0:00:13 loss: 0.1120 (0.1719) loss_multiDice: 0.0587 (0.0872) loss_CrossEntropy: 0.1120 (0.1719) Avg: 0.8884 (0.7602) time: 0.3996 data: 0.3453 max mem: 10288
Test: [50/75] eta: 0:00:06 loss: 0.1104 (0.1646) loss_multiDice: 0.0543 (0.0838) loss_CrossEntropy: 0.1104 (0.1646) Avg: 0.8718 (0.7423) time: 0.2743 data: 0.2088 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.1000 (0.1523) loss_multiDice: 0.0655 (0.0801) loss_CrossEntropy: 0.1000 (0.1523) Avg: 0.8392 (0.7574) time: 0.4531 data: 0.3332 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1183 (0.1541) loss_multiDice: 0.0751 (0.0826) loss_CrossEntropy: 0.1183 (0.1541) Avg: 0.7546 (0.7427) time: 0.3138 data: 0.2467 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1457 (0.1598) loss_multiDice: 0.0905 (0.0843) loss_CrossEntropy: 0.1457 (0.1598) Avg: 0.6917 (0.7359) time: 0.3988 data: 0.3222 max mem: 10288
Test: Total time: 0:00:27 (0.3712 s / it)
Averaged stats: loss: 0.1457 (0.1598) loss_multiDice: 0.0905 (0.0843) loss_CrossEntropy: 0.1457 (0.1598) Avg: 0.6917 (0.7359)
MSCMR dice score: 0.7359428997834524
Update MSCMR high dice score model!
myops: loss1: 0.8872022032737732 loss1 mix: 0.9488338828086853 invariant mix: -0.8866102695465088
MSCMR: loss3: 0.8443557024002075 loss3 mix: 0.6790381669998169 invariant mix MSCMR: -0.9290075302124023
Epoch: [14] [ 0/176] eta: 0:20:21 lr: 0.000100 loss: 0.0538 (0.0538) loss_multiDice: 0.7906 (0.7906) loss_CrossEntropy: 0.0538 (0.0538) time: 6.9428 data: 6.9428 max mem: 10288
Epoch: [14] [ 10/176] eta: 0:19:46 lr: 0.000100 loss: 0.0658 (0.0728) loss_multiDice: 0.8066 (0.8106) loss_CrossEntropy: 0.0658 (0.0728) time: 7.1479 data: 7.1479 max mem: 10288
Epoch: [14] [ 20/176] eta: 0:18:55 lr: 0.000100 loss: 0.0658 (0.0728) loss_multiDice: 0.8154 (0.8087) loss_CrossEntropy: 0.0658 (0.0728) time: 7.2783 data: 7.2783 max mem: 10288
Epoch: [14] [ 30/176] eta: 0:18:18 lr: 0.000100 loss: 0.0618 (0.0707) loss_multiDice: 0.8154 (0.8099) loss_CrossEntropy: 0.0618 (0.0707) time: 7.5222 data: 7.5222 max mem: 10288
Epoch: [14] [ 40/176] eta: 0:16:19 lr: 0.000100 loss: 0.0583 (0.0698) loss_multiDice: 0.8103 (0.8117) loss_CrossEntropy: 0.0583 (0.0698) time: 7.2023 data: 7.2023 max mem: 10288
Epoch: [14] [ 50/176] eta: 0:15:01 lr: 0.000100 loss: 0.0798 (0.0731) loss_multiDice: 0.8103 (0.8113) loss_CrossEntropy: 0.0798 (0.0731) time: 7.1511 data: 7.1511 max mem: 10288
Epoch: [14] [ 60/176] eta: 0:14:46 lr: 0.000100 loss: 0.0798 (0.0729) loss_multiDice: 0.8079 (0.8109) loss_CrossEntropy: 0.0798 (0.0729) time: 7.6455 data: 7.6455 max mem: 10288
Epoch: [14] [ 70/176] eta: 0:11:43 lr: 0.000100 loss: 0.0624 (0.0708) loss_multiDice: 0.8043 (0.8109) loss_CrossEntropy: 0.0624 (0.0708) time: 6.6400 data: 6.6400 max mem: 10288
Epoch: [14] [ 80/176] eta: 0:11:32 lr: 0.000100 loss: 0.0625 (0.0718) loss_multiDice: 0.8045 (0.8103) loss_CrossEntropy: 0.0625 (0.0718) time: 7.2121 data: 7.2121 max mem: 10288
Epoch: [14] [ 90/176] eta: 0:05:53 lr: 0.000100 loss: 0.0732 (0.0728) loss_multiDice: 0.8107 (0.8107) loss_CrossEntropy: 0.0732 (0.0728) time: 4.1141 data: 4.1141 max mem: 10288
Epoch: [14] [100/176] eta: 0:08:02 lr: 0.000100 loss: 0.0722 (0.0727) loss_multiDice: 0.8114 (0.8099) loss_CrossEntropy: 0.0722 (0.0727) time: 6.3518 data: 6.3518 max mem: 10288
Epoch: [14] [110/176] eta: 0:07:28 lr: 0.000100 loss: 0.0624 (0.0713) loss_multiDice: 0.8114 (0.8105) loss_CrossEntropy: 0.0624 (0.0713) time: 6.7926 data: 6.7926 max mem: 10288
Epoch: [14] [120/176] eta: 0:06:51 lr: 0.000100 loss: 0.0623 (0.0718) loss_multiDice: 0.8032 (0.8092) loss_CrossEntropy: 0.0623 (0.0718) time: 7.3459 data: 7.3459 max mem: 10288
Epoch: [14] [130/176] eta: 0:05:03 lr: 0.000100 loss: 0.0641 (0.0724) loss_multiDice: 0.7964 (0.8097) loss_CrossEntropy: 0.0641 (0.0724) time: 6.5916 data: 6.5916 max mem: 10288
Epoch: [14] [140/176] eta: 0:04:20 lr: 0.000100 loss: 0.0727 (0.0724) loss_multiDice: 0.8084 (0.8103) loss_CrossEntropy: 0.0727 (0.0724) time: 7.2490 data: 7.2490 max mem: 10288
Epoch: [14] [150/176] eta: 0:03:15 lr: 0.000100 loss: 0.0870 (0.0744) loss_multiDice: 0.8111 (0.8105) loss_CrossEntropy: 0.0870 (0.0744) time: 7.5157 data: 7.5157 max mem: 10288
Epoch: [14] [160/176] eta: 0:01:56 lr: 0.000100 loss: 0.0921 (0.0754) loss_multiDice: 0.8183 (0.8113) loss_CrossEntropy: 0.0921 (0.0754) time: 7.2575 data: 7.2575 max mem: 10288
Epoch: [14] [170/176] eta: 0:00:43 lr: 0.000100 loss: 0.0724 (0.0747) loss_multiDice: 0.8136 (0.8119) loss_CrossEntropy: 0.0724 (0.0747) time: 7.2306 data: 7.2306 max mem: 10288
Epoch: [14] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0675 (0.0747) loss_multiDice: 0.8171 (0.8122) loss_CrossEntropy: 0.0675 (0.0747) time: 7.3986 data: 7.3986 max mem: 10288
Test: [ 0/75] eta: 0:00:30 loss: 0.1920 (0.1920) loss_multiDice: 0.1378 (0.1378) loss_CrossEntropy: 0.1920 (0.1920) Avg: 0.0440 (0.0440) time: 0.4078 data: 0.2750 max mem: 10288
Test: [10/75] eta: 0:00:29 loss: 0.2188 (0.2281) loss_multiDice: 0.1406 (0.1421) loss_CrossEntropy: 0.2188 (0.2281) Avg: 0.6197 (0.5868) time: 0.4481 data: 0.3673 max mem: 10288
Test: [20/75] eta: 0:00:23 loss: 0.2415 (0.2412) loss_multiDice: 0.1308 (0.1312) loss_CrossEntropy: 0.2415 (0.2412) Avg: 0.6869 (0.6343) time: 0.4234 data: 0.3247 max mem: 10288
Test: [30/75] eta: 0:00:21 loss: 0.2477 (0.2345) loss_multiDice: 0.0832 (0.1140) loss_CrossEntropy: 0.2477 (0.2345) Avg: 0.8042 (0.6936) time: 0.4711 data: 0.3828 max mem: 10288
Test: [40/75] eta: 0:00:15 loss: 0.1429 (0.2103) loss_multiDice: 0.0743 (0.1017) loss_CrossEntropy: 0.1429 (0.2103) Avg: 0.8728 (0.7424) time: 0.4376 data: 0.3179 max mem: 10288
Test: [50/75] eta: 0:00:09 loss: 0.1235 (0.1983) loss_multiDice: 0.0728 (0.0963) loss_CrossEntropy: 0.1235 (0.1983) Avg: 0.8720 (0.7278) time: 0.3686 data: 0.2867 max mem: 10288
Test: [60/75] eta: 0:00:05 loss: 0.1124 (0.1853) loss_multiDice: 0.0742 (0.0927) loss_CrossEntropy: 0.1124 (0.1853) Avg: 0.7334 (0.7385) time: 0.3780 data: 0.2905 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1547 (0.1877) loss_multiDice: 0.0964 (0.0965) loss_CrossEntropy: 0.1547 (0.1877) Avg: 0.7088 (0.7207) time: 0.3242 data: 0.2562 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1922 (0.1912) loss_multiDice: 0.1133 (0.0976) loss_CrossEntropy: 0.1922 (0.1912) Avg: 0.6663 (0.7161) time: 0.3219 data: 0.2420 max mem: 10288
Test: Total time: 0:00:29 (0.3881 s / it)
Averaged stats: loss: 0.1922 (0.1912) loss_multiDice: 0.1133 (0.0976) loss_CrossEntropy: 0.1922 (0.1912) Avg: 0.6663 (0.7161)
MSCMR dice score: 0.7160849604507288
Update MSCMR high dice score model!
myops: loss1: 0.8987019658088684 loss1 mix: 0.9343420267105103 invariant mix: -0.9700521230697632
MSCMR: loss3: 0.8505206108093262 loss3 mix: 0.7993327379226685 invariant mix MSCMR: -0.903489887714386
Epoch: [15] [ 0/176] eta: 0:21:04 lr: 0.000100 loss: 0.0899 (0.0899) loss_multiDice: 0.7606 (0.7606) loss_CrossEntropy: 0.0899 (0.0899) time: 7.1851 data: 7.1851 max mem: 10288
Epoch: [15] [ 10/176] eta: 0:20:22 lr: 0.000100 loss: 0.0676 (0.0769) loss_multiDice: 0.7955 (0.8023) loss_CrossEntropy: 0.0676 (0.0769) time: 7.3673 data: 7.3673 max mem: 10288
Epoch: [15] [ 20/176] eta: 0:18:48 lr: 0.000100 loss: 0.0656 (0.0729) loss_multiDice: 0.7921 (0.7939) loss_CrossEntropy: 0.0656 (0.0729) time: 7.2321 data: 7.2321 max mem: 10288
Epoch: [15] [ 30/176] eta: 0:16:44 lr: 0.000100 loss: 0.0621 (0.0709) loss_multiDice: 0.7965 (0.7978) loss_CrossEntropy: 0.0621 (0.0709) time: 6.8805 data: 6.8805 max mem: 10288
Epoch: [15] [ 40/176] eta: 0:16:42 lr: 0.000100 loss: 0.0761 (0.0770) loss_multiDice: 0.8082 (0.7994) loss_CrossEntropy: 0.0761 (0.0770) time: 7.3699 data: 7.3699 max mem: 10288
Epoch: [15] [ 50/176] eta: 0:15:51 lr: 0.000100 loss: 0.0753 (0.0752) loss_multiDice: 0.8044 (0.7995) loss_CrossEntropy: 0.0753 (0.0752) time: 7.5511 data: 7.5511 max mem: 10288
Epoch: [15] [ 60/176] eta: 0:13:03 lr: 0.000100 loss: 0.0511 (0.0719) loss_multiDice: 0.8203 (0.8024) loss_CrossEntropy: 0.0511 (0.0719) time: 6.7560 data: 6.7560 max mem: 10288
Epoch: [15] [ 70/176] eta: 0:13:04 lr: 0.000100 loss: 0.0540 (0.0720) loss_multiDice: 0.8077 (0.8034) loss_CrossEntropy: 0.0540 (0.0720) time: 7.3977 data: 7.3977 max mem: 10288
Epoch: [15] [ 80/176] eta: 0:11:06 lr: 0.000100 loss: 0.0724 (0.0739) loss_multiDice: 0.8077 (0.8054) loss_CrossEntropy: 0.0724 (0.0739) time: 6.9443 data: 6.9443 max mem: 10288
Epoch: [15] [ 90/176] eta: 0:08:28 lr: 0.000100 loss: 0.0831 (0.0755) loss_multiDice: 0.8052 (0.8051) loss_CrossEntropy: 0.0831 (0.0755) time: 5.9151 data: 5.9151 max mem: 10288
Epoch: [15] [100/176] eta: 0:08:23 lr: 0.000100 loss: 0.0663 (0.0743) loss_multiDice: 0.8052 (0.8064) loss_CrossEntropy: 0.0663 (0.0743) time: 6.6227 data: 6.6227 max mem: 10288
Epoch: [15] [110/176] eta: 0:05:11 lr: 0.000100 loss: 0.0697 (0.0747) loss_multiDice: 0.8107 (0.8066) loss_CrossEntropy: 0.0697 (0.0747) time: 4.7264 data: 4.7264 max mem: 10288
Epoch: [15] [120/176] eta: 0:03:35 lr: 0.000100 loss: 0.0762 (0.0744) loss_multiDice: 0.8124 (0.8075) loss_CrossEntropy: 0.0762 (0.0744) time: 3.8399 data: 3.8399 max mem: 10288
Epoch: [15] [130/176] eta: 0:05:03 lr: 0.000100 loss: 0.0660 (0.0740) loss_multiDice: 0.8223 (0.8079) loss_CrossEntropy: 0.0660 (0.0740) time: 6.5960 data: 6.5960 max mem: 10288
Epoch: [15] [140/176] eta: 0:04:21 lr: 0.000100 loss: 0.0787 (0.0763) loss_multiDice: 0.8053 (0.8084) loss_CrossEntropy: 0.0787 (0.0763) time: 7.2684 data: 7.2684 max mem: 10288
Epoch: [15] [150/176] eta: 0:03:17 lr: 0.000100 loss: 0.0941 (0.0777) loss_multiDice: 0.8148 (0.8094) loss_CrossEntropy: 0.0941 (0.0777) time: 7.5990 data: 7.5990 max mem: 10288
Epoch: [15] [160/176] eta: 0:01:55 lr: 0.000100 loss: 0.0713 (0.0787) loss_multiDice: 0.8188 (0.8101) loss_CrossEntropy: 0.0713 (0.0787) time: 7.2377 data: 7.2377 max mem: 10288
Epoch: [15] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0672 (0.0785) loss_multiDice: 0.8114 (0.8099) loss_CrossEntropy: 0.0672 (0.0785) time: 7.1070 data: 7.1070 max mem: 10288
Epoch: [15] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0765 (0.0785) loss_multiDice: 0.8218 (0.8103) loss_CrossEntropy: 0.0765 (0.0785) time: 7.5248 data: 7.5248 max mem: 10288
Test: [ 0/75] eta: 0:00:33 loss: 0.1593 (0.1593) loss_multiDice: 0.1165 (0.1165) loss_CrossEntropy: 0.1593 (0.1593) Avg: 0.0598 (0.0598) time: 0.4513 data: 0.3587 max mem: 10288
Test: [10/75] eta: 0:00:23 loss: 0.1915 (0.2139) loss_multiDice: 0.1365 (0.1315) loss_CrossEntropy: 0.1915 (0.2139) Avg: 0.6148 (0.5834) time: 0.3566 data: 0.2761 max mem: 10288
Test: [20/75] eta: 0:00:16 loss: 0.2378 (0.2573) loss_multiDice: 0.1224 (0.1282) loss_CrossEntropy: 0.2378 (0.2573) Avg: 0.5642 (0.5947) time: 0.2980 data: 0.2125 max mem: 10288
Test: [30/75] eta: 0:00:17 loss: 0.2378 (0.2410) loss_multiDice: 0.0753 (0.1090) loss_CrossEntropy: 0.2378 (0.2410) Avg: 0.7892 (0.6703) time: 0.3989 data: 0.3132 max mem: 10288
Test: [40/75] eta: 0:00:11 loss: 0.1449 (0.2167) loss_multiDice: 0.0612 (0.0967) loss_CrossEntropy: 0.1449 (0.2167) Avg: 0.8668 (0.7199) time: 0.3175 data: 0.2600 max mem: 10288
Test: [50/75] eta: 0:00:09 loss: 0.1210 (0.1977) loss_multiDice: 0.0551 (0.0890) loss_CrossEntropy: 0.1210 (0.1977) Avg: 0.8344 (0.7119) time: 0.3647 data: 0.2765 max mem: 10288
Test: [60/75] eta: 0:00:05 loss: 0.1044 (0.1824) loss_multiDice: 0.0592 (0.0844) loss_CrossEntropy: 0.1044 (0.1824) Avg: 0.7730 (0.7313) time: 0.3905 data: 0.3114 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1285 (0.1821) loss_multiDice: 0.0739 (0.0866) loss_CrossEntropy: 0.1285 (0.1821) Avg: 0.7772 (0.7201) time: 0.3617 data: 0.2725 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1431 (0.1872) loss_multiDice: 0.0908 (0.0881) loss_CrossEntropy: 0.1431 (0.1872) Avg: 0.6649 (0.7151) time: 0.3966 data: 0.2972 max mem: 10288
Test: Total time: 0:00:27 (0.3680 s / it)
Averaged stats: loss: 0.1431 (0.1872) loss_multiDice: 0.0908 (0.0881) loss_CrossEntropy: 0.1431 (0.1872) Avg: 0.6649 (0.7151)
MSCMR dice score: 0.7151228987673919
Update MSCMR high dice score model!
myops: loss1: 0.8828916549682617 loss1 mix: 0.9638108015060425 invariant mix: -0.838975727558136
MSCMR: loss3: 0.7947525978088379 loss3 mix: 0.6490479707717896 invariant mix MSCMR: -0.8975447416305542
Epoch: [16] [ 0/176] eta: 0:11:53 lr: 0.000100 loss: 0.0544 (0.0544) loss_multiDice: 0.7404 (0.7404) loss_CrossEntropy: 0.0544 (0.0544) time: 4.0535 data: 4.0535 max mem: 10288
Epoch: [16] [ 10/176] eta: 0:18:59 lr: 0.000100 loss: 0.0572 (0.0617) loss_multiDice: 0.8089 (0.8112) loss_CrossEntropy: 0.0572 (0.0617) time: 6.8670 data: 6.8670 max mem: 10288
Epoch: [16] [ 20/176] eta: 0:15:22 lr: 0.000100 loss: 0.0596 (0.0652) loss_multiDice: 0.8089 (0.8081) loss_CrossEntropy: 0.0596 (0.0652) time: 5.9118 data: 5.9118 max mem: 10288
Epoch: [16] [ 30/176] eta: 0:16:56 lr: 0.000100 loss: 0.0629 (0.0708) loss_multiDice: 0.8096 (0.8091) loss_CrossEntropy: 0.0629 (0.0708) time: 6.9610 data: 6.9610 max mem: 10288
Epoch: [16] [ 40/176] eta: 0:15:42 lr: 0.000100 loss: 0.0674 (0.0698) loss_multiDice: 0.7942 (0.8013) loss_CrossEntropy: 0.0674 (0.0698) time: 6.9278 data: 6.9278 max mem: 10288
Epoch: [16] [ 50/176] eta: 0:07:50 lr: 0.000100 loss: 0.0717 (0.0732) loss_multiDice: 0.7942 (0.8039) loss_CrossEntropy: 0.0717 (0.0732) time: 3.7307 data: 3.7307 max mem: 10288
Epoch: [16] [ 60/176] eta: 0:14:13 lr: 0.000100 loss: 0.0780 (0.0730) loss_multiDice: 0.7952 (0.8026) loss_CrossEntropy: 0.0780 (0.0730) time: 7.3608 data: 7.3608 max mem: 10288
Epoch: [16] [ 70/176] eta: 0:05:50 lr: 0.000100 loss: 0.0616 (0.0708) loss_multiDice: 0.7928 (0.8032) loss_CrossEntropy: 0.0616 (0.0708) time: 3.3083 data: 3.3083 max mem: 10288
Epoch: [16] [ 80/176] eta: 0:11:33 lr: 0.000100 loss: 0.0626 (0.0714) loss_multiDice: 0.8114 (0.8050) loss_CrossEntropy: 0.0626 (0.0714) time: 7.2276 data: 7.2276 max mem: 10288
Epoch: [16] [ 90/176] eta: 0:09:16 lr: 0.000100 loss: 0.0817 (0.0737) loss_multiDice: 0.8145 (0.8059) loss_CrossEntropy: 0.0817 (0.0737) time: 6.4707 data: 6.4707 max mem: 10288
Epoch: [16] [100/176] eta: 0:09:04 lr: 0.000100 loss: 0.0720 (0.0721) loss_multiDice: 0.8107 (0.8068) loss_CrossEntropy: 0.0720 (0.0721) time: 7.1681 data: 7.1681 max mem: 10288
Epoch: [16] [110/176] eta: 0:07:07 lr: 0.000100 loss: 0.0702 (0.0729) loss_multiDice: 0.8074 (0.8062) loss_CrossEntropy: 0.0702 (0.0729) time: 6.4822 data: 6.4822 max mem: 10288
Epoch: [16] [120/176] eta: 0:05:41 lr: 0.000100 loss: 0.0716 (0.0723) loss_multiDice: 0.8074 (0.8067) loss_CrossEntropy: 0.0716 (0.0723) time: 6.0909 data: 6.0909 max mem: 10288
Epoch: [16] [130/176] eta: 0:05:20 lr: 0.000100 loss: 0.0650 (0.0722) loss_multiDice: 0.8109 (0.8065) loss_CrossEntropy: 0.0650 (0.0722) time: 6.9666 data: 6.9666 max mem: 10288
Epoch: [16] [140/176] eta: 0:03:50 lr: 0.000100 loss: 0.0650 (0.0721) loss_multiDice: 0.8018 (0.8059) loss_CrossEntropy: 0.0650 (0.0721) time: 6.4003 data: 6.4003 max mem: 10288
Epoch: [16] [150/176] eta: 0:02:53 lr: 0.000100 loss: 0.0621 (0.0717) loss_multiDice: 0.8024 (0.8062) loss_CrossEntropy: 0.0621 (0.0717) time: 6.6798 data: 6.6798 max mem: 10288
Epoch: [16] [160/176] eta: 0:01:42 lr: 0.000100 loss: 0.0608 (0.0715) loss_multiDice: 0.8103 (0.8071) loss_CrossEntropy: 0.0608 (0.0715) time: 6.3788 data: 6.3788 max mem: 10288
Epoch: [16] [170/176] eta: 0:00:43 lr: 0.000100 loss: 0.0566 (0.0707) loss_multiDice: 0.8282 (0.8078) loss_CrossEntropy: 0.0566 (0.0707) time: 7.3120 data: 7.3120 max mem: 10288
Epoch: [16] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0566 (0.0707) loss_multiDice: 0.8282 (0.8080) loss_CrossEntropy: 0.0566 (0.0707) time: 7.4341 data: 7.4341 max mem: 10288
Test: [ 0/75] eta: 0:00:35 loss: 0.1784 (0.1784) loss_multiDice: 0.1126 (0.1126) loss_CrossEntropy: 0.1784 (0.1784) Avg: 0.0361 (0.0361) time: 0.4766 data: 0.3767 max mem: 10288
Test: [10/75] eta: 0:00:27 loss: 0.1421 (0.1615) loss_multiDice: 0.1013 (0.0986) loss_CrossEntropy: 0.1421 (0.1615) Avg: 0.7352 (0.6193) time: 0.4173 data: 0.3347 max mem: 10288
Test: [20/75] eta: 0:00:25 loss: 0.1921 (0.2123) loss_multiDice: 0.0927 (0.0957) loss_CrossEntropy: 0.1921 (0.2123) Avg: 0.6961 (0.6473) time: 0.4635 data: 0.3507 max mem: 10288
Test: [30/75] eta: 0:00:15 loss: 0.2642 (0.2267) loss_multiDice: 0.0654 (0.0839) loss_CrossEntropy: 0.2642 (0.2267) Avg: 0.8105 (0.7072) time: 0.3530 data: 0.2570 max mem: 10288
Test: [40/75] eta: 0:00:12 loss: 0.1705 (0.2089) loss_multiDice: 0.0565 (0.0763) loss_CrossEntropy: 0.1705 (0.2089) Avg: 0.8825 (0.7509) time: 0.3552 data: 0.2789 max mem: 10288
Test: [50/75] eta: 0:00:08 loss: 0.1452 (0.1983) loss_multiDice: 0.0523 (0.0724) loss_CrossEntropy: 0.1452 (0.1983) Avg: 0.8541 (0.7328) time: 0.3559 data: 0.2786 max mem: 10288
Test: [60/75] eta: 0:00:05 loss: 0.1337 (0.1863) loss_multiDice: 0.0568 (0.0703) loss_CrossEntropy: 0.1337 (0.1863) Avg: 0.7530 (0.7437) time: 0.3899 data: 0.3220 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1388 (0.1810) loss_multiDice: 0.0680 (0.0718) loss_CrossEntropy: 0.1388 (0.1810) Avg: 0.7573 (0.7332) time: 0.3664 data: 0.2647 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1483 (0.1861) loss_multiDice: 0.0724 (0.0739) loss_CrossEntropy: 0.1483 (0.1861) Avg: 0.6416 (0.7252) time: 0.3704 data: 0.2737 max mem: 10288
Test: Total time: 0:00:28 (0.3836 s / it)
Averaged stats: loss: 0.1483 (0.1861) loss_multiDice: 0.0724 (0.0739) loss_CrossEntropy: 0.1483 (0.1861) Avg: 0.6416 (0.7252)
MSCMR dice score: 0.7252040187021097
Update MSCMR high dice score model!
myops: loss1: 0.8804849982261658 loss1 mix: 0.9983989596366882 invariant mix: -0.8317057490348816
MSCMR: loss3: 0.8974363207817078 loss3 mix: 0.7269591093063354 invariant mix MSCMR: -0.9110138416290283
Epoch: [17] [ 0/176] eta: 0:19:58 lr: 0.000100 loss: 0.0829 (0.0829) loss_multiDice: 0.8145 (0.8145) loss_CrossEntropy: 0.0829 (0.0829) time: 6.8091 data: 6.8091 max mem: 10288
Epoch: [17] [ 10/176] eta: 0:19:19 lr: 0.000100 loss: 0.0788 (0.0795) loss_multiDice: 0.8040 (0.8046) loss_CrossEntropy: 0.0788 (0.0795) time: 6.9829 data: 6.9829 max mem: 10288
Epoch: [17] [ 20/176] eta: 0:17:48 lr: 0.000100 loss: 0.0730 (0.0729) loss_multiDice: 0.8002 (0.8021) loss_CrossEntropy: 0.0730 (0.0729) time: 6.8492 data: 6.8492 max mem: 10288
Epoch: [17] [ 30/176] eta: 0:17:05 lr: 0.000100 loss: 0.0686 (0.0713) loss_multiDice: 0.8213 (0.8090) loss_CrossEntropy: 0.0686 (0.0713) time: 7.0235 data: 7.0235 max mem: 10288
Epoch: [17] [ 40/176] eta: 0:16:23 lr: 0.000100 loss: 0.0516 (0.0713) loss_multiDice: 0.8148 (0.8066) loss_CrossEntropy: 0.0516 (0.0713) time: 7.2346 data: 7.2346 max mem: 10288
Epoch: [17] [ 50/176] eta: 0:14:35 lr: 0.000100 loss: 0.0559 (0.0731) loss_multiDice: 0.8011 (0.8069) loss_CrossEntropy: 0.0559 (0.0731) time: 6.9464 data: 6.9464 max mem: 10288
Epoch: [17] [ 60/176] eta: 0:13:10 lr: 0.000100 loss: 0.0624 (0.0730) loss_multiDice: 0.7999 (0.8039) loss_CrossEntropy: 0.0624 (0.0730) time: 6.8138 data: 6.8138 max mem: 10288
Epoch: [17] [ 70/176] eta: 0:11:07 lr: 0.000100 loss: 0.0624 (0.0734) loss_multiDice: 0.7925 (0.8049) loss_CrossEntropy: 0.0624 (0.0734) time: 6.2992 data: 6.2992 max mem: 10288
Epoch: [17] [ 80/176] eta: 0:09:48 lr: 0.000100 loss: 0.0561 (0.0718) loss_multiDice: 0.8082 (0.8051) loss_CrossEntropy: 0.0561 (0.0718) time: 6.1323 data: 6.1323 max mem: 10288
Epoch: [17] [ 90/176] eta: 0:10:54 lr: 0.000100 loss: 0.0490 (0.0715) loss_multiDice: 0.8111 (0.8068) loss_CrossEntropy: 0.0490 (0.0715) time: 7.6103 data: 7.6103 max mem: 10288
Epoch: [17] [100/176] eta: 0:07:33 lr: 0.000100 loss: 0.0657 (0.0727) loss_multiDice: 0.8319 (0.8096) loss_CrossEntropy: 0.0657 (0.0727) time: 5.9652 data: 5.9652 max mem: 10288
Epoch: [17] [110/176] eta: 0:07:22 lr: 0.000100 loss: 0.0657 (0.0722) loss_multiDice: 0.8317 (0.8102) loss_CrossEntropy: 0.0657 (0.0722) time: 6.7023 data: 6.7023 max mem: 10288
Epoch: [17] [120/176] eta: 0:06:10 lr: 0.000100 loss: 0.0720 (0.0729) loss_multiDice: 0.8165 (0.8099) loss_CrossEntropy: 0.0720 (0.0729) time: 6.6131 data: 6.6131 max mem: 10288
Epoch: [17] [130/176] eta: 0:04:24 lr: 0.000100 loss: 0.0748 (0.0730) loss_multiDice: 0.8100 (0.8096) loss_CrossEntropy: 0.0748 (0.0730) time: 5.7466 data: 5.7466 max mem: 10288
Epoch: [17] [140/176] eta: 0:04:17 lr: 0.000100 loss: 0.0638 (0.0723) loss_multiDice: 0.7940 (0.8083) loss_CrossEntropy: 0.0638 (0.0723) time: 7.1544 data: 7.1544 max mem: 10288
Epoch: [17] [150/176] eta: 0:02:59 lr: 0.000100 loss: 0.0566 (0.0715) loss_multiDice: 0.7920 (0.8082) loss_CrossEntropy: 0.0566 (0.0715) time: 6.9112 data: 6.9112 max mem: 10288
Epoch: [17] [160/176] eta: 0:00:58 lr: 0.000100 loss: 0.0502 (0.0710) loss_multiDice: 0.8077 (0.8082) loss_CrossEntropy: 0.0502 (0.0710) time: 3.6628 data: 3.6628 max mem: 10288
Epoch: [17] [170/176] eta: 0:00:44 lr: 0.000100 loss: 0.0537 (0.0703) loss_multiDice: 0.8079 (0.8086) loss_CrossEntropy: 0.0537 (0.0703) time: 7.3685 data: 7.3685 max mem: 10288
Epoch: [17] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0539 (0.0706) loss_multiDice: 0.8063 (0.8087) loss_CrossEntropy: 0.0539 (0.0706) time: 6.8268 data: 6.8268 max mem: 10288
Test: [ 0/75] eta: 0:00:37 loss: 0.1695 (0.1695) loss_multiDice: 0.1181 (0.1181) loss_CrossEntropy: 0.1695 (0.1695) Avg: 0.0433 (0.0433) time: 0.4976 data: 0.3806 max mem: 10288
Test: [10/75] eta: 0:00:26 loss: 0.1707 (0.1896) loss_multiDice: 0.1243 (0.1227) loss_CrossEntropy: 0.1707 (0.1896) Avg: 0.7030 (0.6229) time: 0.4026 data: 0.3197 max mem: 10288
Test: [20/75] eta: 0:00:23 loss: 0.2028 (0.2067) loss_multiDice: 0.1208 (0.1176) loss_CrossEntropy: 0.2028 (0.2067) Avg: 0.7213 (0.6675) time: 0.4319 data: 0.3281 max mem: 10288
Test: [30/75] eta: 0:00:22 loss: 0.1774 (0.1906) loss_multiDice: 0.0810 (0.0999) loss_CrossEntropy: 0.1774 (0.1906) Avg: 0.8392 (0.7256) time: 0.4951 data: 0.3517 max mem: 10288
Test: [40/75] eta: 0:00:09 loss: 0.1135 (0.1706) loss_multiDice: 0.0515 (0.0877) loss_CrossEntropy: 0.1135 (0.1706) Avg: 0.8967 (0.7700) time: 0.2754 data: 0.1974 max mem: 10288
Test: [50/75] eta: 0:00:08 loss: 0.0988 (0.1604) loss_multiDice: 0.0579 (0.0830) loss_CrossEntropy: 0.0988 (0.1604) Avg: 0.8827 (0.7550) time: 0.3544 data: 0.2858 max mem: 10288
Test: [60/75] eta: 0:00:07 loss: 0.1064 (0.1520) loss_multiDice: 0.0670 (0.0804) loss_CrossEntropy: 0.1064 (0.1520) Avg: 0.8451 (0.7675) time: 0.4732 data: 0.3350 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1436 (0.1566) loss_multiDice: 0.0806 (0.0844) loss_CrossEntropy: 0.1436 (0.1566) Avg: 0.7488 (0.7493) time: 0.3779 data: 0.3053 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1613 (0.1609) loss_multiDice: 0.1040 (0.0862) loss_CrossEntropy: 0.1613 (0.1609) Avg: 0.6912 (0.7433) time: 0.2881 data: 0.2188 max mem: 10288
Test: Total time: 0:00:28 (0.3777 s / it)
Averaged stats: loss: 0.1613 (0.1609) loss_multiDice: 0.1040 (0.0862) loss_CrossEntropy: 0.1613 (0.1609) Avg: 0.6912 (0.7433)
MSCMR dice score: 0.7432707604765892
Update MSCMR high dice score model!
myops: loss1: 0.8742851614952087 loss1 mix: 0.9427320957183838 invariant mix: -0.8372396230697632
MSCMR: loss3: 0.8291062712669373 loss3 mix: 0.7737120389938354 invariant mix MSCMR: -0.9669426083564758
Epoch: [18] [ 0/176] eta: 0:20:03 lr: 0.000100 loss: 0.0345 (0.0345) loss_multiDice: 0.7946 (0.7946) loss_CrossEntropy: 0.0345 (0.0345) time: 6.8364 data: 6.8364 max mem: 10288
Epoch: [18] [ 10/176] eta: 0:19:13 lr: 0.000100 loss: 0.0514 (0.0710) loss_multiDice: 0.8315 (0.8292) loss_CrossEntropy: 0.0514 (0.0710) time: 6.9503 data: 6.9503 max mem: 10288
Epoch: [18] [ 20/176] eta: 0:18:14 lr: 0.000100 loss: 0.0689 (0.0753) loss_multiDice: 0.8136 (0.8171) loss_CrossEntropy: 0.0689 (0.0753) time: 7.0150 data: 7.0150 max mem: 10288
Epoch: [18] [ 30/176] eta: 0:11:57 lr: 0.000100 loss: 0.0787 (0.0771) loss_multiDice: 0.8049 (0.8141) loss_CrossEntropy: 0.0787 (0.0771) time: 4.9138 data: 4.9138 max mem: 10288
Epoch: [18] [ 40/176] eta: 0:13:40 lr: 0.000100 loss: 0.0771 (0.0772) loss_multiDice: 0.8082 (0.8141) loss_CrossEntropy: 0.0771 (0.0772) time: 6.0346 data: 6.0346 max mem: 10288
Epoch: [18] [ 50/176] eta: 0:14:38 lr: 0.000100 loss: 0.0548 (0.0725) loss_multiDice: 0.7940 (0.8103) loss_CrossEntropy: 0.0548 (0.0725) time: 6.9743 data: 6.9743 max mem: 10288
Epoch: [18] [ 60/176] eta: 0:13:17 lr: 0.000100 loss: 0.0581 (0.0746) loss_multiDice: 0.8040 (0.8117) loss_CrossEntropy: 0.0581 (0.0746) time: 6.8776 data: 6.8776 max mem: 10288
Epoch: [18] [ 70/176] eta: 0:12:00 lr: 0.000100 loss: 0.0645 (0.0737) loss_multiDice: 0.8116 (0.8123) loss_CrossEntropy: 0.0645 (0.0737) time: 6.7944 data: 6.7944 max mem: 10288
Epoch: [18] [ 80/176] eta: 0:11:49 lr: 0.000100 loss: 0.0568 (0.0714) loss_multiDice: 0.7998 (0.8114) loss_CrossEntropy: 0.0568 (0.0714) time: 7.3903 data: 7.3903 max mem: 10288
Epoch: [18] [ 90/176] eta: 0:09:55 lr: 0.000100 loss: 0.0557 (0.0706) loss_multiDice: 0.7998 (0.8110) loss_CrossEntropy: 0.0557 (0.0706) time: 6.9190 data: 6.9190 max mem: 10288
Epoch: [18] [100/176] eta: 0:09:01 lr: 0.000100 loss: 0.0559 (0.0700) loss_multiDice: 0.8017 (0.8104) loss_CrossEntropy: 0.0559 (0.0700) time: 7.1206 data: 7.1206 max mem: 10288
Epoch: [18] [110/176] eta: 0:08:24 lr: 0.000100 loss: 0.0559 (0.0696) loss_multiDice: 0.8008 (0.8105) loss_CrossEntropy: 0.0559 (0.0696) time: 7.6423 data: 7.6423 max mem: 10288
Epoch: [18] [120/176] eta: 0:06:28 lr: 0.000100 loss: 0.0620 (0.0693) loss_multiDice: 0.7998 (0.8097) loss_CrossEntropy: 0.0620 (0.0693) time: 6.9324 data: 6.9324 max mem: 10288
Epoch: [18] [130/176] eta: 0:02:06 lr: 0.000100 loss: 0.0717 (0.0702) loss_multiDice: 0.8054 (0.8100) loss_CrossEntropy: 0.0717 (0.0702) time: 2.7564 data: 2.7564 max mem: 10288
Epoch: [18] [140/176] eta: 0:04:01 lr: 0.000100 loss: 0.0913 (0.0725) loss_multiDice: 0.8070 (0.8097) loss_CrossEntropy: 0.0913 (0.0725) time: 6.7192 data: 6.7192 max mem: 10288
Epoch: [18] [150/176] eta: 0:02:56 lr: 0.000100 loss: 0.0784 (0.0723) loss_multiDice: 0.7988 (0.8096) loss_CrossEntropy: 0.0784 (0.0723) time: 6.7837 data: 6.7837 max mem: 10288
Epoch: [18] [160/176] eta: 0:01:57 lr: 0.000100 loss: 0.0725 (0.0731) loss_multiDice: 0.7988 (0.8092) loss_CrossEntropy: 0.0725 (0.0731) time: 7.3242 data: 7.3242 max mem: 10288
Epoch: [18] [170/176] eta: 0:00:44 lr: 0.000100 loss: 0.0744 (0.0735) loss_multiDice: 0.8050 (0.8088) loss_CrossEntropy: 0.0744 (0.0735) time: 7.4997 data: 7.4997 max mem: 10288
Epoch: [18] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0744 (0.0732) loss_multiDice: 0.8112 (0.8089) loss_CrossEntropy: 0.0744 (0.0732) time: 7.8678 data: 7.8679 max mem: 10288
Test: [ 0/75] eta: 0:00:38 loss: 0.1942 (0.1942) loss_multiDice: 0.1406 (0.1406) loss_CrossEntropy: 0.1942 (0.1942) Avg: 0.0441 (0.0441) time: 0.5139 data: 0.3946 max mem: 10288
Test: [10/75] eta: 0:00:26 loss: 0.1942 (0.2183) loss_multiDice: 0.1347 (0.1295) loss_CrossEntropy: 0.1942 (0.2183) Avg: 0.6063 (0.5760) time: 0.4035 data: 0.2967 max mem: 10288
Test: [20/75] eta: 0:00:16 loss: 0.2496 (0.2686) loss_multiDice: 0.1268 (0.1243) loss_CrossEntropy: 0.2496 (0.2686) Avg: 0.6255 (0.6115) time: 0.3001 data: 0.2269 max mem: 10288
Test: [30/75] eta: 0:00:21 loss: 0.2494 (0.2509) loss_multiDice: 0.0798 (0.1085) loss_CrossEntropy: 0.2494 (0.2509) Avg: 0.7991 (0.6817) time: 0.4715 data: 0.3752 max mem: 10288
Test: [40/75] eta: 0:00:14 loss: 0.1558 (0.2249) loss_multiDice: 0.0718 (0.0974) loss_CrossEntropy: 0.1558 (0.2249) Avg: 0.8657 (0.7320) time: 0.4092 data: 0.3188 max mem: 10288
Test: [50/75] eta: 0:00:10 loss: 0.1298 (0.2089) loss_multiDice: 0.0676 (0.0921) loss_CrossEntropy: 0.1298 (0.2089) Avg: 0.8603 (0.7219) time: 0.4317 data: 0.3183 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.1144 (0.1945) loss_multiDice: 0.0713 (0.0890) loss_CrossEntropy: 0.1144 (0.1945) Avg: 0.8186 (0.7398) time: 0.4040 data: 0.3167 max mem: 10288
Test: [70/75] eta: 0:00:02 loss: 0.1374 (0.1940) loss_multiDice: 0.0868 (0.0916) loss_CrossEntropy: 0.1374 (0.1940) Avg: 0.6973 (0.7224) time: 0.4401 data: 0.3435 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1436 (0.2001) loss_multiDice: 0.1018 (0.0937) loss_CrossEntropy: 0.1436 (0.2001) Avg: 0.5820 (0.7144) time: 0.3585 data: 0.2701 max mem: 10288
Test: Total time: 0:00:28 (0.3791 s / it)
Averaged stats: loss: 0.1436 (0.2001) loss_multiDice: 0.1018 (0.0937) loss_CrossEntropy: 0.1436 (0.2001) Avg: 0.5820 (0.7144)
MSCMR dice score: 0.714402437210083
Update MSCMR high dice score model!
myops: loss1: 0.8751587271690369 loss1 mix: 0.9585826992988586 invariant mix: -0.8284505605697632
MSCMR: loss3: 0.8620194792747498 loss3 mix: 0.7532965540885925 invariant mix MSCMR: -0.9436067342758179
Epoch: [19] [ 0/176] eta: 0:20:24 lr: 0.000100 loss: 0.0682 (0.0682) loss_multiDice: 0.7939 (0.7939) loss_CrossEntropy: 0.0682 (0.0682) time: 6.9574 data: 6.9574 max mem: 10288
Epoch: [19] [ 10/176] eta: 0:18:38 lr: 0.000100 loss: 0.0561 (0.0541) loss_multiDice: 0.8109 (0.7985) loss_CrossEntropy: 0.0561 (0.0541) time: 6.7399 data: 6.7399 max mem: 10288
Epoch: [19] [ 20/176] eta: 0:20:14 lr: 0.000100 loss: 0.0531 (0.0667) loss_multiDice: 0.8118 (0.8097) loss_CrossEntropy: 0.0531 (0.0667) time: 7.7849 data: 7.7849 max mem: 10288
Epoch: [19] [ 30/176] eta: 0:18:26 lr: 0.000100 loss: 0.0607 (0.0657) loss_multiDice: 0.8102 (0.8110) loss_CrossEntropy: 0.0607 (0.0657) time: 7.5820 data: 7.5820 max mem: 10288
Epoch: [19] [ 40/176] eta: 0:15:23 lr: 0.000100 loss: 0.0607 (0.0680) loss_multiDice: 0.8117 (0.8129) loss_CrossEntropy: 0.0607 (0.0680) time: 6.7892 data: 6.7892 max mem: 10288
Epoch: [19] [ 50/176] eta: 0:14:31 lr: 0.000100 loss: 0.0614 (0.0681) loss_multiDice: 0.8132 (0.8119) loss_CrossEntropy: 0.0614 (0.0681) time: 6.9150 data: 6.9150 max mem: 10288
Epoch: [19] [ 60/176] eta: 0:13:27 lr: 0.000100 loss: 0.0599 (0.0659) loss_multiDice: 0.8036 (0.8111) loss_CrossEntropy: 0.0599 (0.0659) time: 6.9641 data: 6.9641 max mem: 10288
Epoch: [19] [ 70/176] eta: 0:12:54 lr: 0.000100 loss: 0.0596 (0.0672) loss_multiDice: 0.8036 (0.8130) loss_CrossEntropy: 0.0596 (0.0672) time: 7.3077 data: 7.3077 max mem: 10288
Epoch: [19] [ 80/176] eta: 0:11:27 lr: 0.000100 loss: 0.0692 (0.0685) loss_multiDice: 0.8241 (0.8150) loss_CrossEntropy: 0.0692 (0.0685) time: 7.1601 data: 7.1601 max mem: 10288
Epoch: [19] [ 90/176] eta: 0:10:02 lr: 0.000100 loss: 0.0694 (0.0685) loss_multiDice: 0.8139 (0.8138) loss_CrossEntropy: 0.0694 (0.0685) time: 7.0111 data: 7.0111 max mem: 10288
Epoch: [19] [100/176] eta: 0:09:09 lr: 0.000100 loss: 0.0694 (0.0697) loss_multiDice: 0.8048 (0.8137) loss_CrossEntropy: 0.0694 (0.0697) time: 7.2272 data: 7.2272 max mem: 10288
Epoch: [19] [110/176] eta: 0:07:38 lr: 0.000100 loss: 0.0663 (0.0699) loss_multiDice: 0.8048 (0.8128) loss_CrossEntropy: 0.0663 (0.0699) time: 6.9501 data: 6.9501 max mem: 10288
Epoch: [19] [120/176] eta: 0:06:55 lr: 0.000100 loss: 0.0663 (0.0705) loss_multiDice: 0.8094 (0.8123) loss_CrossEntropy: 0.0663 (0.0705) time: 7.4113 data: 7.4113 max mem: 10288
Epoch: [19] [130/176] eta: 0:05:00 lr: 0.000100 loss: 0.0683 (0.0706) loss_multiDice: 0.8089 (0.8120) loss_CrossEntropy: 0.0683 (0.0706) time: 6.5244 data: 6.5244 max mem: 10288
Epoch: [19] [140/176] eta: 0:04:00 lr: 0.000100 loss: 0.0724 (0.0712) loss_multiDice: 0.8089 (0.8119) loss_CrossEntropy: 0.0724 (0.0712) time: 6.6726 data: 6.6726 max mem: 10288
Epoch: [19] [150/176] eta: 0:02:40 lr: 0.000100 loss: 0.0699 (0.0707) loss_multiDice: 0.8127 (0.8117) loss_CrossEntropy: 0.0699 (0.0707) time: 6.1870 data: 6.1870 max mem: 10288
Epoch: [19] [160/176] eta: 0:01:47 lr: 0.000100 loss: 0.0558 (0.0709) loss_multiDice: 0.8005 (0.8116) loss_CrossEntropy: 0.0558 (0.0709) time: 6.7447 data: 6.7447 max mem: 10288
Epoch: [19] [170/176] eta: 0:00:38 lr: 0.000100 loss: 0.0616 (0.0708) loss_multiDice: 0.8005 (0.8122) loss_CrossEntropy: 0.0616 (0.0708) time: 6.3961 data: 6.3961 max mem: 10288
Epoch: [19] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0632 (0.0711) loss_multiDice: 0.8037 (0.8127) loss_CrossEntropy: 0.0632 (0.0711) time: 6.2278 data: 6.2278 max mem: 10288
Test: [ 0/75] eta: 0:00:25 loss: 0.1311 (0.1311) loss_multiDice: 0.1064 (0.1064) loss_CrossEntropy: 0.1311 (0.1311) Avg: 0.1104 (0.1104) time: 0.3448 data: 0.2557 max mem: 10288
Test: [10/75] eta: 0:00:23 loss: 0.1474 (0.1691) loss_multiDice: 0.1064 (0.1064) loss_CrossEntropy: 0.1474 (0.1691) Avg: 0.6628 (0.6190) time: 0.3600 data: 0.2996 max mem: 10288
Test: [20/75] eta: 0:00:17 loss: 0.1988 (0.2111) loss_multiDice: 0.0975 (0.1056) loss_CrossEntropy: 0.1988 (0.2111) Avg: 0.6628 (0.6524) time: 0.3094 data: 0.2370 max mem: 10288
Test: [30/75] eta: 0:00:21 loss: 0.1988 (0.2019) loss_multiDice: 0.0668 (0.0912) loss_CrossEntropy: 0.1988 (0.2019) Avg: 0.8232 (0.7124) time: 0.4771 data: 0.3736 max mem: 10288
Test: [40/75] eta: 0:00:14 loss: 0.1370 (0.1833) loss_multiDice: 0.0538 (0.0816) loss_CrossEntropy: 0.1370 (0.1833) Avg: 0.8810 (0.7563) time: 0.4163 data: 0.3395 max mem: 10288
Test: [50/75] eta: 0:00:11 loss: 0.1166 (0.1727) loss_multiDice: 0.0532 (0.0772) loss_CrossEntropy: 0.1166 (0.1727) Avg: 0.8787 (0.7394) time: 0.4767 data: 0.3559 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.0920 (0.1573) loss_multiDice: 0.0516 (0.0725) loss_CrossEntropy: 0.0920 (0.1573) Avg: 0.8468 (0.7572) time: 0.4184 data: 0.3260 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.0994 (0.1608) loss_multiDice: 0.0636 (0.0756) loss_CrossEntropy: 0.0994 (0.1608) Avg: 0.7245 (0.7384) time: 0.3818 data: 0.3181 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1394 (0.1703) loss_multiDice: 0.0801 (0.0785) loss_CrossEntropy: 0.1394 (0.1703) Avg: 0.6453 (0.7266) time: 0.3448 data: 0.2715 max mem: 10288
Test: Total time: 0:00:26 (0.3537 s / it)
Averaged stats: loss: 0.1394 (0.1703) loss_multiDice: 0.0801 (0.0785) loss_CrossEntropy: 0.1394 (0.1703) Avg: 0.6453 (0.7266)
MSCMR dice score: 0.7266453997294108
Update MSCMR high dice score model!
myops: loss1: 0.8672232627868652 loss1 mix: 0.9209326505661011 invariant mix: -0.9595248699188232
MSCMR: loss3: 0.8731876611709595 loss3 mix: 0.7192397117614746 invariant mix MSCMR: -0.8937017321586609
Epoch: [20] [ 0/176] eta: 0:19:02 lr: 0.000100 loss: 0.0859 (0.0859) loss_multiDice: 0.7873 (0.7873) loss_CrossEntropy: 0.0859 (0.0859) time: 6.4932 data: 6.4932 max mem: 10288
Epoch: [20] [ 10/176] eta: 0:11:09 lr: 0.000100 loss: 0.0575 (0.0672) loss_multiDice: 0.7910 (0.8030) loss_CrossEntropy: 0.0575 (0.0672) time: 4.0357 data: 4.0357 max mem: 10288
Epoch: [20] [ 20/176] eta: 0:18:59 lr: 0.000100 loss: 0.0575 (0.0660) loss_multiDice: 0.7768 (0.7890) loss_CrossEntropy: 0.0575 (0.0660) time: 7.3034 data: 7.3034 max mem: 10288
Epoch: [20] [ 30/176] eta: 0:16:59 lr: 0.000100 loss: 0.0544 (0.0628) loss_multiDice: 0.7775 (0.7899) loss_CrossEntropy: 0.0544 (0.0628) time: 6.9818 data: 6.9818 max mem: 10288
Epoch: [20] [ 40/176] eta: 0:12:19 lr: 0.000100 loss: 0.0535 (0.0616) loss_multiDice: 0.7903 (0.7908) loss_CrossEntropy: 0.0535 (0.0616) time: 5.4350 data: 5.4350 max mem: 10288
Epoch: [20] [ 50/176] eta: 0:14:19 lr: 0.000100 loss: 0.0563 (0.0617) loss_multiDice: 0.7986 (0.7929) loss_CrossEntropy: 0.0563 (0.0617) time: 6.8218 data: 6.8218 max mem: 10288
Epoch: [20] [ 60/176] eta: 0:12:31 lr: 0.000100 loss: 0.0716 (0.0659) loss_multiDice: 0.8020 (0.7948) loss_CrossEntropy: 0.0716 (0.0659) time: 6.4777 data: 6.4777 max mem: 10288
Epoch: [20] [ 70/176] eta: 0:08:20 lr: 0.000100 loss: 0.0664 (0.0636) loss_multiDice: 0.8039 (0.7969) loss_CrossEntropy: 0.0664 (0.0636) time: 4.7177 data: 4.7177 max mem: 10288
Epoch: [20] [ 80/176] eta: 0:09:58 lr: 0.000100 loss: 0.0472 (0.0654) loss_multiDice: 0.8172 (0.7994) loss_CrossEntropy: 0.0472 (0.0654) time: 6.2337 data: 6.2337 max mem: 10288
Epoch: [20] [ 90/176] eta: 0:09:53 lr: 0.000100 loss: 0.0644 (0.0645) loss_multiDice: 0.8175 (0.7994) loss_CrossEntropy: 0.0644 (0.0645) time: 6.9004 data: 6.9004 max mem: 10288
Epoch: [20] [100/176] eta: 0:08:59 lr: 0.000100 loss: 0.0591 (0.0645) loss_multiDice: 0.7899 (0.7997) loss_CrossEntropy: 0.0591 (0.0645) time: 7.0995 data: 7.0995 max mem: 10288
Epoch: [20] [110/176] eta: 0:03:21 lr: 0.000100 loss: 0.0606 (0.0659) loss_multiDice: 0.8256 (0.8033) loss_CrossEntropy: 0.0606 (0.0659) time: 3.0557 data: 3.0557 max mem: 10288
Epoch: [20] [120/176] eta: 0:06:22 lr: 0.000100 loss: 0.0823 (0.0675) loss_multiDice: 0.8297 (0.8045) loss_CrossEntropy: 0.0823 (0.0675) time: 6.8273 data: 6.8273 max mem: 10288
Epoch: [20] [130/176] eta: 0:03:25 lr: 0.000100 loss: 0.0768 (0.0666) loss_multiDice: 0.8133 (0.8055) loss_CrossEntropy: 0.0768 (0.0666) time: 4.4696 data: 4.4696 max mem: 10288
Epoch: [20] [140/176] eta: 0:03:40 lr: 0.000100 loss: 0.0496 (0.0661) loss_multiDice: 0.7962 (0.8051) loss_CrossEntropy: 0.0496 (0.0661) time: 6.1199 data: 6.1199 max mem: 10288
Epoch: [20] [150/176] eta: 0:03:12 lr: 0.000100 loss: 0.0555 (0.0662) loss_multiDice: 0.8013 (0.8057) loss_CrossEntropy: 0.0555 (0.0662) time: 7.4014 data: 7.4014 max mem: 10288
Epoch: [20] [160/176] eta: 0:01:33 lr: 0.000100 loss: 0.0590 (0.0658) loss_multiDice: 0.8072 (0.8061) loss_CrossEntropy: 0.0590 (0.0658) time: 5.8151 data: 5.8151 max mem: 10288
Epoch: [20] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0567 (0.0658) loss_multiDice: 0.8072 (0.8065) loss_CrossEntropy: 0.0567 (0.0658) time: 7.0142 data: 7.0142 max mem: 10288
Epoch: [20] [175/176] eta: 0:00:07 lr: 0.000100 loss: 0.0584 (0.0657) loss_multiDice: 0.7957 (0.8062) loss_CrossEntropy: 0.0584 (0.0657) time: 7.1062 data: 7.1062 max mem: 10288
Test: [ 0/75] eta: 0:00:26 loss: 0.1884 (0.1884) loss_multiDice: 0.1291 (0.1291) loss_CrossEntropy: 0.1884 (0.1884) Avg: 0.0377 (0.0377) time: 0.3524 data: 0.2767 max mem: 10288
Test: [10/75] eta: 0:00:20 loss: 0.1884 (0.2128) loss_multiDice: 0.1245 (0.1191) loss_CrossEntropy: 0.1884 (0.2128) Avg: 0.6068 (0.5576) time: 0.3180 data: 0.2505 max mem: 10288
Test: [20/75] eta: 0:00:18 loss: 0.2511 (0.2635) loss_multiDice: 0.1221 (0.1187) loss_CrossEntropy: 0.2511 (0.2635) Avg: 0.6122 (0.5852) time: 0.3388 data: 0.2497 max mem: 10288
Test: [30/75] eta: 0:00:16 loss: 0.2174 (0.2393) loss_multiDice: 0.0764 (0.1001) loss_CrossEntropy: 0.2174 (0.2393) Avg: 0.6697 (0.6618) time: 0.3645 data: 0.2823 max mem: 10288
Test: [40/75] eta: 0:00:15 loss: 0.1499 (0.2138) loss_multiDice: 0.0557 (0.0885) loss_CrossEntropy: 0.1499 (0.2138) Avg: 0.8803 (0.7188) time: 0.4484 data: 0.3558 max mem: 10288
Test: [50/75] eta: 0:00:09 loss: 0.1193 (0.1975) loss_multiDice: 0.0548 (0.0833) loss_CrossEntropy: 0.1193 (0.1975) Avg: 0.8795 (0.7128) time: 0.4000 data: 0.3163 max mem: 10288
Test: [60/75] eta: 0:00:04 loss: 0.0867 (0.1783) loss_multiDice: 0.0502 (0.0774) loss_CrossEntropy: 0.0867 (0.1783) Avg: 0.8397 (0.7339) time: 0.3206 data: 0.2349 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.0937 (0.1766) loss_multiDice: 0.0657 (0.0794) loss_CrossEntropy: 0.0937 (0.1766) Avg: 0.7686 (0.7196) time: 0.3555 data: 0.2791 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1395 (0.1831) loss_multiDice: 0.0856 (0.0813) loss_CrossEntropy: 0.1395 (0.1831) Avg: 0.6283 (0.7123) time: 0.4414 data: 0.3472 max mem: 10288
Test: Total time: 0:00:29 (0.3904 s / it)
Averaged stats: loss: 0.1395 (0.1831) loss_multiDice: 0.0856 (0.0813) loss_CrossEntropy: 0.1395 (0.1831) Avg: 0.6283 (0.7123)
MSCMR dice score: 0.7123340953886509
Update MSCMR high dice score model!
myops: loss1: 0.8785661458969116 loss1 mix: 0.9168150424957275 invariant mix: -0.9594184160232544
MSCMR: loss3: 1.0786367654800415 loss3 mix: 1.1093114614486694 invariant mix MSCMR: -0.9410040378570557
Epoch: [21] [ 0/176] eta: 0:20:08 lr: 0.000100 loss: 0.2410 (0.2410) loss_multiDice: 0.8376 (0.8376) loss_CrossEntropy: 0.2410 (0.2410) time: 6.8670 data: 6.8670 max mem: 10288
Epoch: [21] [ 10/176] eta: 0:19:17 lr: 0.000100 loss: 0.0937 (0.0982) loss_multiDice: 0.7912 (0.8024) loss_CrossEntropy: 0.0937 (0.0982) time: 6.9733 data: 6.9733 max mem: 10288
Epoch: [21] [ 20/176] eta: 0:16:14 lr: 0.000100 loss: 0.0694 (0.0856) loss_multiDice: 0.7930 (0.7997) loss_CrossEntropy: 0.0694 (0.0856) time: 6.2460 data: 6.2460 max mem: 10288
Epoch: [21] [ 30/176] eta: 0:17:16 lr: 0.000100 loss: 0.0694 (0.0842) loss_multiDice: 0.7977 (0.8030) loss_CrossEntropy: 0.0694 (0.0842) time: 7.0962 data: 7.0962 max mem: 10288
Epoch: [21] [ 40/176] eta: 0:16:15 lr: 0.000100 loss: 0.0729 (0.0814) loss_multiDice: 0.7957 (0.8046) loss_CrossEntropy: 0.0729 (0.0814) time: 7.1742 data: 7.1742 max mem: 10288
Epoch: [21] [ 50/176] eta: 0:11:49 lr: 0.000100 loss: 0.0729 (0.0798) loss_multiDice: 0.8255 (0.8111) loss_CrossEntropy: 0.0729 (0.0798) time: 5.6333 data: 5.6333 max mem: 10288
Epoch: [21] [ 60/176] eta: 0:14:47 lr: 0.000100 loss: 0.0751 (0.0801) loss_multiDice: 0.8160 (0.8103) loss_CrossEntropy: 0.0751 (0.0801) time: 7.6501 data: 7.6501 max mem: 10288
Epoch: [21] [ 70/176] eta: 0:12:34 lr: 0.000100 loss: 0.0739 (0.0801) loss_multiDice: 0.8128 (0.8125) loss_CrossEntropy: 0.0739 (0.0801) time: 7.1139 data: 7.1139 max mem: 10288
Epoch: [21] [ 80/176] eta: 0:07:43 lr: 0.000100 loss: 0.0677 (0.0776) loss_multiDice: 0.8103 (0.8111) loss_CrossEntropy: 0.0677 (0.0776) time: 4.8268 data: 4.8268 max mem: 10288
Epoch: [21] [ 90/176] eta: 0:10:13 lr: 0.000100 loss: 0.0533 (0.0754) loss_multiDice: 0.8031 (0.8099) loss_CrossEntropy: 0.0533 (0.0754) time: 7.1316 data: 7.1316 max mem: 10288
Epoch: [21] [100/176] eta: 0:08:22 lr: 0.000100 loss: 0.0486 (0.0744) loss_multiDice: 0.8147 (0.8104) loss_CrossEntropy: 0.0486 (0.0744) time: 6.6074 data: 6.6074 max mem: 10288
Epoch: [21] [110/176] eta: 0:07:45 lr: 0.000100 loss: 0.0599 (0.0749) loss_multiDice: 0.7984 (0.8091) loss_CrossEntropy: 0.0599 (0.0749) time: 7.0491 data: 7.0491 max mem: 10288
Epoch: [21] [120/176] eta: 0:05:48 lr: 0.000100 loss: 0.0623 (0.0751) loss_multiDice: 0.8058 (0.8098) loss_CrossEntropy: 0.0623 (0.0751) time: 6.2155 data: 6.2155 max mem: 10288
Epoch: [21] [130/176] eta: 0:05:30 lr: 0.000100 loss: 0.0518 (0.0728) loss_multiDice: 0.8068 (0.8096) loss_CrossEntropy: 0.0518 (0.0728) time: 7.1783 data: 7.1783 max mem: 10288
Epoch: [21] [140/176] eta: 0:04:03 lr: 0.000100 loss: 0.0594 (0.0732) loss_multiDice: 0.8055 (0.8089) loss_CrossEntropy: 0.0594 (0.0732) time: 6.7599 data: 6.7599 max mem: 10288
Epoch: [21] [150/176] eta: 0:02:40 lr: 0.000100 loss: 0.0718 (0.0728) loss_multiDice: 0.8040 (0.8085) loss_CrossEntropy: 0.0718 (0.0728) time: 6.1812 data: 6.1812 max mem: 10288
Epoch: [21] [160/176] eta: 0:01:17 lr: 0.000100 loss: 0.0776 (0.0749) loss_multiDice: 0.8173 (0.8100) loss_CrossEntropy: 0.0776 (0.0749) time: 4.8330 data: 4.8330 max mem: 10288
Epoch: [21] [170/176] eta: 0:00:36 lr: 0.000100 loss: 0.0889 (0.0751) loss_multiDice: 0.8138 (0.8102) loss_CrossEntropy: 0.0889 (0.0751) time: 6.1346 data: 6.1346 max mem: 10288
Epoch: [21] [175/176] eta: 0:00:03 lr: 0.000100 loss: 0.0778 (0.0753) loss_multiDice: 0.8131 (0.8103) loss_CrossEntropy: 0.0778 (0.0753) time: 3.1157 data: 3.1157 max mem: 10288
Test: [ 0/75] eta: 0:00:20 loss: 0.1330 (0.1330) loss_multiDice: 0.1057 (0.1057) loss_CrossEntropy: 0.1330 (0.1330) Avg: 0.0685 (0.0685) time: 0.2714 data: 0.2157 max mem: 10288
Test: [10/75] eta: 0:00:19 loss: 0.1548 (0.1791) loss_multiDice: 0.1057 (0.1083) loss_CrossEntropy: 0.1548 (0.1791) Avg: 0.6933 (0.6221) time: 0.2953 data: 0.2290 max mem: 10288
Test: [20/75] eta: 0:00:26 loss: 0.2209 (0.2214) loss_multiDice: 0.1056 (0.1101) loss_CrossEntropy: 0.2209 (0.2214) Avg: 0.6557 (0.6317) time: 0.4815 data: 0.3556 max mem: 10288
Test: [30/75] eta: 0:00:17 loss: 0.2395 (0.2156) loss_multiDice: 0.0722 (0.0955) loss_CrossEntropy: 0.2395 (0.2156) Avg: 0.7895 (0.6932) time: 0.3818 data: 0.3197 max mem: 10288
Test: [40/75] eta: 0:00:16 loss: 0.1448 (0.1968) loss_multiDice: 0.0589 (0.0850) loss_CrossEntropy: 0.1448 (0.1968) Avg: 0.8737 (0.7390) time: 0.4621 data: 0.3513 max mem: 10288
Test: [50/75] eta: 0:00:08 loss: 0.1329 (0.1827) loss_multiDice: 0.0576 (0.0798) loss_CrossEntropy: 0.1329 (0.1827) Avg: 0.8691 (0.7267) time: 0.3469 data: 0.2684 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.0978 (0.1677) loss_multiDice: 0.0538 (0.0751) loss_CrossEntropy: 0.0978 (0.1677) Avg: 0.8179 (0.7454) time: 0.4561 data: 0.3505 max mem: 10288
Test: [70/75] eta: 0:00:01 loss: 0.1072 (0.1665) loss_multiDice: 0.0633 (0.0767) loss_CrossEntropy: 0.1072 (0.1665) Avg: 0.7561 (0.7324) time: 0.2789 data: 0.2182 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1238 (0.1711) loss_multiDice: 0.0725 (0.0786) loss_CrossEntropy: 0.1238 (0.1711) Avg: 0.6963 (0.7254) time: 0.4120 data: 0.3196 max mem: 10288
Test: Total time: 0:00:25 (0.3460 s / it)
Averaged stats: loss: 0.1238 (0.1711) loss_multiDice: 0.0725 (0.0786) loss_CrossEntropy: 0.1238 (0.1711) Avg: 0.6963 (0.7254)
MSCMR dice score: 0.7253749716281891
Update MSCMR high dice score model!
myops: loss1: 0.8759168982505798 loss1 mix: 0.9281623363494873 invariant mix: -0.8573111891746521
MSCMR: loss3: 0.8714005947113037 loss3 mix: 0.6625685691833496 invariant mix MSCMR: -0.9123915433883667
Epoch: [22] [ 0/176] eta: 0:17:58 lr: 0.000100 loss: 0.0398 (0.0398) loss_multiDice: 0.8316 (0.8316) loss_CrossEntropy: 0.0398 (0.0398) time: 6.1266 data: 6.1266 max mem: 10288
Epoch: [22] [ 10/176] eta: 0:19:04 lr: 0.000100 loss: 0.0709 (0.0721) loss_multiDice: 0.8225 (0.8160) loss_CrossEntropy: 0.0709 (0.0721) time: 6.8941 data: 6.8941 max mem: 10288
Epoch: [22] [ 20/176] eta: 0:19:30 lr: 0.000100 loss: 0.0709 (0.0776) loss_multiDice: 0.8222 (0.8176) loss_CrossEntropy: 0.0709 (0.0776) time: 7.5052 data: 7.5052 max mem: 10288
Epoch: [22] [ 30/176] eta: 0:17:28 lr: 0.000100 loss: 0.0709 (0.0751) loss_multiDice: 0.8250 (0.8157) loss_CrossEntropy: 0.0709 (0.0751) time: 7.1794 data: 7.1794 max mem: 10288
Epoch: [22] [ 40/176] eta: 0:13:50 lr: 0.000100 loss: 0.0573 (0.0727) loss_multiDice: 0.8250 (0.8156) loss_CrossEntropy: 0.0573 (0.0727) time: 6.1077 data: 6.1077 max mem: 10288
Epoch: [22] [ 50/176] eta: 0:11:41 lr: 0.000100 loss: 0.0604 (0.0738) loss_multiDice: 0.8067 (0.8125) loss_CrossEntropy: 0.0604 (0.0738) time: 5.5645 data: 5.5645 max mem: 10288
Epoch: [22] [ 60/176] eta: 0:14:06 lr: 0.000100 loss: 0.0619 (0.0722) loss_multiDice: 0.7949 (0.8111) loss_CrossEntropy: 0.0619 (0.0722) time: 7.2993 data: 7.2993 max mem: 10288
Epoch: [22] [ 70/176] eta: 0:10:46 lr: 0.000100 loss: 0.0539 (0.0712) loss_multiDice: 0.7954 (0.8109) loss_CrossEntropy: 0.0539 (0.0712) time: 6.0965 data: 6.0965 max mem: 10288
Epoch: [22] [ 80/176] eta: 0:11:30 lr: 0.000100 loss: 0.0488 (0.0692) loss_multiDice: 0.7941 (0.8084) loss_CrossEntropy: 0.0488 (0.0692) time: 7.1955 data: 7.1955 max mem: 10288
Epoch: [22] [ 90/176] eta: 0:10:18 lr: 0.000100 loss: 0.0546 (0.0693) loss_multiDice: 0.7860 (0.8067) loss_CrossEntropy: 0.0546 (0.0693) time: 7.1911 data: 7.1911 max mem: 10288
Epoch: [22] [100/176] eta: 0:09:20 lr: 0.000100 loss: 0.0582 (0.0680) loss_multiDice: 0.7921 (0.8064) loss_CrossEntropy: 0.0582 (0.0680) time: 7.3796 data: 7.3796 max mem: 10288
Epoch: [22] [110/176] eta: 0:07:28 lr: 0.000100 loss: 0.0556 (0.0686) loss_multiDice: 0.8238 (0.8081) loss_CrossEntropy: 0.0556 (0.0686) time: 6.8009 data: 6.8009 max mem: 10288
Epoch: [22] [120/176] eta: 0:03:25 lr: 0.000100 loss: 0.0657 (0.0690) loss_multiDice: 0.8238 (0.8075) loss_CrossEntropy: 0.0657 (0.0690) time: 3.6713 data: 3.6713 max mem: 10288
Epoch: [22] [130/176] eta: 0:05:03 lr: 0.000100 loss: 0.0654 (0.0696) loss_multiDice: 0.7987 (0.8069) loss_CrossEntropy: 0.0654 (0.0696) time: 6.5883 data: 6.5883 max mem: 10288
Epoch: [22] [140/176] eta: 0:04:06 lr: 0.000100 loss: 0.0654 (0.0699) loss_multiDice: 0.7974 (0.8059) loss_CrossEntropy: 0.0654 (0.0699) time: 6.8455 data: 6.8455 max mem: 10288
Epoch: [22] [150/176] eta: 0:02:11 lr: 0.000100 loss: 0.0580 (0.0692) loss_multiDice: 0.8003 (0.8064) loss_CrossEntropy: 0.0580 (0.0692) time: 5.0459 data: 5.0459 max mem: 10288
Epoch: [22] [160/176] eta: 0:01:52 lr: 0.000100 loss: 0.0549 (0.0682) loss_multiDice: 0.8066 (0.8058) loss_CrossEntropy: 0.0549 (0.0682) time: 7.0422 data: 7.0422 max mem: 10288
Epoch: [22] [170/176] eta: 0:00:40 lr: 0.000100 loss: 0.0555 (0.0689) loss_multiDice: 0.8010 (0.8060) loss_CrossEntropy: 0.0555 (0.0689) time: 6.6951 data: 6.6951 max mem: 10288
Epoch: [22] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0555 (0.0684) loss_multiDice: 0.8053 (0.8061) loss_CrossEntropy: 0.0555 (0.0684) time: 6.8799 data: 6.8799 max mem: 10288
Test: [ 0/75] eta: 0:00:24 loss: 0.2911 (0.2911) loss_multiDice: 0.1692 (0.1692) loss_CrossEntropy: 0.2911 (0.2911) Avg: 0.0296 (0.0296) time: 0.3277 data: 0.2346 max mem: 10288
Test: [10/75] eta: 0:00:28 loss: 0.2841 (0.3091) loss_multiDice: 0.1612 (0.1595) loss_CrossEntropy: 0.2841 (0.3091) Avg: 0.4974 (0.4913) time: 0.4358 data: 0.3715 max mem: 10288
Test: [20/75] eta: 0:00:15 loss: 0.2733 (0.2716) loss_multiDice: 0.1366 (0.1362) loss_CrossEntropy: 0.2733 (0.2716) Avg: 0.6140 (0.5857) time: 0.2754 data: 0.2120 max mem: 10288
Test: [30/75] eta: 0:00:16 loss: 0.2034 (0.2492) loss_multiDice: 0.0846 (0.1174) loss_CrossEntropy: 0.2034 (0.2492) Avg: 0.8009 (0.6567) time: 0.3695 data: 0.3106 max mem: 10288
Test: [40/75] eta: 0:00:11 loss: 0.1489 (0.2224) loss_multiDice: 0.0697 (0.1040) loss_CrossEntropy: 0.1489 (0.2224) Avg: 0.8782 (0.7103) time: 0.3365 data: 0.2608 max mem: 10288
Test: [50/75] eta: 0:00:09 loss: 0.1415 (0.2082) loss_multiDice: 0.0662 (0.0988) loss_CrossEntropy: 0.1415 (0.2082) Avg: 0.8153 (0.6996) time: 0.3631 data: 0.2709 max mem: 10288
Test: [60/75] eta: 0:00:06 loss: 0.1286 (0.1947) loss_multiDice: 0.0776 (0.0947) loss_CrossEntropy: 0.1286 (0.1947) Avg: 0.7714 (0.7155) time: 0.4313 data: 0.3073 max mem: 10288
Test: [70/75] eta: 0:00:02 loss: 0.1683 (0.1962) loss_multiDice: 0.0882 (0.0961) loss_CrossEntropy: 0.1683 (0.1962) Avg: 0.7420 (0.6989) time: 0.4508 data: 0.3637 max mem: 10288
Test: [74/75] eta: 0:00:00 loss: 0.1764 (0.1983) loss_multiDice: 0.0970 (0.0965) loss_CrossEntropy: 0.1764 (0.1983) Avg: 0.7031 (0.6959) time: 0.4852 data: 0.3883 max mem: 10288
Test: Total time: 0:00:27 (0.3714 s / it)
Averaged stats: loss: 0.1764 (0.1983) loss_multiDice: 0.0970 (0.0965) loss_CrossEntropy: 0.1764 (0.1983) Avg: 0.7031 (0.6959)
MSCMR dice score: 0.6959408215433359
myops: loss1: 0.8652104139328003 loss1 mix: 0.9099226593971252 invariant mix: -0.9276258945465088
MSCMR: loss3: 0.7880746722221375 loss3 mix: 0.6670785546302795 invariant mix MSCMR: -0.8914701342582703
Epoch: [23] [ 0/176] eta: 0:20:10 lr: 0.000100 loss: 0.0453 (0.0453) loss_multiDice: 0.7428 (0.7428) loss_CrossEntropy: 0.0453 (0.0453) time: 6.8804 data: 6.8804 max mem: 10288
Epoch: [23] [ 10/176] eta: 0:19:15 lr: 0.000100 loss: 0.0628 (0.0684) loss_multiDice: 0.8312 (0.8237) loss_CrossEntropy: 0.0628 (0.0684) time: 6.9580 data: 6.9580 max mem: 10288
Epoch: [23] [ 20/176] eta: 0:19:25 lr: 0.000100 loss: 0.0628 (0.0721) loss_multiDice: 0.8312 (0.8216) loss_CrossEntropy: 0.0628 (0.0721) time: 7.4720 data: 7.4720 max mem: 10288
Epoch: [23] [ 30/176] eta: 0:14:58 lr: 0.000100 loss: 0.0562 (0.0689) loss_multiDice: 0.8117 (0.8156) loss_CrossEntropy: 0.0562 (0.0689) time: 6.1531 data: 6.1531 max mem: 10288
Epoch: [23] [ 40/176] eta: 0:12:24 lr: 0.000100 loss: 0.0620 (0.0693) loss_multiDice: 0.7906 (0.8078) loss_CrossEntropy: 0.0620 (0.0693) time: 5.4719 data: 5.4719 max mem: 10289
Epoch: [23] [ 50/176] eta: 0:14:12 lr: 0.000100 loss: 0.0622 (0.0677) loss_multiDice: 0.7886 (0.8076) loss_CrossEntropy: 0.0622 (0.0677) time: 6.7652 data: 6.7652 max mem: 10289
Epoch: [23] [ 60/176] eta: 0:14:10 lr: 0.000100 loss: 0.0622 (0.0676) loss_multiDice: 0.7962 (0.8059) loss_CrossEntropy: 0.0622 (0.0676) time: 7.3311 data: 7.3311 max mem: 10289
Epoch: [23] [ 70/176] eta: 0:12:03 lr: 0.000100 loss: 0.0584 (0.0669) loss_multiDice: 0.7907 (0.8050) loss_CrossEntropy: 0.0584 (0.0669) time: 6.8288 data: 6.8288 max mem: 10289
Epoch: [23] [ 80/176] eta: 0:12:21 lr: 0.000100 loss: 0.0489 (0.0651) loss_multiDice: 0.8019 (0.8066) loss_CrossEntropy: 0.0489 (0.0651) time: 7.7211 data: 7.7211 max mem: 10289
Epoch: [23] [ 90/176] eta: 0:09:49 lr: 0.000100 loss: 0.0548 (0.0659) loss_multiDice: 0.8186 (0.8066) loss_CrossEntropy: 0.0548 (0.0659) time: 6.8508 data: 6.8508 max mem: 10289
Epoch: [23] [100/176] eta: 0:08:23 lr: 0.000100 loss: 0.0647 (0.0651) loss_multiDice: 0.8164 (0.8072) loss_CrossEntropy: 0.0647 (0.0651) time: 6.6299 data: 6.6299 max mem: 10289
Epoch: [23] [110/176] eta: 0:08:01 lr: 0.000100 loss: 0.0500 (0.0644) loss_multiDice: 0.8100 (0.8079) loss_CrossEntropy: 0.0500 (0.0644) time: 7.2883 data: 7.2883 max mem: 10289
Epoch: [23] [120/176] eta: 0:06:00 lr: 0.000100 loss: 0.0534 (0.0661) loss_multiDice: 0.8056 (0.8085) loss_CrossEntropy: 0.0534 (0.0661) time: 6.4439 data: 6.4439 max mem: 10289
Epoch: [23] [130/176] eta: 0:05:17 lr: 0.000100 loss: 0.0582 (0.0661) loss_multiDice: 0.8072 (0.8078) loss_CrossEntropy: 0.0582 (0.0661) time: 6.8997 data: 6.8997 max mem: 10289
Epoch: [23] [140/176] eta: 0:04:13 lr: 0.000100 loss: 0.0557 (0.0654) loss_multiDice: 0.8031 (0.8075) loss_CrossEntropy: 0.0557 (0.0654) time: 7.0316 data: 7.0316 max mem: 10289
Epoch: [23] [150/176] eta: 0:02:58 lr: 0.000100 loss: 0.0465 (0.0650) loss_multiDice: 0.8006 (0.8079) loss_CrossEntropy: 0.0465 (0.0650) time: 6.8679 data: 6.8679 max mem: 10289
Epoch: [23] [160/176] eta: 0:01:57 lr: 0.000100 loss: 0.0581 (0.0645) loss_multiDice: 0.8154 (0.8080) loss_CrossEntropy: 0.0581 (0.0645) time: 7.3368 data: 7.3368 max mem: 10289
Epoch: [23] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0604 (0.0644) loss_multiDice: 0.8077 (0.8079) loss_CrossEntropy: 0.0604 (0.0644) time: 7.0105 data: 7.0105 max mem: 10289
Epoch: [23] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0604 (0.0646) loss_multiDice: 0.8003 (0.8078) loss_CrossEntropy: 0.0604 (0.0646) time: 6.5874 data: 6.5874 max mem: 10289
Test: [ 0/75] eta: 0:00:32 loss: 0.1552 (0.1552) loss_multiDice: 0.1106 (0.1106) loss_CrossEntropy: 0.1552 (0.1552) Avg: 0.0404 (0.0404) time: 0.4324 data: 0.3340 max mem: 10289
Test: [10/75] eta: 0:00:22 loss: 0.1639 (0.1767) loss_multiDice: 0.1075 (0.1073) loss_CrossEntropy: 0.1639 (0.1767) Avg: 0.7071 (0.6272) time: 0.3472 data: 0.2632 max mem: 10289
Test: [20/75] eta: 0:00:17 loss: 0.1790 (0.2004) loss_multiDice: 0.0991 (0.0992) loss_CrossEntropy: 0.1790 (0.2004) Avg: 0.7193 (0.6728) time: 0.3254 data: 0.2620 max mem: 10289
Test: [30/75] eta: 0:00:17 loss: 0.2121 (0.2017) loss_multiDice: 0.0684 (0.0876) loss_CrossEntropy: 0.2121 (0.2017) Avg: 0.8191 (0.7225) time: 0.3924 data: 0.3031 max mem: 10289
Test: [40/75] eta: 0:00:16 loss: 0.1340 (0.1823) loss_multiDice: 0.0560 (0.0778) loss_CrossEntropy: 0.1340 (0.1823) Avg: 0.8874 (0.7661) time: 0.4609 data: 0.3680 max mem: 10289
Test: [50/75] eta: 0:00:10 loss: 0.1154 (0.1770) loss_multiDice: 0.0525 (0.0745) loss_CrossEntropy: 0.1154 (0.1770) Avg: 0.8874 (0.7445) time: 0.4047 data: 0.3484 max mem: 10289
Test: [60/75] eta: 0:00:06 loss: 0.1062 (0.1635) loss_multiDice: 0.0552 (0.0706) loss_CrossEntropy: 0.1062 (0.1635) Avg: 0.7503 (0.7588) time: 0.4337 data: 0.3454 max mem: 10289
Test: [70/75] eta: 0:00:01 loss: 0.1240 (0.1614) loss_multiDice: 0.0693 (0.0727) loss_CrossEntropy: 0.1240 (0.1614) Avg: 0.7932 (0.7484) time: 0.2814 data: 0.2194 max mem: 10289
Test: [74/75] eta: 0:00:00 loss: 0.1404 (0.1652) loss_multiDice: 0.0829 (0.0740) loss_CrossEntropy: 0.1404 (0.1652) Avg: 0.7556 (0.7455) time: 0.3696 data: 0.2940 max mem: 10289
Test: Total time: 0:00:26 (0.3494 s / it)
Averaged stats: loss: 0.1404 (0.1652) loss_multiDice: 0.0829 (0.0740) loss_CrossEntropy: 0.1404 (0.1652) Avg: 0.7556 (0.7455)
MSCMR dice score: 0.7454532836377621
Update MSCMR high dice score model!
myops: loss1: 0.8738194704055786 loss1 mix: 0.9405359029769897 invariant mix: -0.8828125
MSCMR: loss3: 0.8443384170532227 loss3 mix: 0.6700440049171448 invariant mix MSCMR: -0.9425135254859924
Epoch: [24] [ 0/176] eta: 0:20:01 lr: 0.000100 loss: 0.0377 (0.0377) loss_multiDice: 0.8067 (0.8067) loss_CrossEntropy: 0.0377 (0.0377) time: 6.8289 data: 6.8289 max mem: 10289
Epoch: [24] [ 10/176] eta: 0:19:55 lr: 0.000100 loss: 0.0713 (0.0690) loss_multiDice: 0.8067 (0.8091) loss_CrossEntropy: 0.0713 (0.0690) time: 7.2032 data: 7.2032 max mem: 10289
Epoch: [24] [ 20/176] eta: 0:17:49 lr: 0.000100 loss: 0.0638 (0.0653) loss_multiDice: 0.8019 (0.8050) loss_CrossEntropy: 0.0638 (0.0653) time: 6.8587 data: 6.8587 max mem: 10289
Epoch: [24] [ 30/176] eta: 0:14:47 lr: 0.000100 loss: 0.0578 (0.0678) loss_multiDice: 0.8027 (0.8051) loss_CrossEntropy: 0.0578 (0.0678) time: 6.0807 data: 6.0807 max mem: 10289
Epoch: [24] [ 40/176] eta: 0:13:27 lr: 0.000100 loss: 0.0652 (0.0680) loss_multiDice: 0.8054 (0.8068) loss_CrossEntropy: 0.0652 (0.0680) time: 5.9375 data: 5.9375 max mem: 10289
Epoch: [24] [ 50/176] eta: 0:08:03 lr: 0.000100 loss: 0.0683 (0.0696) loss_multiDice: 0.8054 (0.8070) loss_CrossEntropy: 0.0683 (0.0696) time: 3.8345 data: 3.8345 max mem: 10289
Epoch: [24] [ 60/176] eta: 0:11:18 lr: 0.000100 loss: 0.0710 (0.0720) loss_multiDice: 0.8058 (0.8084) loss_CrossEntropy: 0.0710 (0.0720) time: 5.8491 data: 5.8491 max mem: 10289
Epoch: [24] [ 70/176] eta: 0:10:11 lr: 0.000100 loss: 0.0704 (0.0727) loss_multiDice: 0.8058 (0.8077) loss_CrossEntropy: 0.0704 (0.0727) time: 5.7689 data: 5.7689 max mem: 10289
Epoch: [24] [ 80/176] eta: 0:09:28 lr: 0.000100 loss: 0.0704 (0.0719) loss_multiDice: 0.8094 (0.8087) loss_CrossEntropy: 0.0704 (0.0719) time: 5.9244 data: 5.9244 max mem: 10289
Epoch: [24] [ 90/176] eta: 0:09:41 lr: 0.000100 loss: 0.0625 (0.0696) loss_multiDice: 0.8136 (0.8088) loss_CrossEntropy: 0.0625 (0.0696) time: 6.7641 data: 6.7641 max mem: 10289
Epoch: [24] [100/176] eta: 0:07:49 lr: 0.000100 loss: 0.0590 (0.0686) loss_multiDice: 0.8083 (0.8089) loss_CrossEntropy: 0.0590 (0.0686) time: 6.1782 data: 6.1782 max mem: 10289
Epoch: [24] [110/176] eta: 0:07:17 lr: 0.000100 loss: 0.0640 (0.0701) loss_multiDice: 0.8058 (0.8088) loss_CrossEntropy: 0.0640 (0.0701) time: 6.6349 data: 6.6349 max mem: 10289
Epoch: [24] [120/176] eta: 0:06:25 lr: 0.000100 loss: 0.0593 (0.0691) loss_multiDice: 0.8092 (0.8092) loss_CrossEntropy: 0.0593 (0.0691) time: 6.8816 data: 6.8816 max mem: 10289
Epoch: [24] [130/176] eta: 0:05:32 lr: 0.000100 loss: 0.0503 (0.0680) loss_multiDice: 0.8131 (0.8092) loss_CrossEntropy: 0.0503 (0.0680) time: 7.2375 data: 7.2375 max mem: 10289
Epoch: [24] [140/176] eta: 0:04:17 lr: 0.000100 loss: 0.0532 (0.0679) loss_multiDice: 0.7997 (0.8083) loss_CrossEntropy: 0.0532 (0.0679) time: 7.1467 data: 7.1467 max mem: 10289
Epoch: [24] [150/176] eta: 0:02:54 lr: 0.000100 loss: 0.0559 (0.0676) loss_multiDice: 0.7983 (0.8085) loss_CrossEntropy: 0.0559 (0.0676) time: 6.7225 data: 6.7225 max mem: 10289
Epoch: [24] [160/176] eta: 0:01:52 lr: 0.000100 loss: 0.0541 (0.0667) loss_multiDice: 0.8077 (0.8087) loss_CrossEntropy: 0.0541 (0.0667) time: 7.0554 data: 7.0554 max mem: 10289
Epoch: [24] [170/176] eta: 0:00:42 lr: 0.000100 loss: 0.0488 (0.0663) loss_multiDice: 0.8009 (0.8082) loss_CrossEntropy: 0.0488 (0.0663) time: 7.0803 data: 7.0803 max mem: 10289
Epoch: [24] [175/176] eta: 0:00:08 lr: 0.000100 loss: 0.0541 (0.0669) loss_multiDice: 0.7955 (0.8085) loss_CrossEntropy: 0.0541 (0.0669) time: 8.1119 data: 8.1119 max mem: 10289
Test: [ 0/75] eta: 0:00:32 loss: 0.1910 (0.1910) loss_multiDice: 0.1350 (0.1350) loss_CrossEntropy: 0.1910 (0.1910) Avg: 0.0343 (0.0343) time: 0.4368 data: 0.3277 max mem: 10289
Test: [10/75] eta: 0:00:31 loss: 0.1910 (0.1915) loss_multiDice: 0.1262 (0.1261) loss_CrossEntropy: 0.1910 (0.1915) Avg: 0.6852 (0.6282) time: 0.4823 data: 0.3787 max mem: 10289
Test: [20/75] eta: 0:00:24 loss: 0.2066 (0.2344) loss_multiDice: 0.1250 (0.1216) loss_CrossEntropy: 0.2066 (0.2344) Avg: 0.6872 (0.6497) time: 0.4475 data: 0.3443 max mem: 10289
Test: [30/75] eta: 0:00:12 loss: 0.2596 (0.2325) loss_multiDice: 0.0748 (0.1044) loss_CrossEntropy: 0.2596 (0.2325) Avg: 0.7270 (0.7022) time: 0.2689 data: 0.2290 max mem: 10289
Test: [40/75] eta: 0:00:15 loss: 0.1429 (0.2086) loss_multiDice: 0.0618 (0.0926) loss_CrossEntropy: 0.1429 (0.2086) Avg: 0.8983 (0.7519) time: 0.4295 data: 0.3383 max mem: 10289
Test: [50/75] eta: 0:00:06 loss: 0.1241 (0.1942) loss_multiDice: 0.0630 (0.0878) loss_CrossEntropy: 0.1241 (0.1942) Avg: 0.8769 (0.7378) time: 0.2632 data: 0.2114 max mem: 10289
Test: [60/75] eta: 0:00:04 loss: 0.1061 (0.1799) loss_multiDice: 0.0683 (0.0842) loss_CrossEntropy: 0.1061 (0.1799) Avg: 0.8100 (0.7538) time: 0.2979 data: 0.2153 max mem: 10289
Test: [70/75] eta: 0:00:02 loss: 0.1293 (0.1806) loss_multiDice: 0.0823 (0.0877) loss_CrossEntropy: 0.1293 (0.1806) Avg: 0.7319 (0.7365) time: 0.5957 data: 0.4279 max mem: 10289
Test: [74/75] eta: 0:00:00 loss: 0.1703 (0.1839) loss_multiDice: 0.1035 (0.0891) loss_CrossEntropy: 0.1703 (0.1839) Avg: 0.6752 (0.7311) time: 0.3528 data: 0.2751 max mem: 10289
Test: Total time: 0:00:30 (0.4038 s / it)
Averaged stats: loss: 0.1703 (0.1839) loss_multiDice: 0.1035 (0.0891) loss_CrossEntropy: 0.1703 (0.1839) Avg: 0.6752 (0.7311)
MSCMR dice score: 0.7310760247707367
Update MSCMR high dice score model!
myops: loss1: 0.8610186576843262 loss1 mix: 1.0041390657424927 invariant mix: -0.8911675810813904
MSCMR: loss3: 0.8617360591888428 loss3 mix: 0.7643122673034668 invariant mix MSCMR: -0.9301263689994812
Epoch: [25] [ 0/176] eta: 0:21:30 lr: 0.000100 loss: 0.0503 (0.0503) loss_multiDice: 0.8114 (0.8114) loss_CrossEntropy: 0.0503 (0.0503) time: 7.3336 data: 7.3336 max mem: 10289
Epoch: [25] [ 10/176] eta: 0:18:32 lr: 0.000100 loss: 0.0654 (0.0674) loss_multiDice: 0.8025 (0.7995) loss_CrossEntropy: 0.0654 (0.0674) time: 6.6995 data: 6.6995 max mem: 10289
Epoch: [25] [ 20/176] eta: 0:17:55 lr: 0.000100 loss: 0.0574 (0.0604) loss_multiDice: 0.7995 (0.8011) loss_CrossEntropy: 0.0574 (0.0604) time: 6.8923 data: 6.8923 max mem: 10289
Epoch: [25] [ 30/176] eta: 0:17:06 lr: 0.000100 loss: 0.0536 (0.0626) loss_multiDice: 0.8049 (0.8077) loss_CrossEntropy: 0.0536 (0.0626) time: 7.0317 data: 7.0317 max mem: 10289
Epoch: [25] [ 40/176] eta: 0:16:49 lr: 0.000100 loss: 0.0649 (0.0621) loss_multiDice: 0.8175 (0.8102) loss_CrossEntropy: 0.0649 (0.0621) time: 7.4214 data: 7.4214 max mem: 10289
Epoch: [25] [ 50/176] eta: 0:14:49 lr: 0.000100 loss: 0.0598 (0.0631) loss_multiDice: 0.7896 (0.8063) loss_CrossEntropy: 0.0598 (0.0631) time: 7.0570 data: 7.0570 max mem: 10289
Epoch: [25] [ 60/176] eta: 0:12:21 lr: 0.000100 loss: 0.0618 (0.0641) loss_multiDice: 0.7986 (0.8083) loss_CrossEntropy: 0.0618 (0.0641) time: 6.3960 data: 6.3960 max mem: 10289
Epoch: [25] [ 70/176] eta: 0:12:29 lr: 0.000100 loss: 0.0679 (0.0647) loss_multiDice: 0.8026 (0.8070) loss_CrossEntropy: 0.0679 (0.0647) time: 7.0708 data: 7.0708 max mem: 10289
Epoch: [25] [ 80/176] eta: 0:11:10 lr: 0.000100 loss: 0.0642 (0.0652) loss_multiDice: 0.8153 (0.8079) loss_CrossEntropy: 0.0642 (0.0652) time: 6.9870 data: 6.9870 max mem: 10289
Epoch: [25] [ 90/176] eta: 0:09:11 lr: 0.000100 loss: 0.0557 (0.0644) loss_multiDice: 0.8182 (0.8080) loss_CrossEntropy: 0.0557 (0.0644) time: 6.4172 data: 6.4172 max mem: 10289
Epoch: [25] [100/176] eta: 0:08:47 lr: 0.000100 loss: 0.0556 (0.0645) loss_multiDice: 0.8099 (0.8079) loss_CrossEntropy: 0.0556 (0.0645) time: 6.9405 data: 6.9405 max mem: 10289
Epoch: [25] [110/176] eta: 0:07:20 lr: 0.000100 loss: 0.0490 (0.0644) loss_multiDice: 0.8070 (0.8080) loss_CrossEntropy: 0.0490 (0.0644) time: 6.6676 data: 6.6676 max mem: 10289
Epoch: [25] [120/176] eta: 0:02:03 lr: 0.000100 loss: 0.0411 (0.0638) loss_multiDice: 0.8155 (0.8085) loss_CrossEntropy: 0.0411 (0.0638) time: 2.2057 data: 2.2057 max mem: 10289
Epoch: [25] [130/176] eta: 0:04:51 lr: 0.000100 loss: 0.0568 (0.0643) loss_multiDice: 0.8054 (0.8086) loss_CrossEntropy: 0.0568 (0.0643) time: 6.3454 data: 6.3454 max mem: 10289
Epoch: [25] [140/176] eta: 0:03:48 lr: 0.000100 loss: 0.0611 (0.0644) loss_multiDice: 0.8054 (0.8090) loss_CrossEntropy: 0.0611 (0.0644) time: 6.3489 data: 6.3489 max mem: 10289
Epoch: [25] [150/176] eta: 0:03:17 lr: 0.000100 loss: 0.0587 (0.0643) loss_multiDice: 0.8078 (0.8096) loss_CrossEntropy: 0.0587 (0.0643) time: 7.5863 data: 7.5863 max mem: 10289
Epoch: [25] [160/176] eta: 0:01:47 lr: 0.000100 loss: 0.0595 (0.0654) loss_multiDice: 0.7971 (0.8091) loss_CrossEntropy: 0.0595 (0.0654) time: 6.7136 data: 6.7136 max mem: 10289
Epoch: [25] [170/176] eta: 0:00:40 lr: 0.000100 loss: 0.0611 (0.0653) loss_multiDice: 0.7955 (0.8085) loss_CrossEntropy: 0.0611 (0.0653) time: 6.7349 data: 6.7349 max mem: 10289
Epoch: [25] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0591 (0.0650) loss_multiDice: 0.8009 (0.8086) loss_CrossEntropy: 0.0591 (0.0650) time: 6.5619 data: 6.5619 max mem: 10289
Test: [ 0/75] eta: 0:00:26 loss: 0.1870 (0.1870) loss_multiDice: 0.1187 (0.1187) loss_CrossEntropy: 0.1870 (0.1870) Avg: 0.0351 (0.0351) time: 0.3537 data: 0.2770 max mem: 10289
Test: [10/75] eta: 0:00:19 loss: 0.1709 (0.1859) loss_multiDice: 0.1076 (0.1069) loss_CrossEntropy: 0.1709 (0.1859) Avg: 0.6174 (0.6012) time: 0.2958 data: 0.2241 max mem: 10289
Test: [20/75] eta: 0:00:20 loss: 0.2619 (0.2569) loss_multiDice: 0.0951 (0.1071) loss_CrossEntropy: 0.2619 (0.2569) Avg: 0.5736 (0.5780) time: 0.3817 data: 0.2928 max mem: 10289
Test: [30/75] eta: 0:00:19 loss: 0.2922 (0.2469) loss_multiDice: 0.0633 (0.0913) loss_CrossEntropy: 0.2922 (0.2469) Avg: 0.6102 (0.6495) time: 0.4239 data: 0.3007 max mem: 10289
Test: [40/75] eta: 0:00:13 loss: 0.1378 (0.2168) loss_multiDice: 0.0516 (0.0794) loss_CrossEntropy: 0.1378 (0.2168) Avg: 0.8715 (0.7093) time: 0.3896 data: 0.2967 max mem: 10289
Test: [50/75] eta: 0:00:11 loss: 0.1214 (0.1996) loss_multiDice: 0.0436 (0.0736) loss_CrossEntropy: 0.1214 (0.1996) Avg: 0.8750 (0.6979) time: 0.4617 data: 0.3600 max mem: 10289
Test: [60/75] eta: 0:00:06 loss: 0.0812 (0.1817) loss_multiDice: 0.0431 (0.0687) loss_CrossEntropy: 0.0812 (0.1817) Avg: 0.6860 (0.7207) time: 0.4301 data: 0.3120 max mem: 10289
Test: [70/75] eta: 0:00:01 loss: 0.1062 (0.1784) loss_multiDice: 0.0547 (0.0705) loss_CrossEntropy: 0.1062 (0.1784) Avg: 0.7664 (0.7099) time: 0.3417 data: 0.2846 max mem: 10289
Test: [74/75] eta: 0:00:00 loss: 0.1353 (0.1841) loss_multiDice: 0.0732 (0.0724) loss_CrossEntropy: 0.1353 (0.1841) Avg: 0.6052 (0.7035) time: 0.3991 data: 0.3116 max mem: 10289
Test: Total time: 0:00:24 (0.3312 s / it)
Averaged stats: loss: 0.1353 (0.1841) loss_multiDice: 0.0732 (0.0724) loss_CrossEntropy: 0.1353 (0.1841) Avg: 0.6052 (0.7035)
MSCMR dice score: 0.703457481265068
Update MSCMR high dice score model!
myops: loss1: 0.8427236080169678 loss1 mix: 0.9120495319366455 invariant mix: -0.8996623158454895
MSCMR: loss3: 0.835690975189209 loss3 mix: 0.6606821417808533 invariant mix MSCMR: -0.9242956638336182
Epoch: [26] [ 0/176] eta: 0:19:00 lr: 0.000100 loss: 0.0457 (0.0457) loss_multiDice: 0.7900 (0.7900) loss_CrossEntropy: 0.0457 (0.0457) time: 6.4813 data: 6.4813 max mem: 10289
Epoch: [26] [ 10/176] eta: 0:18:10 lr: 0.000100 loss: 0.0681 (0.0804) loss_multiDice: 0.8094 (0.8076) loss_CrossEntropy: 0.0681 (0.0804) time: 6.5690 data: 6.5690 max mem: 10289
Epoch: [26] [ 20/176] eta: 0:18:34 lr: 0.000100 loss: 0.0711 (0.0733) loss_multiDice: 0.8082 (0.8039) loss_CrossEntropy: 0.0711 (0.0733) time: 7.1432 data: 7.1432 max mem: 10289
Epoch: [26] [ 30/176] eta: 0:15:33 lr: 0.000100 loss: 0.0579 (0.0674) loss_multiDice: 0.8121 (0.8100) loss_CrossEntropy: 0.0579 (0.0674) time: 6.3930 data: 6.3930 max mem: 10289
Epoch: [26] [ 40/176] eta: 0:13:11 lr: 0.000100 loss: 0.0597 (0.0687) loss_multiDice: 0.8166 (0.8101) loss_CrossEntropy: 0.0597 (0.0687) time: 5.8235 data: 5.8235 max mem: 10289
Epoch: [26] [ 50/176] eta: 0:10:34 lr: 0.000100 loss: 0.0649 (0.0684) loss_multiDice: 0.8203 (0.8129) loss_CrossEntropy: 0.0649 (0.0684) time: 5.0379 data: 5.0379 max mem: 10289
Epoch: [26] [ 60/176] eta: 0:06:37 lr: 0.000100 loss: 0.0619 (0.0688) loss_multiDice: 0.8058 (0.8115) loss_CrossEntropy: 0.0619 (0.0688) time: 3.4295 data: 3.4295 max mem: 10289
Epoch: [26] [ 70/176] eta: 0:12:16 lr: 0.000100 loss: 0.0493 (0.0666) loss_multiDice: 0.8009 (0.8104) loss_CrossEntropy: 0.0493 (0.0666) time: 6.9516 data: 6.9516 max mem: 10289
Epoch: [26] [ 80/176] eta: 0:10:36 lr: 0.000100 loss: 0.0516 (0.0660) loss_multiDice: 0.8034 (0.8094) loss_CrossEntropy: 0.0516 (0.0660) time: 6.6348 data: 6.6348 max mem: 10289
Epoch: [26] [ 90/176] eta: 0:09:56 lr: 0.000100 loss: 0.0546 (0.0653) loss_multiDice: 0.8064 (0.8096) loss_CrossEntropy: 0.0546 (0.0653) time: 6.9399 data: 6.9399 max mem: 10289
Epoch: [26] [100/176] eta: 0:08:33 lr: 0.000100 loss: 0.0594 (0.0653) loss_multiDice: 0.8102 (0.8098) loss_CrossEntropy: 0.0594 (0.0653) time: 6.7533 data: 6.7533 max mem: 10289
Epoch: [26] [110/176] eta: 0:06:24 lr: 0.000100 loss: 0.0494 (0.0644) loss_multiDice: 0.7981 (0.8097) loss_CrossEntropy: 0.0494 (0.0644) time: 5.8240 data: 5.8240 max mem: 10289
Epoch: [26] [120/176] eta: 0:06:16 lr: 0.000100 loss: 0.0473 (0.0647) loss_multiDice: 0.8058 (0.8102) loss_CrossEntropy: 0.0473 (0.0647) time: 6.7183 data: 6.7183 max mem: 10289
Epoch: [26] [130/176] eta: 0:05:05 lr: 0.000100 loss: 0.0492 (0.0644) loss_multiDice: 0.8040 (0.8081) loss_CrossEntropy: 0.0492 (0.0644) time: 6.6408 data: 6.6408 max mem: 10289
Epoch: [26] [140/176] eta: 0:03:44 lr: 0.000100 loss: 0.0639 (0.0655) loss_multiDice: 0.7960 (0.8091) loss_CrossEntropy: 0.0639 (0.0655) time: 6.2231 data: 6.2231 max mem: 10289
Epoch: [26] [150/176] eta: 0:03:14 lr: 0.000100 loss: 0.0639 (0.0649) loss_multiDice: 0.7992 (0.8084) loss_CrossEntropy: 0.0639 (0.0649) time: 7.4686 data: 7.4686 max mem: 10289
Epoch: [26] [160/176] eta: 0:01:28 lr: 0.000100 loss: 0.0527 (0.0651) loss_multiDice: 0.7992 (0.8090) loss_CrossEntropy: 0.0527 (0.0651) time: 5.5422 data: 5.5422 max mem: 10289
Epoch: [26] [170/176] eta: 0:00:40 lr: 0.000100 loss: 0.0588 (0.0649) loss_multiDice: 0.8157 (0.8103) loss_CrossEntropy: 0.0588 (0.0649) time: 6.7159 data: 6.7159 max mem: 10289
Epoch: [26] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0644 (0.0651) loss_multiDice: 0.8176 (0.8108) loss_CrossEntropy: 0.0644 (0.0651) time: 6.9500 data: 6.9500 max mem: 10289
Test: [ 0/75] eta: 0:00:28 loss: 0.1851 (0.1851) loss_multiDice: 0.1406 (0.1406) loss_CrossEntropy: 0.1851 (0.1851) Avg: 0.0494 (0.0494) time: 0.3776 data: 0.3262 max mem: 10289
Test: [10/75] eta: 0:00:27 loss: 0.1917 (0.2063) loss_multiDice: 0.1261 (0.1274) loss_CrossEntropy: 0.1917 (0.2063) Avg: 0.5872 (0.5593) time: 0.4302 data: 0.3199 max mem: 10289
Test: [20/75] eta: 0:00:19 loss: 0.2305 (0.2525) loss_multiDice: 0.1239 (0.1215) loss_CrossEntropy: 0.2305 (0.2525) Avg: 0.6049 (0.5912) time: 0.3541 data: 0.2789 max mem: 10289
Test: [30/75] eta: 0:00:20 loss: 0.1776 (0.2221) loss_multiDice: 0.0754 (0.1020) loss_CrossEntropy: 0.1776 (0.2221) Avg: 0.7073 (0.6684) time: 0.4660 data: 0.3575 max mem: 10289
Test: [40/75] eta: 0:00:13 loss: 0.1079 (0.1903) loss_multiDice: 0.0527 (0.0880) loss_CrossEntropy: 0.1079 (0.1903) Avg: 0.9083 (0.7300) time: 0.3967 data: 0.2994 max mem: 10289
Test: [50/75] eta: 0:00:09 loss: 0.0970 (0.1779) loss_multiDice: 0.0511 (0.0839) loss_CrossEntropy: 0.0970 (0.1779) Avg: 0.9020 (0.7220) time: 0.3840 data: 0.3131 max mem: 10289
Test: [60/75] eta: 0:00:06 loss: 0.0929 (0.1629) loss_multiDice: 0.0567 (0.0796) loss_CrossEntropy: 0.0929 (0.1629) Avg: 0.8625 (0.7419) time: 0.4122 data: 0.3311 max mem: 10289
Test: [70/75] eta: 0:00:01 loss: 0.1216 (0.1665) loss_multiDice: 0.0885 (0.0830) loss_CrossEntropy: 0.1216 (0.1665) Avg: 0.7154 (0.7229) time: 0.3066 data: 0.2422 max mem: 10289
Test: [74/75] eta: 0:00:00 loss: 0.1592 (0.1709) loss_multiDice: 0.0954 (0.0846) loss_CrossEntropy: 0.1592 (0.1709) Avg: 0.5950 (0.7173) time: 0.3274 data: 0.2246 max mem: 10289
Test: Total time: 0:00:28 (0.3802 s / it)
Averaged stats: loss: 0.1592 (0.1709) loss_multiDice: 0.0954 (0.0846) loss_CrossEntropy: 0.1592 (0.1709) Avg: 0.5950 (0.7173)
MSCMR dice score: 0.7172576475143433
Update MSCMR high dice score model!
myops: loss1: 0.8489543795585632 loss1 mix: 0.9623408317565918 invariant mix: -0.8389076590538025
MSCMR: loss3: 0.8501983880996704 loss3 mix: 0.7760710716247559 invariant mix MSCMR: -0.966224193572998
Epoch: [27] [ 0/176] eta: 0:21:05 lr: 0.000100 loss: 0.0499 (0.0499) loss_multiDice: 0.8003 (0.8003) loss_CrossEntropy: 0.0499 (0.0499) time: 7.1886 data: 7.1886 max mem: 10289
Epoch: [27] [ 10/176] eta: 0:14:55 lr: 0.000100 loss: 0.0586 (0.0694) loss_multiDice: 0.8178 (0.8122) loss_CrossEntropy: 0.0586 (0.0694) time: 5.3967 data: 5.3967 max mem: 10289
Epoch: [27] [ 20/176] eta: 0:16:55 lr: 0.000100 loss: 0.0549 (0.0651) loss_multiDice: 0.8178 (0.8100) loss_CrossEntropy: 0.0549 (0.0651) time: 6.5095 data: 6.5095 max mem: 10289
Epoch: [27] [ 30/176] eta: 0:16:15 lr: 0.000100 loss: 0.0601 (0.0698) loss_multiDice: 0.8118 (0.8111) loss_CrossEntropy: 0.0601 (0.0698) time: 6.6833 data: 6.6833 max mem: 10289
Epoch: [27] [ 40/176] eta: 0:15:54 lr: 0.000100 loss: 0.0681 (0.0711) loss_multiDice: 0.8107 (0.8118) loss_CrossEntropy: 0.0681 (0.0711) time: 7.0171 data: 7.0171 max mem: 10289
Epoch: [27] [ 50/176] eta: 0:14:30 lr: 0.000100 loss: 0.0652 (0.0708) loss_multiDice: 0.8102 (0.8108) loss_CrossEntropy: 0.0652 (0.0708) time: 6.9070 data: 6.9070 max mem: 10289
Epoch: [27] [ 60/176] eta: 0:13:23 lr: 0.000100 loss: 0.0628 (0.0683) loss_multiDice: 0.7979 (0.8086) loss_CrossEntropy: 0.0628 (0.0683) time: 6.9261 data: 6.9261 max mem: 10289
Epoch: [27] [ 70/176] eta: 0:12:59 lr: 0.000100 loss: 0.0528 (0.0671) loss_multiDice: 0.7942 (0.8091) loss_CrossEntropy: 0.0528 (0.0671) time: 7.3574 data: 7.3574 max mem: 10289
Epoch: [27] [ 80/176] eta: 0:10:26 lr: 0.000100 loss: 0.0581 (0.0670) loss_multiDice: 0.8005 (0.8081) loss_CrossEntropy: 0.0581 (0.0670) time: 6.5280 data: 6.5280 max mem: 10289
Epoch: [27] [ 90/176] eta: 0:10:10 lr: 0.000100 loss: 0.0598 (0.0671) loss_multiDice: 0.8002 (0.8073) loss_CrossEntropy: 0.0598 (0.0671) time: 7.0937 data: 7.0937 max mem: 10289
Epoch: [27] [100/176] eta: 0:08:19 lr: 0.000100 loss: 0.0551 (0.0665) loss_multiDice: 0.8026 (0.8075) loss_CrossEntropy: 0.0551 (0.0665) time: 6.5687 data: 6.5687 max mem: 10289
Epoch: [27] [110/176] eta: 0:07:22 lr: 0.000100 loss: 0.0629 (0.0672) loss_multiDice: 0.8145 (0.8091) loss_CrossEntropy: 0.0629 (0.0672) time: 6.7096 data: 6.7096 max mem: 10289
Epoch: [27] [120/176] eta: 0:06:24 lr: 0.000100 loss: 0.0629 (0.0662) loss_multiDice: 0.8145 (0.8084) loss_CrossEntropy: 0.0629 (0.0662) time: 6.8584 data: 6.8584 max mem: 10289
Epoch: [27] [130/176] eta: 0:03:50 lr: 0.000100 loss: 0.0543 (0.0657) loss_multiDice: 0.8127 (0.8090) loss_CrossEntropy: 0.0543 (0.0657) time: 5.0127 data: 5.0127 max mem: 10289
Epoch: [27] [140/176] eta: 0:04:14 lr: 0.000100 loss: 0.0550 (0.0664) loss_multiDice: 0.8148 (0.8090) loss_CrossEntropy: 0.0550 (0.0664) time: 7.0628 data: 7.0628 max mem: 10289
Epoch: [27] [150/176] eta: 0:02:53 lr: 0.000100 loss: 0.0608 (0.0672) loss_multiDice: 0.8002 (0.8089) loss_CrossEntropy: 0.0608 (0.0672) time: 6.6727 data: 6.6727 max mem: 10289
Epoch: [27] [160/176] eta: 0:02:07 lr: 0.000100 loss: 0.0688 (0.0676) loss_multiDice: 0.8089 (0.8091) loss_CrossEntropy: 0.0688 (0.0676) time: 7.9849 data: 7.9849 max mem: 10289
Epoch: [27] [170/176] eta: 0:00:41 lr: 0.000100 loss: 0.0697 (0.0682) loss_multiDice: 0.8089 (0.8094) loss_CrossEntropy: 0.0697 (0.0682) time: 6.8404 data: 6.8404 max mem: 10289
Epoch: [27] [175/176] eta: 0:00:05 lr: 0.000100 loss: 0.0663 (0.0686) loss_multiDice: 0.8081 (0.8092) loss_CrossEntropy: 0.0663 (0.0686) time: 5.2548 data: 5.2548 max mem: 10289
Test: [ 0/75] eta: 0:00:28 loss: 0.1982 (0.1982) loss_multiDice: 0.1311 (0.1311) loss_CrossEntropy: 0.1982 (0.1982) Avg: 0.0835 (0.0835) time: 0.3788 data: 0.2903 max mem: 10289
Test: [10/75] eta: 0:00:21 loss: 0.1997 (0.2120) loss_multiDice: 0.1311 (0.1300) loss_CrossEntropy: 0.1997 (0.2120) Avg: 0.6988 (0.6349) time: 0.3321 data: 0.2564 max mem: 10289
Test: [20/75] eta: 0:00:23 loss: 0.2387 (0.2595) loss_multiDice: 0.1256 (0.1267) loss_CrossEntropy: 0.2387 (0.2595) Avg: 0.6685 (0.6536) time: 0.4204 data: 0.3317 max mem: 10289
Test: [30/75] eta: 0:00:14 loss: 0.2287 (0.2409) loss_multiDice: 0.0779 (0.1106) loss_CrossEntropy: 0.2287 (0.2409) Avg: 0.8265 (0.7143) time: 0.3184 data: 0.2507 max mem: 10289
Test: [40/75] eta: 0:00:11 loss: 0.1817 (0.2226) loss_multiDice: 0.0723 (0.0997) loss_CrossEntropy: 0.1817 (0.2226) Avg: 0.8777 (0.7536) time: 0.3240 data: 0.2473 max mem: 10289
Test: [50/75] eta: 0:00:07 loss: 0.1618 (0.2153) loss_multiDice: 0.0757 (0.0962) loss_CrossEntropy: 0.1618 (0.2153) Avg: 0.8258 (0.7327) time: 0.3037 data: 0.2430 max mem: 10289
Test: [60/75] eta: 0:00:06 loss: 0.1313 (0.2004) loss_multiDice: 0.0780 (0.0931) loss_CrossEntropy: 0.1313 (0.2004) Avg: 0.7840 (0.7477) time: 0.4153 data: 0.3151 max mem: 10289
Test: [70/75] eta: 0:00:02 loss: 0.1530 (0.1999) loss_multiDice: 0.0922 (0.0961) loss_CrossEntropy: 0.1530 (0.1999) Avg: 0.7401 (0.7367) time: 0.4813 data: 0.3339 max mem: 10289
Test: [74/75] eta: 0:00:00 loss: 0.1774 (0.2053) loss_multiDice: 0.1086 (0.0981) loss_CrossEntropy: 0.1774 (0.2053) Avg: 0.6742 (0.7299) time: 0.3775 data: 0.3163 max mem: 10289
Test: Total time: 0:00:27 (0.3685 s / it)
Averaged stats: loss: 0.1774 (0.2053) loss_multiDice: 0.1086 (0.0981) loss_CrossEntropy: 0.1774 (0.2053) Avg: 0.6742 (0.7299)
MSCMR dice score: 0.7298561405142149
Update MSCMR high dice score model!
myops: loss1: 0.8439448475837708 loss1 mix: 0.9773362278938293 invariant mix: -0.8297361731529236
MSCMR: loss3: 0.9532084465026855 loss3 mix: 0.8332273364067078 invariant mix MSCMR: -0.9159729480743408
Epoch: [28] [ 0/176] eta: 0:18:55 lr: 0.000100 loss: 0.1049 (0.1049) loss_multiDice: 0.8483 (0.8483) loss_CrossEntropy: 0.1049 (0.1049) time: 6.4542 data: 6.4542 max mem: 10289
Epoch: [28] [ 10/176] eta: 0:18:20 lr: 0.000100 loss: 0.0682 (0.0747) loss_multiDice: 0.8115 (0.8115) loss_CrossEntropy: 0.0682 (0.0747) time: 6.6298 data: 6.6298 max mem: 10289
Epoch: [28] [ 20/176] eta: 0:17:13 lr: 0.000100 loss: 0.0596 (0.0701) loss_multiDice: 0.8060 (0.8125) loss_CrossEntropy: 0.0596 (0.0701) time: 6.6279 data: 6.6279 max mem: 10289
Epoch: [28] [ 30/176] eta: 0:16:12 lr: 0.000100 loss: 0.0516 (0.0677) loss_multiDice: 0.8060 (0.8142) loss_CrossEntropy: 0.0516 (0.0677) time: 6.6625 data: 6.6625 max mem: 10289
Epoch: [28] [ 40/176] eta: 0:15:39 lr: 0.000100 loss: 0.0615 (0.0679) loss_multiDice: 0.8062 (0.8131) loss_CrossEntropy: 0.0615 (0.0679) time: 6.9089 data: 6.9089 max mem: 10289
Epoch: [28] [ 50/176] eta: 0:13:35 lr: 0.000100 loss: 0.0599 (0.0675) loss_multiDice: 0.8078 (0.8133) loss_CrossEntropy: 0.0599 (0.0675) time: 6.4745 data: 6.4745 max mem: 10289
Epoch: [28] [ 60/176] eta: 0:15:06 lr: 0.000100 loss: 0.0599 (0.0684) loss_multiDice: 0.8181 (0.8138) loss_CrossEntropy: 0.0599 (0.0684) time: 7.8117 data: 7.8117 max mem: 10289
Epoch: [28] [ 70/176] eta: 0:11:31 lr: 0.000100 loss: 0.0715 (0.0707) loss_multiDice: 0.8201 (0.8136) loss_CrossEntropy: 0.0715 (0.0707) time: 6.5233 data: 6.5233 max mem: 10289
Epoch: [28] [ 80/176] eta: 0:10:30 lr: 0.000100 loss: 0.0630 (0.0688) loss_multiDice: 0.8191 (0.8137) loss_CrossEntropy: 0.0630 (0.0688) time: 6.5683 data: 6.5683 max mem: 10289
Epoch: [28] [ 90/176] eta: 0:08:58 lr: 0.000100 loss: 0.0544 (0.0671) loss_multiDice: 0.8083 (0.8134) loss_CrossEntropy: 0.0544 (0.0671) time: 6.2659 data: 6.2659 max mem: 10289
Epoch: [28] [100/176] eta: 0:09:16 lr: 0.000100 loss: 0.0559 (0.0679) loss_multiDice: 0.8021 (0.8129) loss_CrossEntropy: 0.0559 (0.0679) time: 7.3219 data: 7.3219 max mem: 10289
Epoch: [28] [110/176] eta: 0:07:27 lr: 0.000100 loss: 0.0539 (0.0680) loss_multiDice: 0.8024 (0.8123) loss_CrossEntropy: 0.0539 (0.0680) time: 6.7860 data: 6.7860 max mem: 10289
Epoch: [28] [120/176] eta: 0:06:35 lr: 0.000100 loss: 0.0507 (0.0671) loss_multiDice: 0.8041 (0.8117) loss_CrossEntropy: 0.0507 (0.0671) time: 7.0634 data: 7.0634 max mem: 10289
Epoch: [28] [130/176] eta: 0:05:20 lr: 0.000100 loss: 0.0647 (0.0680) loss_multiDice: 0.8105 (0.8124) loss_CrossEntropy: 0.0647 (0.0680) time: 6.9628 data: 6.9628 max mem: 10289
Epoch: [28] [140/176] eta: 0:04:10 lr: 0.000100 loss: 0.0740 (0.0684) loss_multiDice: 0.8103 (0.8119) loss_CrossEntropy: 0.0740 (0.0684) time: 6.9690 data: 6.9690 max mem: 10289
Epoch: [28] [150/176] eta: 0:03:02 lr: 0.000100 loss: 0.0504 (0.0671) loss_multiDice: 0.8054 (0.8112) loss_CrossEntropy: 0.0504 (0.0671) time: 7.0036 data: 7.0036 max mem: 10289
Epoch: [28] [160/176] eta: 0:01:58 lr: 0.000100 loss: 0.0504 (0.0678) loss_multiDice: 0.8074 (0.8104) loss_CrossEntropy: 0.0504 (0.0678) time: 7.4277 data: 7.4277 max mem: 10289
Epoch: [28] [170/176] eta: 0:00:40 lr: 0.000100 loss: 0.0742 (0.0685) loss_multiDice: 0.8078 (0.8096) loss_CrossEntropy: 0.0742 (0.0685) time: 6.7878 data: 6.7878 max mem: 10289
Epoch: [28] [175/176] eta: 0:00:06 lr: 0.000100 loss: 0.0721 (0.0680) loss_multiDice: 0.7984 (0.8094) loss_CrossEntropy: 0.0721 (0.0680) time: 6.0288 data: 6.0288 max mem: 10289
Test: [ 0/75] eta: 0:00:29 loss: 0.1696 (0.1696) loss_multiDice: 0.1176 (0.1176) loss_CrossEntropy: 0.1696 (0.1696) Avg: 0.0307 (0.0307) time: 0.3984 data: 0.3035 max mem: 10289
Test: [10/75] eta: 0:00:02 loss: 0.2028 (0.2489) loss_multiDice: 0.1181 (0.1231) loss_CrossEntropy: 0.2028 (0.2489) Avg: 0.5518 (0.5275) time: 0.0399 data: 0.0130 max mem: 10289
Test: [20/75] eta: 0:00:25 loss: 0.2693 (0.2980) loss_multiDice: 0.1187 (0.1223) loss_CrossEntropy: 0.2693 (0.2980) Avg: 0.5518 (0.5431) time: 0.4567 data: 0.3404 max mem: 10289
Test: [30/75] eta: 0:00:12 loss: 0.2752 (0.2812) loss_multiDice: 0.0834 (0.1067) loss_CrossEntropy: 0.2752 (0.2812) Avg: 0.7082 (0.6109) time: 0.2871 data: 0.2250 max mem: 10289
Test: [40/75] eta: 0:00:15 loss: 0.1480 (0.2452) loss_multiDice: 0.0616 (0.0928) loss_CrossEntropy: 0.1480 (0.2452) Avg: 0.8551 (0.6815) time: 0.4409 data: 0.3614 max mem: 10289
Test: [50/75] eta: 0:00:07 loss: 0.1331 (0.2304) loss_multiDice: 0.0589 (0.0879) loss_CrossEntropy: 0.1331 (0.2304) Avg: 0.8631 (0.6772) time: 0.3175 data: 0.2480 max mem: 10289
Test: [60/75] eta: 0:00:04 loss: 0.1331 (0.2146) loss_multiDice: 0.0622 (0.0833) loss_CrossEntropy: 0.1331 (0.2146) Avg: 0.7808 (0.6995) time: 0.3193 data: 0.2508 max mem: 10289
Test: [70/75] eta: 0:00:01 loss: 0.1535 (0.2140) loss_multiDice: 0.0735 (0.0863) loss_CrossEntropy: 0.1535 (0.2140) Avg: 0.7132 (0.6857) time: 0.3700 data: 0.2767 max mem: 10289
Test: [74/75] eta: 0:00:00 loss: 0.1684 (0.2205) loss_multiDice: 0.0924 (0.0884) loss_CrossEntropy: 0.1684 (0.2205) Avg: 0.5729 (0.6762) time: 0.4172 data: 0.3063 max mem: 10289
Test: Total time: 0:00:26 (0.3577 s / it)
Averaged stats: loss: 0.1684 (0.2205) loss_multiDice: 0.0924 (0.0884) loss_CrossEntropy: 0.1684 (0.2205) Avg: 0.5729 (0.6762)
MSCMR dice score: 0.6761727495739858
myops: loss1: 0.8436054587364197 loss1 mix: 0.9581268429756165 invariant mix: -0.8827803134918213
MSCMR: loss3: 0.8585548996925354 loss3 mix: 0.7017620801925659 invariant mix MSCMR: -0.8822932839393616
Epoch: [29] [ 0/176] eta: 0:19:36 lr: 0.000100 loss: 0.0531 (0.0531) loss_multiDice: 0.8054 (0.8054) loss_CrossEntropy: 0.0531 (0.0531) time: 6.6850 data: 6.6850 max mem: 10289
Epoch: [29] [ 10/176] eta: 0:19:53 lr: 0.000100 loss: 0.0531 (0.0530) loss_multiDice: 0.8054 (0.8104) loss_CrossEntropy: 0.0531 (0.0530) time: 7.1919 data: 7.1919 max mem: 10289
Epoch: [29] [ 20/176] eta: 0:17:53 lr: 0.000100 loss: 0.0507 (0.0542) loss_multiDice: 0.8072 (0.8100) loss_CrossEntropy: 0.0507 (0.0542) time: 6.8813 data: 6.8813 max mem: 10289
Epoch: [29] [ 30/176] eta: 0:15:47 lr: 0.000100 loss: 0.0594 (0.0593) loss_multiDice: 0.8211 (0.8148) loss_CrossEntropy: 0.0594 (0.0593) time: 6.4904 data: 6.4904 max mem: 10289
Epoch: [29] [ 40/176] eta: 0:15:39 lr: 0.000100 loss: 0.0644 (0.0617) loss_multiDice: 0.8211 (0.8155) loss_CrossEntropy: 0.0644 (0.0617) time: 6.9109 data: 6.9109 max mem: 10289
Epoch: [29] [ 50/176] eta: 0:12:57 lr: 0.000100 loss: 0.0560 (0.0602) loss_multiDice: 0.8133 (0.8128) loss_CrossEntropy: 0.0560 (0.0602) time: 6.1742 data: 6.1742 max mem: 10289