由於 upsample 時全換成 pixel shuffle, 訓練了4個小時, 數值幾乎沒動, 只有在上振盪, 如下圖所示:
由於想解決 conv 的 staircase, 似乎 chatgpt 首推 pixel shuffle, 折衷方案, 試看看只替換最靠近 outermost 的3層, 訓練 log 如下, from checkpoint 438 to checkpoint 440:
Epoch: [ 0], Batch: [ 0/ 385] | Total Time: 2s
d_loss: 1.3869, g_loss: 45.8408, const_loss: 0.0010, l1_loss: 35.5425, fm_loss: 0.0147, perc_loss: 9.3610, edge: 0.2283
Checkpoint step 100 reached, but saving starts after step 200.
Epoch: [ 0], Batch: [ 100/ 385] | Total Time: 3m 52s
d_loss: 1.3868, g_loss: 45.3611, const_loss: 0.0010, l1_loss: 35.5221, fm_loss: 0.0141, perc_loss: 8.9105, edge: 0.2200
Epoch: [ 0], Batch: [ 200/ 385] | Total Time: 7m 52s
d_loss: 1.3870, g_loss: 47.5990, const_loss: 0.0010, l1_loss: 37.8291, fm_loss: 0.0182, perc_loss: 8.8485, edge: 0.2087
Epoch: [ 0], Batch: [ 300/ 385] | Total Time: 11m 51s
d_loss: 1.3869, g_loss: 47.6899, const_loss: 0.0012, l1_loss: 39.0059, fm_loss: 0.0159, perc_loss: 7.7966, edge: 0.1769
--- End of Epoch 0 --- Time: 909.6s ---
LR Scheduler stepped. Current LR G: 0.000205, LR D: 0.000205
Epoch: [ 1], Batch: [ 0/ 385] | Total Time: 15m 12s
d_loss: 1.3870, g_loss: 46.4882, const_loss: 0.0011, l1_loss: 37.5547, fm_loss: 0.0185, perc_loss: 8.0417, edge: 0.1789
Epoch: [ 1], Batch: [ 100/ 385] | Total Time: 19m 15s
d_loss: 1.3868, g_loss: 46.9446, const_loss: 0.0009, l1_loss: 38.4674, fm_loss: 0.0188, perc_loss: 7.5909, edge: 0.1733
Epoch: [ 1], Batch: [ 200/ 385] | Total Time: 23m 13s
d_loss: 1.3869, g_loss: 46.4333, const_loss: 0.0010, l1_loss: 36.9866, fm_loss: 0.0140, perc_loss: 8.5359, edge: 0.2025
Epoch: [ 1], Batch: [ 300/ 385] | Total Time: 27m 12s
d_loss: 1.3867, g_loss: 45.8198, const_loss: 0.0011, l1_loss: 37.0253, fm_loss: 0.0147, perc_loss: 7.8906, edge: 0.1953
--- End of Epoch 1 --- Time: 922.0s ---
LR Scheduler stepped. Current LR G: 0.000204, LR D: 0.000204
Epoch: [ 2], Batch: [ 0/ 385] | Total Time: 30m 34s
d_loss: 1.3870, g_loss: 45.6523, const_loss: 0.0012, l1_loss: 36.6831, fm_loss: 0.0167, perc_loss: 8.0584, edge: 0.1995
Epoch: [ 2], Batch: [ 100/ 385] | Total Time: 34m 32s
d_loss: 1.3868, g_loss: 45.2854, const_loss: 0.0009, l1_loss: 36.3379, fm_loss: 0.0154, perc_loss: 8.0468, edge: 0.1909
Epoch: [ 2], Batch: [ 200/ 385] | Total Time: 38m 34s
d_loss: 1.3874, g_loss: 45.8440, const_loss: 0.0010, l1_loss: 37.2061, fm_loss: 0.0143, perc_loss: 7.7328, edge: 0.1969
Epoch: [ 2], Batch: [ 300/ 385] | Total Time: 42m 32s
d_loss: 1.3868, g_loss: 45.9283, const_loss: 0.0011, l1_loss: 36.6678, fm_loss: 0.0176, perc_loss: 8.3478, edge: 0.2007
--- End of Epoch 2 --- Time: 919.4s ---
LR Scheduler stepped. Current LR G: 0.000202, LR D: 0.000202
Epoch: [ 3], Batch: [ 0/ 385] | Total Time: 45m 53s
d_loss: 1.3869, g_loss: 45.8861, const_loss: 0.0011, l1_loss: 37.2641, fm_loss: 0.0148, perc_loss: 7.7312, edge: 0.1820
Epoch: [ 3], Batch: [ 100/ 385] | Total Time: 49m 53s
d_loss: 1.3869, g_loss: 44.9206, const_loss: 0.0010, l1_loss: 36.1619, fm_loss: 0.0162, perc_loss: 7.8508, edge: 0.1972
Epoch: [ 3], Batch: [ 200/ 385] | Total Time: 53m 57s
d_loss: 1.3868, g_loss: 45.5885, const_loss: 0.0009, l1_loss: 37.2605, fm_loss: 0.0167, perc_loss: 7.4354, edge: 0.1816
Epoch: [ 3], Batch: [ 300/ 385] | Total Time: 57m 55s
d_loss: 1.3868, g_loss: 45.3942, const_loss: 0.0013, l1_loss: 36.8488, fm_loss: 0.0135, perc_loss: 7.6597, edge: 0.1780
--- End of Epoch 3 --- Time: 928.2s ---
LR Scheduler stepped. Current LR G: 0.000200, LR D: 0.000200
Epoch: [ 4], Batch: [ 0/ 385] | Total Time: 1h 1m 21s
d_loss: 1.3868, g_loss: 46.4442, const_loss: 0.0011, l1_loss: 37.9884, fm_loss: 0.0158, perc_loss: 7.5600, edge: 0.1856
Epoch: [ 4], Batch: [ 100/ 385] | Total Time: 1h 5m 20s
d_loss: 1.3875, g_loss: 46.5919, const_loss: 0.0011, l1_loss: 37.4225, fm_loss: 0.0155, perc_loss: 8.2718, edge: 0.1876
Epoch: [ 4], Batch: [ 200/ 385] | Total Time: 1h 9m 22s
d_loss: 1.3868, g_loss: 45.7125, const_loss: 0.0012, l1_loss: 37.2073, fm_loss: 0.0149, perc_loss: 7.6293, edge: 0.1669
Epoch: [ 4], Batch: [ 300/ 385] | Total Time: 1h 13m 20s
d_loss: 1.3868, g_loss: 44.7595, const_loss: 0.0010, l1_loss: 35.7454, fm_loss: 0.0146, perc_loss: 8.1081, edge: 0.1976
--- End of Epoch 4 --- Time: 920.9s ---
LR Scheduler stepped. Current LR G: 0.000197, LR D: 0.000197
Epoch: [ 5], Batch: [ 0/ 385] | Total Time: 1h 16m 42s
d_loss: 1.3868, g_loss: 44.9370, const_loss: 0.0011, l1_loss: 36.5663, fm_loss: 0.0126, perc_loss: 7.4901, edge: 0.1740
Epoch: [ 5], Batch: [ 100/ 385] | Total Time: 1h 20m 41s
d_loss: 1.3868, g_loss: 46.1378, const_loss: 0.0010, l1_loss: 38.5346, fm_loss: 0.0144, perc_loss: 6.7311, edge: 0.1639
from 440 to 442 圖表:
結論來看, 等同於幾乎沒訓練.
log:
Epoch: [ 0], Batch: [ 0/ 404] | Total Time: 4s
d_loss: 1.3868, g_loss: 44.0380, const_loss: 0.0010, l1_loss: 35.2616, fm_loss: 0.0122, perc_loss: 7.8732, edge: 0.1971
Epoch: [ 0], Batch: [ 100/ 404] | Total Time: 3m 37s
d_loss: 1.3867, g_loss: 46.2001, const_loss: 0.0012, l1_loss: 38.5842, fm_loss: 0.0149, perc_loss: 6.7422, edge: 0.1647
Epoch: [ 0], Batch: [ 200/ 404] | Total Time: 7m 12s
d_loss: 1.3868, g_loss: 44.1531, const_loss: 0.0010, l1_loss: 35.2343, fm_loss: 0.0137, perc_loss: 8.0237, edge: 0.1876
Epoch: [ 0], Batch: [ 300/ 404] | Total Time: 10m 48s
d_loss: 1.3867, g_loss: 44.9150, const_loss: 0.0012, l1_loss: 36.2056, fm_loss: 0.0141, perc_loss: 7.8230, edge: 0.1783
Epoch: [ 0], Batch: [ 400/ 404] | Total Time: 14m 24s
d_loss: 1.3868, g_loss: 44.6668, const_loss: 0.0009, l1_loss: 35.7884, fm_loss: 0.0147, perc_loss: 7.9789, edge: 0.1905
--- End of Epoch 0 --- Time: 870.0s ---
LR Scheduler stepped. Current LR G: 0.000197, LR D: 0.000197
Epoch: [ 1], Batch: [ 0/ 404] | Total Time: 14m 32s
d_loss: 1.3868, g_loss: 44.8657, const_loss: 0.0010, l1_loss: 36.9506, fm_loss: 0.0156, perc_loss: 7.0364, edge: 0.1688
Epoch: [ 1], Batch: [ 100/ 404] | Total Time: 18m 9s
d_loss: 1.3868, g_loss: 44.6664, const_loss: 0.0011, l1_loss: 36.4206, fm_loss: 0.0138, perc_loss: 7.3639, edge: 0.1737
Epoch: [ 1], Batch: [ 200/ 404] | Total Time: 21m 45s
d_loss: 1.3868, g_loss: 44.9284, const_loss: 0.0009, l1_loss: 37.0546, fm_loss: 0.0137, perc_loss: 6.9996, edge: 0.1668
Epoch: [ 1], Batch: [ 300/ 404] | Total Time: 25m 20s
d_loss: 1.3867, g_loss: 45.7832, const_loss: 0.0012, l1_loss: 37.8017, fm_loss: 0.0144, perc_loss: 7.1061, edge: 0.1664
Epoch: [ 1], Batch: [ 400/ 404] | Total Time: 28m 57s
d_loss: 1.3875, g_loss: 45.0433, const_loss: 0.0011, l1_loss: 37.2464, fm_loss: 0.0134, perc_loss: 6.9203, edge: 0.1688
--- End of Epoch 1 --- Time: 872.7s ---
LR Scheduler stepped. Current LR G: 0.000196, LR D: 0.000196
Epoch: [ 2], Batch: [ 0/ 404] | Total Time: 29m 4s
d_loss: 1.3874, g_loss: 44.6051, const_loss: 0.0011, l1_loss: 36.4838, fm_loss: 0.0143, perc_loss: 7.2361, edge: 0.1765
Epoch: [ 2], Batch: [ 100/ 404] | Total Time: 32m 40s
d_loss: 1.3867, g_loss: 45.2872, const_loss: 0.0011, l1_loss: 37.3185, fm_loss: 0.0129, perc_loss: 7.0854, edge: 0.1766
Epoch: [ 2], Batch: [ 200/ 404] | Total Time: 36m 17s
d_loss: 1.3867, g_loss: 45.7551, const_loss: 0.0012, l1_loss: 37.6546, fm_loss: 0.0150, perc_loss: 7.2131, edge: 0.1779
Epoch: [ 2], Batch: [ 300/ 404] | Total Time: 39m 53s
d_loss: 1.3867, g_loss: 43.5341, const_loss: 0.0011, l1_loss: 35.7742, fm_loss: 0.0122, perc_loss: 6.8904, edge: 0.1633
Epoch: [ 2], Batch: [ 400/ 404] | Total Time: 43m 29s
d_loss: 1.3868, g_loss: 46.1071, const_loss: 0.0013, l1_loss: 38.1673, fm_loss: 0.0134, perc_loss: 7.0658, edge: 0.1659
--- End of Epoch 2 --- Time: 872.1s ---
LR Scheduler stepped. Current LR G: 0.000194, LR D: 0.000194
Epoch: [ 3], Batch: [ 0/ 404] | Total Time: 43m 36s
d_loss: 1.3867, g_loss: 44.9142, const_loss: 0.0010, l1_loss: 37.0848, fm_loss: 0.0122, perc_loss: 6.9661, edge: 0.1572
Epoch: [ 3], Batch: [ 100/ 404] | Total Time: 47m 12s
d_loss: 1.3870, g_loss: 44.3752, const_loss: 0.0010, l1_loss: 36.7427, fm_loss: 0.0114, perc_loss: 6.7714, edge: 0.1559
Epoch: [ 3], Batch: [ 200/ 404] | Total Time: 50m 48s
d_loss: 1.3875, g_loss: 44.1641, const_loss: 0.0011, l1_loss: 35.9262, fm_loss: 0.0126, perc_loss: 7.3493, edge: 0.1821
Epoch: [ 3], Batch: [ 300/ 404] | Total Time: 54m 26s
d_loss: 1.3868, g_loss: 44.5830, const_loss: 0.0010, l1_loss: 36.9005, fm_loss: 0.0121, perc_loss: 6.8104, edge: 0.1662
Epoch: [ 3], Batch: [ 400/ 404] | Total Time: 58m 2s
d_loss: 1.3867, g_loss: 45.1217, const_loss: 0.0015, l1_loss: 37.0878, fm_loss: 0.0122, perc_loss: 7.1602, edge: 0.1671
--- End of Epoch 3 --- Time: 873.2s ---
LR Scheduler stepped. Current LR G: 0.000192, LR D: 0.000192
Epoch: [ 4], Batch: [ 0/ 404] | Total Time: 58m 10s
d_loss: 1.3868, g_loss: 46.0366, const_loss: 0.0011, l1_loss: 38.0848, fm_loss: 0.0148, perc_loss: 7.0771, edge: 0.1659
Epoch: [ 4], Batch: [ 100/ 404] | Total Time: 1h 1m 45s
d_loss: 1.3868, g_loss: 45.4340, const_loss: 0.0011, l1_loss: 37.4390, fm_loss: 0.0146, perc_loss: 7.1205, edge: 0.1654
Epoch: [ 4], Batch: [ 200/ 404] | Total Time: 1h 5m 22s
d_loss: 1.3867, g_loss: 44.4487, const_loss: 0.0011, l1_loss: 36.3935, fm_loss: 0.0130, perc_loss: 7.1702, edge: 0.1780
Epoch: [ 4], Batch: [ 300/ 404] | Total Time: 1h 8m 58s
d_loss: 1.3867, g_loss: 44.9224, const_loss: 0.0009, l1_loss: 37.2511, fm_loss: 0.0140, perc_loss: 6.7958, edge: 0.1672
Epoch: [ 4], Batch: [ 400/ 404] | Total Time: 1h 12m 34s
d_loss: 1.3867, g_loss: 44.9970, const_loss: 0.0013, l1_loss: 36.9172, fm_loss: 0.0122, perc_loss: 7.2008, edge: 0.1725
--- End of Epoch 4 --- Time: 872.6s ---
LR Scheduler stepped. Current LR G: 0.000190, LR D: 0.000190
Epoch: [ 5], Batch: [ 0/ 404] | Total Time: 1h 12m 42s
d_loss: 1.3867, g_loss: 44.3606, const_loss: 0.0010, l1_loss: 36.4943, fm_loss: 0.0115, perc_loss: 6.9972, edge: 0.1637
Epoch: [ 5], Batch: [ 100/ 404] | Total Time: 1h 16m 18s
d_loss: 1.3867, g_loss: 44.4744, const_loss: 0.0010, l1_loss: 36.6028, fm_loss: 0.0123, perc_loss: 7.0043, edge: 0.1613
Epoch: [ 5], Batch: [ 200/ 404] | Total Time: 1h 19m 54s
d_loss: 1.3873, g_loss: 43.5559, const_loss: 0.0011, l1_loss: 35.1300, fm_loss: 0.0110, perc_loss: 7.5631, edge: 0.1578
Epoch: [ 5], Batch: [ 300/ 404] | Total Time: 1h 23m 30s
d_loss: 1.3868, g_loss: 45.3212, const_loss: 0.0010, l1_loss: 37.3844, fm_loss: 0.0128, perc_loss: 7.0562, edge: 0.1738
Epoch: [ 5], Batch: [ 400/ 404] | Total Time: 1h 27m 5s
d_loss: 1.3867, g_loss: 46.9075, const_loss: 0.0011, l1_loss: 39.5571, fm_loss: 0.0179, perc_loss: 6.4795, edge: 0.1585
--- End of Epoch 5 --- Time: 871.0s ---
LR Scheduler stepped. Current LR G: 0.000186, LR D: 0.000186
Epoch: [ 6], Batch: [ 0/ 404] | Total Time: 1h 27m 13s
d_loss: 1.3867, g_loss: 44.3281, const_loss: 0.0009, l1_loss: 36.2166, fm_loss: 0.0129, perc_loss: 7.2419, edge: 0.1629
Epoch: [ 6], Batch: [ 100/ 404] | Total Time: 1h 30m 50s
d_loss: 1.3869, g_loss: 43.6126, const_loss: 0.0012, l1_loss: 35.2198, fm_loss: 0.0121, perc_loss: 7.5183, edge: 0.1684
Epoch: [ 6], Batch: [ 200/ 404] | Total Time: 1h 34m 25s
d_loss: 1.3868, g_loss: 45.4476, const_loss: 0.0010, l1_loss: 37.7873, fm_loss: 0.0109, perc_loss: 6.7943, edge: 0.1613
Epoch: [ 6], Batch: [ 300/ 404] | Total Time: 1h 38m 1s
d_loss: 1.3868, g_loss: 44.5072, const_loss: 0.0009, l1_loss: 36.8934, fm_loss: 0.0122, perc_loss: 6.7419, edge: 0.1659
Epoch: [ 6], Batch: [ 400/ 404] | Total Time: 1h 41m 37s
d_loss: 1.3869, g_loss: 45.0587, const_loss: 0.0011, l1_loss: 37.2985, fm_loss: 0.0135, perc_loss: 6.8923, edge: 0.1599
--- End of Epoch 6 --- Time: 871.4s ---
LR Scheduler stepped. Current LR G: 0.000183, LR D: 0.000183
Epoch: [ 7], Batch: [ 0/ 404] | Total Time: 1h 41m 45s
d_loss: 1.3868, g_loss: 44.8877, const_loss: 0.0011, l1_loss: 36.9214, fm_loss: 0.0128, perc_loss: 7.0929, edge: 0.1666
Epoch: [ 7], Batch: [ 100/ 404] | Total Time: 1h 45m 21s
d_loss: 1.3867, g_loss: 44.4234, const_loss: 0.0010, l1_loss: 36.7125, fm_loss: 0.0106, perc_loss: 6.8505, edge: 0.1560
Epoch: [ 7], Batch: [ 200/ 404] | Total Time: 1h 48m 58s
d_loss: 1.3874, g_loss: 44.3885, const_loss: 0.0011, l1_loss: 36.6668, fm_loss: 0.0116, perc_loss: 6.8424, edge: 0.1737
Epoch: [ 7], Batch: [ 300/ 404] | Total Time: 1h 52m 35s
d_loss: 1.3867, g_loss: 44.6368, const_loss: 0.0012, l1_loss: 36.8646, fm_loss: 0.0119, perc_loss: 6.9041, edge: 0.1617
Epoch: [ 7], Batch: [ 400/ 404] | Total Time: 1h 56m 11s
d_loss: 1.3868, g_loss: 45.5685, const_loss: 0.0010, l1_loss: 38.0531, fm_loss: 0.0141, perc_loss: 6.6533, edge: 0.1537
--- End of Epoch 7 --- Time: 873.9s ---
LR Scheduler stepped. Current LR G: 0.000178, LR D: 0.000178
Epoch: [ 8], Batch: [ 0/ 404] | Total Time: 1h 56m 19s
d_loss: 1.3868, g_loss: 44.6128, const_loss: 0.0011, l1_loss: 36.5852, fm_loss: 0.0111, perc_loss: 7.1522, edge: 0.1703
Epoch: [ 8], Batch: [ 100/ 404] | Total Time: 1h 59m 53s
d_loss: 1.3869, g_loss: 43.8111, const_loss: 0.0009, l1_loss: 35.9975, fm_loss: 0.0111, perc_loss: 6.9566, edge: 0.1521
Epoch: [ 8], Batch: [ 200/ 404] | Total Time: 2h 3m 27s
d_loss: 1.3868, g_loss: 43.9031, const_loss: 0.0009, l1_loss: 36.4797, fm_loss: 0.0105, perc_loss: 6.5631, edge: 0.1555
Epoch: [ 8], Batch: [ 300/ 404] | Total Time: 2h 7m 2s
d_loss: 1.3867, g_loss: 45.5977, const_loss: 0.0011, l1_loss: 37.2110, fm_loss: 0.0126, perc_loss: 7.5162, edge: 0.1635
Epoch: [ 8], Batch: [ 400/ 404] | Total Time: 2h 10m 37s
d_loss: 1.3868, g_loss: 44.4373, const_loss: 0.0010, l1_loss: 36.9358, fm_loss: 0.0106, perc_loss: 6.6556, edge: 0.1409
--- End of Epoch 8 --- Time: 865.8s ---
LR Scheduler stepped. Current LR G: 0.000174, LR D: 0.000174
Epoch: [ 9], Batch: [ 0/ 404] | Total Time: 2h 10m 44s
d_loss: 1.3868, g_loss: 44.4088, const_loss: 0.0009, l1_loss: 36.0848, fm_loss: 0.0115, perc_loss: 7.4633, edge: 0.1551
Epoch: [ 9], Batch: [ 100/ 404] | Total Time: 2h 14m 19s
d_loss: 1.3868, g_loss: 45.0316, const_loss: 0.0008, l1_loss: 37.6891, fm_loss: 0.0116, perc_loss: 6.4804, edge: 0.1564
Epoch: [ 9], Batch: [ 200/ 404] | Total Time: 2h 17m 53s
d_loss: 1.3867, g_loss: 43.5775, const_loss: 0.0012, l1_loss: 36.0471, fm_loss: 0.0125, perc_loss: 6.6653, edge: 0.1580
Epoch: [ 9], Batch: [ 300/ 404] | Total Time: 2h 21m 27s
d_loss: 1.3867, g_loss: 44.1039, const_loss: 0.0008, l1_loss: 36.8913, fm_loss: 0.0104, perc_loss: 6.3642, edge: 0.1443
Epoch: [ 9], Batch: [ 400/ 404] | Total Time: 2h 25m 2s
d_loss: 1.3867, g_loss: 45.9449, const_loss: 0.0009, l1_loss: 38.0915, fm_loss: 0.0144, perc_loss: 6.9848, edge: 0.1599
--- End of Epoch 9 --- Time: 865.0s ---
LR Scheduler stepped. Current LR G: 0.000168, LR D: 0.000168
Epoch: [ 10], Batch: [ 0/ 404] | Total Time: 2h 25m 9s
d_loss: 1.3867, g_loss: 44.2300, const_loss: 0.0009, l1_loss: 36.3498, fm_loss: 0.0114, perc_loss: 7.0079, edge: 0.1666
Epoch: [ 10], Batch: [ 100/ 404] | Total Time: 2h 28m 43s
d_loss: 1.3867, g_loss: 43.4775, const_loss: 0.0010, l1_loss: 35.7000, fm_loss: 0.0101, perc_loss: 6.8967, edge: 0.1768
Epoch: [ 10], Batch: [ 200/ 404] | Total Time: 2h 32m 18s
d_loss: 1.3867, g_loss: 44.8078, const_loss: 0.0010, l1_loss: 37.4535, fm_loss: 0.0109, perc_loss: 6.4927, edge: 0.1562
Epoch: [ 10], Batch: [ 300/ 404] | Total Time: 2h 35m 52s
d_loss: 1.3874, g_loss: 43.0131, const_loss: 0.0010, l1_loss: 35.3009, fm_loss: 0.0098, perc_loss: 6.8482, edge: 0.1604
Epoch: [ 10], Batch: [ 400/ 404] | Total Time: 2h 39m 25s
d_loss: 1.3868, g_loss: 43.7888, const_loss: 0.0009, l1_loss: 35.8286, fm_loss: 0.0104, perc_loss: 7.0906, edge: 0.1654
--- End of Epoch 10 --- Time: 863.8s ---
LR Scheduler stepped. Current LR G: 0.000163, LR D: 0.000163
Epoch: [ 11], Batch: [ 0/ 404] | Total Time: 2h 39m 33s
d_loss: 1.3868, g_loss: 43.2763, const_loss: 0.0008, l1_loss: 35.4838, fm_loss: 0.0099, perc_loss: 6.9224, edge: 0.1666
Epoch: [ 11], Batch: [ 100/ 404] | Total Time: 2h 43m 8s
d_loss: 1.3868, g_loss: 43.1871, const_loss: 0.0009, l1_loss: 35.2194, fm_loss: 0.0107, perc_loss: 7.1065, edge: 0.1567
Epoch: [ 11], Batch: [ 200/ 404] | Total Time: 2h 46m 42s
d_loss: 1.3870, g_loss: 43.9813, const_loss: 0.0011, l1_loss: 35.8540, fm_loss: 0.0104, perc_loss: 7.2436, edge: 0.1793
Epoch: [ 11], Batch: [ 300/ 404] | Total Time: 2h 50m 16s
d_loss: 1.3868, g_loss: 44.4219, const_loss: 0.0009, l1_loss: 36.8481, fm_loss: 0.0108, perc_loss: 6.7041, edge: 0.1646
Epoch: [ 11], Batch: [ 400/ 404] | Total Time: 2h 53m 50s
d_loss: 1.3870, g_loss: 43.8880, const_loss: 0.0009, l1_loss: 36.2121, fm_loss: 0.0110, perc_loss: 6.8092, edge: 0.1615
--- End of Epoch 11 --- Time: 865.0s ---
LR Scheduler stepped. Current LR G: 0.000157, LR D: 0.000157
Epoch: [ 12], Batch: [ 0/ 404] | Total Time: 2h 53m 58s
d_loss: 1.3868, g_loss: 44.5716, const_loss: 0.0009, l1_loss: 37.2838, fm_loss: 0.0107, perc_loss: 6.4234, edge: 0.1599
Epoch: [ 12], Batch: [ 100/ 404] | Total Time: 2h 57m 32s
d_loss: 1.3871, g_loss: 44.5541, const_loss: 0.0009, l1_loss: 37.1393, fm_loss: 0.0097, perc_loss: 6.5558, edge: 0.1554
Epoch: [ 12], Batch: [ 200/ 404] | Total Time: 3h 1m 7s
d_loss: 1.3868, g_loss: 43.3464, const_loss: 0.0009, l1_loss: 36.1745, fm_loss: 0.0107, perc_loss: 6.3053, edge: 0.1621
Epoch: [ 12], Batch: [ 300/ 404] | Total Time: 3h 4m 41s
d_loss: 1.3868, g_loss: 44.1530, const_loss: 0.0009, l1_loss: 36.1407, fm_loss: 0.0115, perc_loss: 7.1293, edge: 0.1777
Epoch: [ 12], Batch: [ 400/ 404] | Total Time: 3h 8m 15s
d_loss: 1.3869, g_loss: 44.1668, const_loss: 0.0010, l1_loss: 35.9512, fm_loss: 0.0126, perc_loss: 7.3299, edge: 0.1788
--- End of Epoch 12 --- Time: 864.3s ---
LR Scheduler stepped. Current LR G: 0.000150, LR D: 0.000150
Epoch: [ 13], Batch: [ 0/ 404] | Total Time: 3h 8m 22s
d_loss: 1.3872, g_loss: 46.1620, const_loss: 0.0013, l1_loss: 39.0847, fm_loss: 0.0113, perc_loss: 6.2308, edge: 0.1406
Epoch: [ 13], Batch: [ 100/ 404] | Total Time: 3h 11m 56s
d_loss: 1.3868, g_loss: 45.1733, const_loss: 0.0012, l1_loss: 37.8244, fm_loss: 0.0140, perc_loss: 6.4814, edge: 0.1590
Epoch: [ 13], Batch: [ 200/ 404] | Total Time: 3h 15m 30s
d_loss: 1.3868, g_loss: 44.8204, const_loss: 0.0013, l1_loss: 37.5940, fm_loss: 0.0112, perc_loss: 6.3712, edge: 0.1499
Epoch: [ 13], Batch: [ 300/ 404] | Total Time: 3h 19m 4s
d_loss: 1.3867, g_loss: 43.7608, const_loss: 0.0009, l1_loss: 36.2835, fm_loss: 0.0101, perc_loss: 6.6136, edge: 0.1599
Epoch: [ 13], Batch: [ 400/ 404] | Total Time: 3h 22m 38s
d_loss: 1.3868, g_loss: 42.9998, const_loss: 0.0009, l1_loss: 35.5083, fm_loss: 0.0092, perc_loss: 6.6265, edge: 0.1621
--- End of Epoch 13 --- Time: 863.6s ---
LR Scheduler stepped. Current LR G: 0.000143, LR D: 0.000143
Epoch: [ 14], Batch: [ 0/ 404] | Total Time: 3h 22m 46s
d_loss: 1.3869, g_loss: 44.0972, const_loss: 0.0009, l1_loss: 36.9165, fm_loss: 0.0116, perc_loss: 6.3221, edge: 0.1532
Epoch: [ 14], Batch: [ 100/ 404] | Total Time: 3h 26m 20s
d_loss: 1.3868, g_loss: 45.0419, const_loss: 0.0016, l1_loss: 37.6077, fm_loss: 0.0117, perc_loss: 6.5715, edge: 0.1560
Epoch: [ 14], Batch: [ 200/ 404] | Total Time: 3h 29m 54s
d_loss: 1.3871, g_loss: 43.3921, const_loss: 0.0008, l1_loss: 36.1966, fm_loss: 0.0101, perc_loss: 6.3448, edge: 0.1468
Epoch: [ 14], Batch: [ 300/ 404] | Total Time: 3h 33m 28s
d_loss: 1.3868, g_loss: 43.7011, const_loss: 0.0012, l1_loss: 36.2865, fm_loss: 0.0107, perc_loss: 6.5633, edge: 0.1465
Epoch: [ 14], Batch: [ 400/ 404] | Total Time: 3h 37m 2s
d_loss: 1.3867, g_loss: 43.7496, const_loss: 0.0009, l1_loss: 36.2420, fm_loss: 0.0108, perc_loss: 6.6418, edge: 0.1613
--- End of Epoch 14 --- Time: 864.0s ---
LR Scheduler stepped. Current LR G: 0.000137, LR D: 0.000137
Epoch: [ 15], Batch: [ 0/ 404] | Total Time: 3h 37m 10s
d_loss: 1.3868, g_loss: 43.0552, const_loss: 0.0010, l1_loss: 35.3368, fm_loss: 0.0094, perc_loss: 6.8609, edge: 0.1542
Epoch: [ 15], Batch: [ 100/ 404] | Total Time: 3h 40m 44s
d_loss: 1.3867, g_loss: 43.4631, const_loss: 0.0010, l1_loss: 36.2813, fm_loss: 0.0092, perc_loss: 6.3273, edge: 0.1509
Epoch: [ 15], Batch: [ 200/ 404] | Total Time: 3h 44m 18s
d_loss: 1.3867, g_loss: 44.2923, const_loss: 0.0007, l1_loss: 37.0083, fm_loss: 0.0104, perc_loss: 6.4229, edge: 0.1565
Epoch: [ 15], Batch: [ 300/ 404] | Total Time: 3h 47m 52s
d_loss: 1.3867, g_loss: 42.7612, const_loss: 0.0011, l1_loss: 34.9463, fm_loss: 0.0102, perc_loss: 6.9497, edge: 0.1604
Epoch: [ 15], Batch: [ 400/ 404] | Total Time: 3h 51m 26s
d_loss: 1.3867, g_loss: 43.4562, const_loss: 0.0010, l1_loss: 36.0089, fm_loss: 0.0082, perc_loss: 6.5816, edge: 0.1632
--- End of Epoch 15 --- Time: 863.6s ---
LR Scheduler stepped. Current LR G: 0.000129, LR D: 0.000129
Epoch: [ 16], Batch: [ 0/ 404] | Total Time: 3h 51m 34s
d_loss: 1.3868, g_loss: 44.3548, const_loss: 0.0011, l1_loss: 36.5225, fm_loss: 0.0098, perc_loss: 6.9673, edge: 0.1607
Epoch: [ 16], Batch: [ 100/ 404] | Total Time: 3h 55m 8s
d_loss: 1.3868, g_loss: 43.4400, const_loss: 0.0010, l1_loss: 36.1392, fm_loss: 0.0097, perc_loss: 6.4424, edge: 0.1543
Epoch: [ 16], Batch: [ 200/ 404] | Total Time: 3h 58m 42s
d_loss: 1.3867, g_loss: 43.6544, const_loss: 0.0009, l1_loss: 36.4642, fm_loss: 0.0087, perc_loss: 6.3299, edge: 0.1572
Epoch: [ 16], Batch: [ 300/ 404] | Total Time: 4h 2m 16s
d_loss: 1.3870, g_loss: 43.0613, const_loss: 0.0011, l1_loss: 35.7108, fm_loss: 0.0093, perc_loss: 6.5011, edge: 0.1457
Epoch: [ 16], Batch: [ 400/ 404] | Total Time: 4h 5m 50s
d_loss: 1.3870, g_loss: 43.8899, const_loss: 0.0010, l1_loss: 36.5445, fm_loss: 0.0092, perc_loss: 6.4875, edge: 0.1543
--- End of Epoch 16 --- Time: 864.2s ---
LR Scheduler stepped. Current LR G: 0.000122, LR D: 0.000122
Epoch: [ 17], Batch: [ 0/ 404] | Total Time: 4h 5m 58s
d_loss: 1.3873, g_loss: 43.3187, const_loss: 0.0009, l1_loss: 35.8654, fm_loss: 0.0084, perc_loss: 6.5850, edge: 0.1656
Epoch: [ 17], Batch: [ 100/ 404] | Total Time: 4h 9m 31s
d_loss: 1.3869, g_loss: 44.5635, const_loss: 0.0009, l1_loss: 37.3238, fm_loss: 0.0096, perc_loss: 6.3751, edge: 0.1607