(StreetFighterAI) PS C:\Users\unitec\Documents\AIProjects\street-fighter-ai> python .\train_cv_sf2_ai.py Using cuda device Current state: Champion.Level8.ChunLiVsBlanka ------------------------------ | time/ | | | fps | 186 | | iterations | 1 | | time_elapsed | 115 | | total_timesteps | 21600 | ------------------------------ Current state: Champion.Level12.ChunLiVsBison ------------------------------------------ | time/ | | | fps | 65 | | iterations | 2 | | time_elapsed | 655 | | total_timesteps | 43200 | | train/ | | | approx_kl | 0.0053780936 | | clip_fraction | 0.0431 | | clip_range | 0.2 | | entropy_loss | -8.31 | | explained_variance | 2.93e-05 | | learning_rate | 0.0003 | | loss | 166 | | n_updates | 10 | | policy_gradient_loss | -0.0016 | | value_loss | 92 | ------------------------------------------ Current state: Champion.Level6.ChunLiVsRyu ----------------------------------------- | time/ | | | fps | 54 | | iterations | 3 | | time_elapsed | 1196 | | total_timesteps | 64800 | | train/ | | | approx_kl | 0.005385526 | | clip_fraction | 0.0472 | | clip_range | 0.2 | | entropy_loss | -8.31 | | explained_variance | -0.00129 | | learning_rate | 0.0003 | | loss | 0.0349 | | n_updates | 20 | | policy_gradient_loss | -0.000679 | | value_loss | 58.4 | ----------------------------------------- Current state: Champion.Level10.ChunLiVsVega ----------------------------------------- | time/ | | | fps | 49 | | iterations | 4 | | time_elapsed | 1736 | | total_timesteps | 86400 | | train/ | | | approx_kl | 0.005108807 | | clip_fraction | 0.0236 | | clip_range | 0.2 | | entropy_loss | -8.3 | | explained_variance | 0.000588 | | learning_rate | 0.0003 | | loss | 0.236 | | n_updates | 30 | | policy_gradient_loss | -0.00157 | | value_loss | 82.7 | ----------------------------------------- Current state: Champion.Level12.ChunLiVsBison ------------------------------------------ | time/ | | | fps | 47 | | iterations | 5 | | time_elapsed | 2274 | | total_timesteps | 108000 | | train/ | | | approx_kl | 0.0060475296 | | clip_fraction | 0.054 | | clip_range | 0.2 | | entropy_loss | -8.3 | | explained_variance | 0.00555 | | learning_rate | 0.0003 | | loss | 0.536 | | n_updates | 40 | | policy_gradient_loss | -0.000733 | | value_loss | 40.5 | ------------------------------------------ Current state: Champion.Level4.ChunLiVsZangief ------------------------------------------ | time/ | | | fps | 46 | | iterations | 6 | | time_elapsed | 2811 | | total_timesteps | 129600 | | train/ | | | approx_kl | 0.0059517785 | | clip_fraction | 0.0546 | | clip_range | 0.2 | | entropy_loss | -8.29 | | explained_variance | 0.0188 | | learning_rate | 0.0003 | | loss | 7.26 | | n_updates | 50 | | policy_gradient_loss | -0.00102 | | value_loss | 21.8 | ------------------------------------------ Current state: Champion.Level7.ChunLiVsEHonda ------------------------------------------ | time/ | | | fps | 45 | | iterations | 7 | | time_elapsed | 3348 | | total_timesteps | 151200 | | train/ | | | approx_kl | 0.0057667145 | | clip_fraction | 0.0337 | | clip_range | 0.2 | | entropy_loss | -8.29 | | explained_variance | 0.0069 | | learning_rate | 0.0003 | | loss | 0.832 | | n_updates | 60 | | policy_gradient_loss | -0.00133 | | value_loss | 36.7 | ------------------------------------------ Current state: Champion.Level8.ChunLiVsBlanka ------------------------------------------ | time/ | | | fps | 44 | | iterations | 8 | | time_elapsed | 3883 | | total_timesteps | 172800 | | train/ | | | approx_kl | 0.0047547054 | | clip_fraction | 0.0291 | | clip_range | 0.2 | | entropy_loss | -8.29 | | explained_variance | 0.0128 | | learning_rate | 0.0003 | | loss | 0.424 | | n_updates | 70 | | policy_gradient_loss | -0.00186 | | value_loss | 21.2 | ------------------------------------------ Current state: Champion.Level8.ChunLiVsBlanka ------------------------------------------ | time/ | | | fps | 43 | | iterations | 9 | | time_elapsed | 4422 | | total_timesteps | 194400 | | train/ | | | approx_kl | 0.0063244957 | | clip_fraction | 0.049 | | clip_range | 0.2 | | entropy_loss | -8.28 | | explained_variance | 0.00417 | | learning_rate | 0.0003 | | loss | 0.146 | | n_updates | 80 | | policy_gradient_loss | -0.00167 | | value_loss | 17 | ------------------------------------------ Current state: Champion.Level8.ChunLiVsBlanka ----------------------------------------- | time/ | | | fps | 43 | | iterations | 10 | | time_elapsed | 4960 | | total_timesteps | 216000 | | train/ | | | approx_kl | 0.008022586 | | clip_fraction | 0.0632 | | clip_range | 0.2 | | entropy_loss | -8.29 | | explained_variance | 0.0241 | | learning_rate | 0.0003 | | loss | 0.902 | | n_updates | 90 | | policy_gradient_loss | -0.00295 | | value_loss | 13.5 | ----------------------------------------- Current state: Champion.Level10.ChunLiVsVega ----------------------------------------- | time/ | | | fps | 43 | | iterations | 11 | | time_elapsed | 5499 | | total_timesteps | 237600 | | train/ | | | approx_kl | 0.006470734 | | clip_fraction | 0.0596 | | clip_range | 0.2 | | entropy_loss | -8.3 | | explained_variance | 0.0611 | | learning_rate | 0.0003 | | loss | 5.72 | | n_updates | 100 | | policy_gradient_loss | -0.000976 | | value_loss | 8.5 | ----------------------------------------- Current state: Champion.Level7.ChunLiVsEHonda ---------------------------------------- | time/ | | | fps | 42 | | iterations | 12 | | time_elapsed | 6040 | | total_timesteps | 259200 | | train/ | | | approx_kl | 0.00540813 | | clip_fraction | 0.0547 | | clip_range | 0.2 | | entropy_loss | -8.29 | | explained_variance | -0.0271 | | learning_rate | 0.0003 | | loss | 0.75 | | n_updates | 110 | | policy_gradient_loss | -0.00104 | | value_loss | 9.12 | ---------------------------------------- Current state: Champion.Level8.ChunLiVsBlanka --------------------------------------- | time/ | | | fps | 42 | | iterations | 13 | | time_elapsed | 6582 | | total_timesteps | 280800 | | train/ | | | approx_kl | 0.0058568 | | clip_fraction | 0.0608 | | clip_range | 0.2 | | entropy_loss | -8.29 | | explained_variance | 0.0277 | | learning_rate | 0.0003 | | loss | 0.256 | | n_updates | 120 | | policy_gradient_loss | -0.00284 | | value_loss | 6.99 | --------------------------------------- Current state: Champion.Level2.ChunLiVsKen ------------------------------------------ | time/ | | | fps | 42 | | iterations | 14 | | time_elapsed | 7126 | | total_timesteps | 302400 | | train/ | | | approx_kl | 0.0066813217 | | clip_fraction | 0.0554 | | clip_range | 0.2 | | entropy_loss | -8.3 | | explained_variance | 0.0689 | | learning_rate | 0.0003 | | loss | 0.504 | | n_updates | 130 | | policy_gradient_loss | -0.00243 | | value_loss | 9.48 | ------------------------------------------ Current state: Champion.Level8.ChunLiVsBlanka ------------------------------------------ | time/ | | | fps | 42 | | iterations | 15 | | time_elapsed | 7670 | | total_timesteps | 324000 | | train/ | | | approx_kl | 0.0069995625 | | clip_fraction | 0.0637 | | clip_range | 0.2 | | entropy_loss | -8.3 | | explained_variance | -0.0336 | | learning_rate | 0.0003 | | loss | -0.000532 | | n_updates | 140 | | policy_gradient_loss | -0.00198 | | value_loss | 9.39 | ------------------------------------------