chris/street-fighter-ai
1
0
Fork 0
mirror of https://github.com/linyiLYi/street-fighter-ai.git synced 2025-04-25 07:00:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
a3ede7dd30
street-fighter-ai/main/trained_models/training_log.txt

18555 lines
750 KiB
Plaintext
Raw Normal View History

SF2 final round conquered. Successfully trained a model (main/trained_models/) that crushes the final round of Street Fighter II Special Champion Edition.
2023-04-05 13:39:08 +00:00
Logging to logs\PPO_1
---------------------------------
| rollout/ | |
| ep_len_mean | 174 |
| ep_rew_mean | -0.0647 |
| time/ | |
| fps | 1087 |
| iterations | 1 |
| time_elapsed | 7 |
| total_timesteps | 8192 |
---------------------------------
-------------------------------------------
| rollout/ | |
| ep_len_mean | 179 |
| ep_rew_mean | -0.067 |
| time/ | |
| fps | 1034 |
| iterations | 2 |
| time_elapsed | 15 |
| total_timesteps | 16384 |
| train/ | |
| approx_kl | 0.00053383934 |
| clip_fraction | 0.00125 |
| clip_range | 0.15 |
| entropy_loss | -8.32 |
| explained_variance | -9.76 |
| learning_rate | 0.00025 |
| loss | -0.00272 |
| n_updates | 4 |
| policy_gradient_loss | -0.000604 |
| value_loss | 0.256 |
-------------------------------------------
------------------------------------------
| rollout/ | |
| ep_len_mean | 192 |
| ep_rew_mean | -0.0558 |
| time/ | |
| fps | 1040 |
| iterations | 3 |
| time_elapsed | 23 |
| total_timesteps | 24576 |
| train/ | |
| approx_kl | 0.0037626293 |
| clip_fraction | 0.0411 |
| clip_range | 0.15 |
| entropy_loss | -8.31 |
| explained_variance | -0.627 |
| learning_rate | 0.00025 |
| loss | -0.0254 |
| n_updates | 8 |
| policy_gradient_loss | -0.00986 |
| value_loss | 0.0012 |
------------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 198 |
| ep_rew_mean | -0.0369 |
| time/ | |
| fps | 1045 |
| iterations | 4 |
| time_elapsed | 31 |
| total_timesteps | 32768 |
| train/ | |
| approx_kl | 0.007358143 |
| clip_fraction | 0.121 |
| clip_range | 0.15 |
| entropy_loss | -8.31 |
| explained_variance | -1.67 |
| learning_rate | 0.00025 |
| loss | -0.0446 |
| n_updates | 12 |
| policy_gradient_loss | -0.0212 |
| value_loss | 0.00197 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 199 |
| ep_rew_mean | -0.0253 |
| time/ | |
| fps | 1048 |
| iterations | 5 |
| time_elapsed | 39 |
| total_timesteps | 40960 |
| train/ | |
| approx_kl | 0.009054327 |
| clip_fraction | 0.185 |
| clip_range | 0.15 |
| entropy_loss | -8.3 |
| explained_variance | -2.35 |
| learning_rate | 0.00025 |
| loss | -0.0551 |
| n_updates | 16 |
| policy_gradient_loss | -0.0281 |
| value_loss | 0.0018 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 202 |
| ep_rew_mean | -0.0247 |
| time/ | |
| fps | 1046 |
| iterations | 6 |
| time_elapsed | 46 |
| total_timesteps | 49152 |
| train/ | |
| approx_kl | 0.010547362 |
| clip_fraction | 0.22 |
| clip_range | 0.15 |
| entropy_loss | -8.29 |
| explained_variance | -1.96 |
| learning_rate | 0.00025 |
| loss | -0.0628 |
| n_updates | 20 |
| policy_gradient_loss | -0.0308 |
| value_loss | 0.00197 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 196 |
| ep_rew_mean | -0.0456 |
| time/ | |
| fps | 1043 |
| iterations | 7 |
| time_elapsed | 54 |
| total_timesteps | 57344 |
| train/ | |
| approx_kl | 0.010614461 |
| clip_fraction | 0.223 |
| clip_range | 0.15 |
| entropy_loss | -8.28 |
| explained_variance | -2.08 |
| learning_rate | 0.00025 |
| loss | -0.0685 |
| n_updates | 24 |
| policy_gradient_loss | -0.0333 |
| value_loss | 0.00176 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 200 |
| ep_rew_mean | -0.039 |
| time/ | |
| fps | 1045 |
| iterations | 8 |
| time_elapsed | 62 |
| total_timesteps | 65536 |
| train/ | |
| approx_kl | 0.013299786 |
| clip_fraction | 0.252 |
| clip_range | 0.15 |
| entropy_loss | -8.27 |
| explained_variance | -1.53 |
| learning_rate | 0.00025 |
| loss | -0.0662 |
| n_updates | 28 |
| policy_gradient_loss | -0.0366 |
| value_loss | 0.00158 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 190 |
| ep_rew_mean | -0.0768 |
| time/ | |
| fps | 1052 |
| iterations | 9 |
| time_elapsed | 70 |
| total_timesteps | 73728 |
| train/ | |
| approx_kl | 0.013322118 |
| clip_fraction | 0.266 |
| clip_range | 0.15 |
| entropy_loss | -8.27 |
| explained_variance | -1.51 |
| learning_rate | 0.00025 |
| loss | -0.0729 |
| n_updates | 32 |
| policy_gradient_loss | -0.0384 |
| value_loss | 0.00153 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 192 |
| ep_rew_mean | -0.0579 |
| time/ | |
| fps | 1054 |
| iterations | 10 |
| time_elapsed | 77 |
| total_timesteps | 81920 |
| train/ | |
| approx_kl | 0.013874512 |
| clip_fraction | 0.282 |
| clip_range | 0.15 |
| entropy_loss | -8.26 |
| explained_variance | -1.19 |
| learning_rate | 0.00025 |
| loss | -0.0734 |
| n_updates | 36 |
| policy_gradient_loss | -0.0395 |
| value_loss | 0.00164 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 191 |
| ep_rew_mean | -0.0485 |
| time/ | |
| fps | 1054 |
| iterations | 11 |
| time_elapsed | 85 |
| total_timesteps | 90112 |
| train/ | |
| approx_kl | 0.014529864 |
| clip_fraction | 0.275 |
| clip_range | 0.15 |
| entropy_loss | -8.26 |
| explained_variance | -1.31 |
| learning_rate | 0.00025 |
| loss | -0.0746 |
| n_updates | 40 |
| policy_gradient_loss | -0.0408 |
| value_loss | 0.00152 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 188 |
| ep_rew_mean | -0.0494 |
| time/ | |
| fps | 1057 |
| iterations | 12 |
| time_elapsed | 93 |
| total_timesteps | 98304 |
| train/ | |
| approx_kl | 0.0178392 |
| clip_fraction | 0.302 |
| clip_range | 0.15 |
| entropy_loss | -8.24 |
| explained_variance | -1.18 |
| learning_rate | 0.00025 |
| loss | -0.0763 |
| n_updates | 44 |
| policy_gradient_loss | -0.0421 |
| value_loss | 0.00155 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 194 |
| ep_rew_mean | -0.0331 |
| time/ | |
| fps | 1055 |
| iterations | 13 |
| time_elapsed | 100 |
| total_timesteps | 106496 |
| train/ | |
| approx_kl | 0.017949063 |
| clip_fraction | 0.314 |
| clip_range | 0.15 |
| entropy_loss | -8.23 |
| explained_variance | -0.914 |
| learning_rate | 0.00025 |
| loss | -0.0767 |
| n_updates | 48 |
| policy_gradient_loss | -0.0445 |
| value_loss | 0.00161 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 197 |
| ep_rew_mean | -0.0246 |
| time/ | |
| fps | 1056 |
| iterations | 14 |
| time_elapsed | 108 |
| total_timesteps | 114688 |
| train/ | |
| approx_kl | 0.01733292 |
| clip_fraction | 0.329 |
| clip_range | 0.15 |
| entropy_loss | -8.23 |
| explained_variance | -1.2 |
| learning_rate | 0.00025 |
| loss | -0.0848 |
| n_updates | 52 |
| policy_gradient_loss | -0.0434 |
| value_loss | 0.00128 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 199 |
| ep_rew_mean | -0.0305 |
| time/ | |
| fps | 1056 |
| iterations | 15 |
| time_elapsed | 116 |
| total_timesteps | 122880 |
| train/ | |
| approx_kl | 0.018736638 |
| clip_fraction | 0.328 |
| clip_range | 0.15 |
| entropy_loss | -8.22 |
| explained_variance | -0.864 |
| learning_rate | 0.00025 |
| loss | -0.077 |
| n_updates | 56 |
| policy_gradient_loss | -0.0443 |
| value_loss | 0.00131 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 197 |
| ep_rew_mean | -0.0437 |
| time/ | |
| fps | 1056 |
| iterations | 16 |
| time_elapsed | 124 |
| total_timesteps | 131072 |
| train/ | |
| approx_kl | 0.021857463 |
| clip_fraction | 0.33 |
| clip_range | 0.15 |
| entropy_loss | -8.22 |
| explained_variance | -0.844 |
| learning_rate | 0.00025 |
| loss | -0.0745 |
| n_updates | 60 |
| policy_gradient_loss | -0.0446 |
| value_loss | 0.0013 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 199 |
| ep_rew_mean | -0.0267 |
| time/ | |
| fps | 1058 |
| iterations | 17 |
| time_elapsed | 131 |
| total_timesteps | 139264 |
| train/ | |
| approx_kl | 0.020751465 |
| clip_fraction | 0.331 |
| clip_range | 0.15 |
| entropy_loss | -8.21 |
| explained_variance | -0.936 |
| learning_rate | 0.00025 |
| loss | -0.0813 |
| n_updates | 64 |
| policy_gradient_loss | -0.0463 |
| value_loss | 0.00119 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 187 |
| ep_rew_mean | -0.056 |
| time/ | |
| fps | 1059 |
| iterations | 18 |
| time_elapsed | 139 |
| total_timesteps | 147456 |
| train/ | |
| approx_kl | 0.020477628 |
| clip_fraction | 0.349 |
| clip_range | 0.15 |
| entropy_loss | -8.2 |
| explained_variance | -0.762 |
| learning_rate | 0.00025 |
| loss | -0.0823 |
| n_updates | 68 |
| policy_gradient_loss | -0.0439 |
| value_loss | 0.00118 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 186 |
| ep_rew_mean | -0.0556 |
| time/ | |
| fps | 1062 |
| iterations | 19 |
| time_elapsed | 146 |
| total_timesteps | 155648 |
| train/ | |
| approx_kl | 0.022180352 |
| clip_fraction | 0.363 |
| clip_range | 0.15 |
| entropy_loss | -8.19 |
| explained_variance | -0.655 |
| learning_rate | 0.00025 |
| loss | -0.0794 |
| n_updates | 72 |
| policy_gradient_loss | -0.0428 |
| value_loss | 0.00114 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 196 |
| ep_rew_mean | -0.0354 |
| time/ | |
| fps | 1064 |
| iterations | 20 |
| time_elapsed | 153 |
| total_timesteps | 163840 |
| train/ | |
| approx_kl | 0.021395119 |
| clip_fraction | 0.348 |
| clip_range | 0.15 |
| entropy_loss | -8.2 |
| explained_variance | -0.451 |
| learning_rate | 0.00025 |
| loss | -0.0805 |
| n_updates | 76 |
| policy_gradient_loss | -0.043 |
| value_loss | 0.00116 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 192 |
| ep_rew_mean | -0.0657 |
| time/ | |
| fps | 1067 |
| iterations | 21 |
| time_elapsed | 161 |
| total_timesteps | 172032 |
| train/ | |
| approx_kl | 0.022942461 |
| clip_fraction | 0.35 |
| clip_range | 0.15 |
| entropy_loss | -8.19 |
| explained_variance | -0.458 |
| learning_rate | 0.00025 |
| loss | -0.0818 |
| n_updates | 80 |
| policy_gradient_loss | -0.0476 |
| value_loss | 0.000972 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 190 |
| ep_rew_mean | -0.0618 |
| time/ | |
| fps | 1069 |
| iterations | 22 |
| time_elapsed | 168 |
| total_timesteps | 180224 |
| train/ | |
| approx_kl | 0.02387139 |
| clip_fraction | 0.35 |
| clip_range | 0.15 |
| entropy_loss | -8.18 |
| explained_variance | -0.317 |
| learning_rate | 0.00025 |
| loss | -0.0754 |
| n_updates | 84 |
| policy_gradient_loss | -0.0438 |
| value_loss | 0.00105 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 189 |
| ep_rew_mean | -0.0452 |
| time/ | |
| fps | 1071 |
| iterations | 23 |
| time_elapsed | 175 |
| total_timesteps | 188416 |
| train/ | |
| approx_kl | 0.022812603 |
| clip_fraction | 0.348 |
| clip_range | 0.15 |
| entropy_loss | -8.18 |
| explained_variance | -0.459 |
| learning_rate | 0.00025 |
| loss | -0.0818 |
| n_updates | 88 |
| policy_gradient_loss | -0.0473 |
| value_loss | 0.000877 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 196 |
| ep_rew_mean | -0.0406 |
| time/ | |
| fps | 1072 |
| iterations | 24 |
| time_elapsed | 183 |
| total_timesteps | 196608 |
| train/ | |
| approx_kl | 0.024460688 |
| clip_fraction | 0.351 |
| clip_range | 0.15 |
| entropy_loss | -8.18 |
| explained_variance | -0.304 |
| learning_rate | 0.00025 |
| loss | -0.0792 |
| n_updates | 92 |
| policy_gradient_loss | -0.0465 |
| value_loss | 0.000971 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 206 |
| ep_rew_mean | -0.0107 |
| time/ | |
| fps | 1073 |
| iterations | 25 |
| time_elapsed | 190 |
| total_timesteps | 204800 |
| train/ | |
| approx_kl | 0.02544355 |
| clip_fraction | 0.377 |
| clip_range | 0.15 |
| entropy_loss | -8.17 |
| explained_variance | -0.459 |
| learning_rate | 0.00025 |
| loss | -0.0787 |
| n_updates | 96 |
| policy_gradient_loss | -0.0475 |
| value_loss | 0.000872 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 205 |
| ep_rew_mean | -0.00389 |
| time/ | |
| fps | 1073 |
| iterations | 26 |
| time_elapsed | 198 |
| total_timesteps | 212992 |
| train/ | |
| approx_kl | 0.02552393 |
| clip_fraction | 0.377 |
| clip_range | 0.15 |
| entropy_loss | -8.16 |
| explained_variance | -0.39 |
| learning_rate | 0.000249 |
| loss | -0.0795 |
| n_updates | 100 |
| policy_gradient_loss | -0.0452 |
| value_loss | 0.000865 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 199 |
| ep_rew_mean | -0.0245 |
| time/ | |
| fps | 1074 |
| iterations | 27 |
| time_elapsed | 205 |
| total_timesteps | 221184 |
| train/ | |
| approx_kl | 0.025224393 |
| clip_fraction | 0.37 |
| clip_range | 0.15 |
| entropy_loss | -8.16 |
| explained_variance | -0.448 |
| learning_rate | 0.000249 |
| loss | -0.0854 |
| n_updates | 104 |
| policy_gradient_loss | -0.0464 |
| value_loss | 0.000939 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 201 |
| ep_rew_mean | -0.0211 |
| time/ | |
| fps | 1076 |
| iterations | 28 |
| time_elapsed | 212 |
| total_timesteps | 229376 |
| train/ | |
| approx_kl | 0.026964266 |
| clip_fraction | 0.392 |
| clip_range | 0.15 |
| entropy_loss | -8.15 |
| explained_variance | -0.315 |
| learning_rate | 0.000249 |
| loss | -0.081 |
| n_updates | 108 |
| policy_gradient_loss | -0.0466 |
| value_loss | 0.000904 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 209 |
| ep_rew_mean | -0.0132 |
| time/ | |
| fps | 1077 |
| iterations | 29 |
| time_elapsed | 220 |
| total_timesteps | 237568 |
| train/ | |
| approx_kl | 0.026146878 |
| clip_fraction | 0.376 |
| clip_range | 0.15 |
| entropy_loss | -8.15 |
| explained_variance | -0.265 |
| learning_rate | 0.000249 |
| loss | -0.0774 |
| n_updates | 112 |
| policy_gradient_loss | -0.0475 |
| value_loss | 0.000817 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 200 |
| ep_rew_mean | -0.0276 |
| time/ | |
| fps | 1077 |
| iterations | 30 |
| time_elapsed | 228 |
| total_timesteps | 245760 |
| train/ | |
| approx_kl | 0.026943514 |
| clip_fraction | 0.369 |
| clip_range | 0.15 |
| entropy_loss | -8.15 |
| explained_variance | -0.225 |
| learning_rate | 0.000249 |
| loss | -0.0765 |
| n_updates | 116 |
| policy_gradient_loss | -0.0466 |
| value_loss | 0.000774 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 195 |
| ep_rew_mean | -0.0262 |
| time/ | |
| fps | 1077 |
| iterations | 31 |
| time_elapsed | 235 |
| total_timesteps | 253952 |
| train/ | |
| approx_kl | 0.025579238 |
| clip_fraction | 0.368 |
| clip_range | 0.15 |
| entropy_loss | -8.13 |
| explained_variance | -0.139 |
| learning_rate | 0.000249 |
| loss | -0.0823 |
| n_updates | 120 |
| policy_gradient_loss | -0.0465 |
| value_loss | 0.000845 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 201 |
| ep_rew_mean | 0.00702 |
| time/ | |
| fps | 1078 |
| iterations | 32 |
| time_elapsed | 243 |
| total_timesteps | 262144 |
| train/ | |
| approx_kl | 0.028000984 |
| clip_fraction | 0.389 |
| clip_range | 0.15 |
| entropy_loss | -8.12 |
| explained_variance | -0.202 |
| learning_rate | 0.000249 |
| loss | -0.0782 |
| n_updates | 124 |
| policy_gradient_loss | -0.0471 |
| value_loss | 0.000711 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 211 |
| ep_rew_mean | 0.0106 |
| time/ | |
| fps | 1079 |
| iterations | 33 |
| time_elapsed | 250 |
| total_timesteps | 270336 |
| train/ | |
| approx_kl | 0.030560931 |
| clip_fraction | 0.395 |
| clip_range | 0.15 |
| entropy_loss | -8.1 |
| explained_variance | -0.211 |
| learning_rate | 0.000249 |
| loss | -0.0817 |
| n_updates | 128 |
| policy_gradient_loss | -0.046 |
| value_loss | 0.000771 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 211 |
| ep_rew_mean | 0.0104 |
| time/ | |
| fps | 1079 |
| iterations | 34 |
| time_elapsed | 257 |
| total_timesteps | 278528 |
| train/ | |
| approx_kl | 0.029904656 |
| clip_fraction | 0.381 |
| clip_range | 0.15 |
| entropy_loss | -8.09 |
| explained_variance | -0.197 |
| learning_rate | 0.000249 |
| loss | -0.0792 |
| n_updates | 132 |
| policy_gradient_loss | -0.0467 |
| value_loss | 0.00069 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 209 |
| ep_rew_mean | 0.0087 |
| time/ | |
| fps | 1080 |
| iterations | 35 |
| time_elapsed | 265 |
| total_timesteps | 286720 |
| train/ | |
| approx_kl | 0.03322889 |
| clip_fraction | 0.419 |
| clip_range | 0.15 |
| entropy_loss | -8.07 |
| explained_variance | -0.0905 |
| learning_rate | 0.000249 |
| loss | -0.0728 |
| n_updates | 136 |
| policy_gradient_loss | -0.0442 |
| value_loss | 0.000856 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 204 |
| ep_rew_mean | -0.00154 |
| time/ | |
| fps | 1081 |
| iterations | 36 |
| time_elapsed | 272 |
| total_timesteps | 294912 |
| train/ | |
| approx_kl | 0.033368126 |
| clip_fraction | 0.397 |
| clip_range | 0.15 |
| entropy_loss | -8.05 |
| explained_variance | -0.111 |
| learning_rate | 0.000249 |
| loss | -0.0801 |
| n_updates | 140 |
| policy_gradient_loss | -0.047 |
| value_loss | 0.000738 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 207 |
| ep_rew_mean | 0.0033 |
| time/ | |
| fps | 1081 |
| iterations | 37 |
| time_elapsed | 280 |
| total_timesteps | 303104 |
| train/ | |
| approx_kl | 0.03245949 |
| clip_fraction | 0.407 |
| clip_range | 0.15 |
| entropy_loss | -8.07 |
| explained_variance | -0.0745 |
| learning_rate | 0.000249 |
| loss | -0.0789 |
| n_updates | 144 |
| policy_gradient_loss | -0.0457 |
| value_loss | 0.000775 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 211 |
| ep_rew_mean | 0.0255 |
| time/ | |
| fps | 1081 |
| iterations | 38 |
| time_elapsed | 287 |
| total_timesteps | 311296 |
| train/ | |
| approx_kl | 0.032103226 |
| clip_fraction | 0.415 |
| clip_range | 0.15 |
| entropy_loss | -8.04 |
| explained_variance | -0.0989 |
| learning_rate | 0.000249 |
| loss | -0.0837 |
| n_updates | 148 |
| policy_gradient_loss | -0.0457 |
| value_loss | 0.000697 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 219 |
| ep_rew_mean | 0.0341 |
| time/ | |
| fps | 1082 |
| iterations | 39 |
| time_elapsed | 295 |
| total_timesteps | 319488 |
| train/ | |
| approx_kl | 0.03655534 |
| clip_fraction | 0.425 |
| clip_range | 0.15 |
| entropy_loss | -8.03 |
| explained_variance | -0.0782 |
| learning_rate | 0.000249 |
| loss | -0.078 |
| n_updates | 152 |
| policy_gradient_loss | -0.0459 |
| value_loss | 0.000671 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 216 |
| ep_rew_mean | 0.0226 |
| time/ | |
| fps | 1083 |
| iterations | 40 |
| time_elapsed | 302 |
| total_timesteps | 327680 |
| train/ | |
| approx_kl | 0.032864608 |
| clip_fraction | 0.416 |
| clip_range | 0.15 |
| entropy_loss | -8.03 |
| explained_variance | -0.0368 |
| learning_rate | 0.000249 |
| loss | -0.0806 |
| n_updates | 156 |
| policy_gradient_loss | -0.0443 |
| value_loss | 0.000702 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 208 |
| ep_rew_mean | 0.0215 |
| time/ | |
| fps | 1083 |
| iterations | 41 |
| time_elapsed | 309 |
| total_timesteps | 335872 |
| train/ | |
| approx_kl | 0.03296768 |
| clip_fraction | 0.405 |
| clip_range | 0.15 |
| entropy_loss | -8.02 |
| explained_variance | -0.0714 |
| learning_rate | 0.000249 |
| loss | -0.0841 |
| n_updates | 160 |
| policy_gradient_loss | -0.0456 |
| value_loss | 0.000735 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 216 |
| ep_rew_mean | 0.0384 |
| time/ | |
| fps | 1085 |
| iterations | 42 |
| time_elapsed | 317 |
| total_timesteps | 344064 |
| train/ | |
| approx_kl | 0.034226447 |
| clip_fraction | 0.41 |
| clip_range | 0.15 |
| entropy_loss | -8.02 |
| explained_variance | -0.0433 |
| learning_rate | 0.000249 |
| loss | -0.0821 |
| n_updates | 164 |
| policy_gradient_loss | -0.0482 |
| value_loss | 0.000689 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 215 |
| ep_rew_mean | 0.0395 |
| time/ | |
| fps | 1085 |
| iterations | 43 |
| time_elapsed | 324 |
| total_timesteps | 352256 |
| train/ | |
| approx_kl | 0.034567412 |
| clip_fraction | 0.41 |
| clip_range | 0.15 |
| entropy_loss | -8.02 |
| explained_variance | -0.0585 |
| learning_rate | 0.000249 |
| loss | -0.0759 |
| n_updates | 168 |
| policy_gradient_loss | -0.0473 |
| value_loss | 0.000626 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 209 |
| ep_rew_mean | 0.015 |
| time/ | |
| fps | 1085 |
| iterations | 44 |
| time_elapsed | 332 |
| total_timesteps | 360448 |
| train/ | |
| approx_kl | 0.03582894 |
| clip_fraction | 0.423 |
| clip_range | 0.15 |
| entropy_loss | -8 |
| explained_variance | -0.069 |
| learning_rate | 0.000249 |
| loss | -0.0751 |
| n_updates | 172 |
| policy_gradient_loss | -0.0474 |
| value_loss | 0.000647 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 197 |
| ep_rew_mean | 0.0179 |
| time/ | |
| fps | 1086 |
| iterations | 45 |
| time_elapsed | 339 |
| total_timesteps | 368640 |
| train/ | |
| approx_kl | 0.037727863 |
| clip_fraction | 0.436 |
| clip_range | 0.15 |
| entropy_loss | -7.97 |
| explained_variance | -0.0323 |
| learning_rate | 0.000249 |
| loss | -0.0803 |
| n_updates | 176 |
| policy_gradient_loss | -0.0468 |
| value_loss | 0.000699 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 198 |
| ep_rew_mean | 0.00253 |
| time/ | |
| fps | 1086 |
| iterations | 46 |
| time_elapsed | 346 |
| total_timesteps | 376832 |
| train/ | |
| approx_kl | 0.036440752 |
| clip_fraction | 0.426 |
| clip_range | 0.15 |
| entropy_loss | -7.96 |
| explained_variance | -0.0603 |
| learning_rate | 0.000249 |
| loss | -0.0829 |
| n_updates | 180 |
| policy_gradient_loss | -0.0487 |
| value_loss | 0.000727 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 205 |
| ep_rew_mean | 0.0133 |
| time/ | |
| fps | 1087 |
| iterations | 47 |
| time_elapsed | 354 |
| total_timesteps | 385024 |
| train/ | |
| approx_kl | 0.036603756 |
| clip_fraction | 0.425 |
| clip_range | 0.15 |
| entropy_loss | -7.92 |
| explained_variance | -0.0141 |
| learning_rate | 0.000249 |
| loss | -0.0719 |
| n_updates | 184 |
| policy_gradient_loss | -0.0439 |
| value_loss | 0.000617 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 214 |
| ep_rew_mean | 0.0356 |
| time/ | |
| fps | 1087 |
| iterations | 48 |
| time_elapsed | 361 |
| total_timesteps | 393216 |
| train/ | |
| approx_kl | 0.038700864 |
| clip_fraction | 0.436 |
| clip_range | 0.15 |
| entropy_loss | -7.93 |
| explained_variance | -0.0768 |
| learning_rate | 0.000249 |
| loss | -0.0783 |
| n_updates | 188 |
| policy_gradient_loss | -0.0451 |
| value_loss | 0.000707 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 212 |
| ep_rew_mean | 0.0433 |
| time/ | |
| fps | 1087 |
| iterations | 49 |
| time_elapsed | 369 |
| total_timesteps | 401408 |
| train/ | |
| approx_kl | 0.036966786 |
| clip_fraction | 0.428 |
| clip_range | 0.15 |
| entropy_loss | -7.91 |
| explained_variance | -0.0343 |
| learning_rate | 0.000249 |
| loss | -0.0739 |
| n_updates | 192 |
| policy_gradient_loss | -0.043 |
| value_loss | 0.000676 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 216 |
| ep_rew_mean | 0.0627 |
| time/ | |
| fps | 1087 |
| iterations | 50 |
| time_elapsed | 376 |
| total_timesteps | 409600 |
| train/ | |
| approx_kl | 0.035639323 |
| clip_fraction | 0.418 |
| clip_range | 0.149 |
| entropy_loss | -7.92 |
| explained_variance | -0.0486 |
| learning_rate | 0.000249 |
| loss | -0.0771 |
| n_updates | 196 |
| policy_gradient_loss | -0.0471 |
| value_loss | 0.00064 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 212 |
| ep_rew_mean | 0.0701 |
| time/ | |
| fps | 1088 |
| iterations | 51 |
| time_elapsed | 383 |
| total_timesteps | 417792 |
| train/ | |
| approx_kl | 0.03806825 |
| clip_fraction | 0.42 |
| clip_range | 0.149 |
| entropy_loss | -7.92 |
| explained_variance | -0.0104 |
| learning_rate | 0.000249 |
| loss | -0.0841 |
| n_updates | 200 |
| policy_gradient_loss | -0.0475 |
| value_loss | 0.000615 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 211 |
| ep_rew_mean | 0.0769 |
| time/ | |
| fps | 1088 |
| iterations | 52 |
| time_elapsed | 391 |
| total_timesteps | 425984 |
| train/ | |
| approx_kl | 0.036555544 |
| clip_fraction | 0.416 |
| clip_range | 0.149 |
| entropy_loss | -7.92 |
| explained_variance | 0.0201 |
| learning_rate | 0.000249 |
| loss | -0.0819 |
| n_updates | 204 |
| policy_gradient_loss | -0.0469 |
| value_loss | 0.000719 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 214 |
| ep_rew_mean | 0.0708 |
| time/ | |
| fps | 1087 |
| iterations | 53 |
| time_elapsed | 399 |
| total_timesteps | 434176 |
| train/ | |
| approx_kl | 0.038168434 |
| clip_fraction | 0.427 |
| clip_range | 0.149 |
| entropy_loss | -7.87 |
| explained_variance | -0.0123 |
| learning_rate | 0.000249 |
| loss | -0.0781 |
| n_updates | 208 |
| policy_gradient_loss | -0.0468 |
| value_loss | 0.000713 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 215 |
| ep_rew_mean | 0.0726 |
| time/ | |
| fps | 1087 |
| iterations | 54 |
| time_elapsed | 406 |
| total_timesteps | 442368 |
| train/ | |
| approx_kl | 0.04196939 |
| clip_fraction | 0.427 |
| clip_range | 0.149 |
| entropy_loss | -7.9 |
| explained_variance | -0.0342 |
| learning_rate | 0.000249 |
| loss | -0.0772 |
| n_updates | 212 |
| policy_gradient_loss | -0.0478 |
| value_loss | 0.000688 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 208 |
| ep_rew_mean | 0.0344 |
| time/ | |
| fps | 1088 |
| iterations | 55 |
| time_elapsed | 414 |
| total_timesteps | 450560 |
| train/ | |
| approx_kl | 0.036647327 |
| clip_fraction | 0.426 |
| clip_range | 0.149 |
| entropy_loss | -7.92 |
| explained_variance | -0.0315 |
| learning_rate | 0.000249 |
| loss | -0.0857 |
| n_updates | 216 |
| policy_gradient_loss | -0.0484 |
| value_loss | 0.000633 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 203 |
| ep_rew_mean | 0.0314 |
| time/ | |
| fps | 1088 |
| iterations | 56 |
| time_elapsed | 421 |
| total_timesteps | 458752 |
| train/ | |
| approx_kl | 0.04033483 |
| clip_fraction | 0.431 |
| clip_range | 0.149 |
| entropy_loss | -7.87 |
| explained_variance | -0.0516 |
| learning_rate | 0.000249 |
| loss | -0.0824 |
| n_updates | 220 |
| policy_gradient_loss | -0.047 |
| value_loss | 0.000681 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 203 |
| ep_rew_mean | 0.00718 |
| time/ | |
| fps | 1088 |
| iterations | 57 |
| time_elapsed | 429 |
| total_timesteps | 466944 |
| train/ | |
| approx_kl | 0.041999236 |
| clip_fraction | 0.449 |
| clip_range | 0.149 |
| entropy_loss | -7.82 |
| explained_variance | -0.0333 |
| learning_rate | 0.000249 |
| loss | -0.0882 |
| n_updates | 224 |
| policy_gradient_loss | -0.0478 |
| value_loss | 0.000702 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 209 |
| ep_rew_mean | 0.0356 |
| time/ | |
| fps | 1088 |
| iterations | 58 |
| time_elapsed | 436 |
| total_timesteps | 475136 |
| train/ | |
| approx_kl | 0.043302666 |
| clip_fraction | 0.443 |
| clip_range | 0.149 |
| entropy_loss | -7.78 |
| explained_variance | -0.0384 |
| learning_rate | 0.000249 |
| loss | -0.0746 |
| n_updates | 228 |
| policy_gradient_loss | -0.0451 |
| value_loss | 0.00069 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 208 |
| ep_rew_mean | 0.0532 |
| time/ | |
| fps | 1089 |
| iterations | 59 |
| time_elapsed | 443 |
| total_timesteps | 483328 |
| train/ | |
| approx_kl | 0.05051574 |
| clip_fraction | 0.468 |
| clip_range | 0.149 |
| entropy_loss | -7.72 |
| explained_variance | 0.0441 |
| learning_rate | 0.000249 |
| loss | -0.0727 |
| n_updates | 232 |
| policy_gradient_loss | -0.0466 |
| value_loss | 0.000701 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 211 |
| ep_rew_mean | 0.0803 |
| time/ | |
| fps | 1090 |
| iterations | 60 |
| time_elapsed | 450 |
| total_timesteps | 491520 |
| train/ | |
| approx_kl | 0.046735413 |
| clip_fraction | 0.475 |
| clip_range | 0.149 |
| entropy_loss | -7.69 |
| explained_variance | -0.0132 |
| learning_rate | 0.000249 |
| loss | -0.0811 |
| n_updates | 236 |
| policy_gradient_loss | -0.0477 |
| value_loss | 0.000733 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 215 |
| ep_rew_mean | 0.0944 |
| time/ | |
| fps | 1090 |
| iterations | 61 |
| time_elapsed | 458 |
| total_timesteps | 499712 |
| train/ | |
| approx_kl | 0.048767954 |
| clip_fraction | 0.469 |
| clip_range | 0.149 |
| entropy_loss | -7.66 |
| explained_variance | 0.0494 |
| learning_rate | 0.000249 |
| loss | -0.0812 |
| n_updates | 240 |
| policy_gradient_loss | -0.046 |
| value_loss | 0.000634 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 219 |
| ep_rew_mean | 0.0853 |
| time/ | |
| fps | 1090 |
| iterations | 62 |
| time_elapsed | 465 |
| total_timesteps | 507904 |
| train/ | |
| approx_kl | 0.048191354 |
| clip_fraction | 0.473 |
| clip_range | 0.149 |
| entropy_loss | -7.65 |
| explained_variance | -0.0291 |
| learning_rate | 0.000249 |
| loss | -0.0774 |
| n_updates | 244 |
| policy_gradient_loss | -0.0459 |
| value_loss | 0.000682 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.0819 |
| time/ | |
| fps | 1090 |
| iterations | 63 |
| time_elapsed | 473 |
| total_timesteps | 516096 |
| train/ | |
| approx_kl | 0.04908924 |
| clip_fraction | 0.474 |
| clip_range | 0.149 |
| entropy_loss | -7.7 |
| explained_variance | -0.0348 |
| learning_rate | 0.000249 |
| loss | -0.0752 |
| n_updates | 248 |
| policy_gradient_loss | -0.0459 |
| value_loss | 0.000703 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.0891 |
| time/ | |
| fps | 1090 |
| iterations | 64 |
| time_elapsed | 480 |
| total_timesteps | 524288 |
| train/ | |
| approx_kl | 0.046627633 |
| clip_fraction | 0.467 |
| clip_range | 0.149 |
| entropy_loss | -7.65 |
| explained_variance | 0.00435 |
| learning_rate | 0.000249 |
| loss | -0.085 |
| n_updates | 252 |
| policy_gradient_loss | -0.047 |
| value_loss | 0.000702 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 215 |
| ep_rew_mean | 0.0887 |
| time/ | |
| fps | 1091 |
| iterations | 65 |
| time_elapsed | 487 |
| total_timesteps | 532480 |
| train/ | |
| approx_kl | 0.04555271 |
| clip_fraction | 0.472 |
| clip_range | 0.149 |
| entropy_loss | -7.65 |
| explained_variance | 0.0458 |
| learning_rate | 0.000249 |
| loss | -0.0808 |
| n_updates | 256 |
| policy_gradient_loss | -0.0452 |
| value_loss | 0.000659 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 214 |
| ep_rew_mean | 0.0925 |
| time/ | |
| fps | 1092 |
| iterations | 66 |
| time_elapsed | 495 |
| total_timesteps | 540672 |
| train/ | |
| approx_kl | 0.046878427 |
| clip_fraction | 0.459 |
| clip_range | 0.149 |
| entropy_loss | -7.64 |
| explained_variance | 0.074 |
| learning_rate | 0.000249 |
| loss | -0.0829 |
| n_updates | 260 |
| policy_gradient_loss | -0.0477 |
| value_loss | 0.000736 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 223 |
| ep_rew_mean | 0.109 |
| time/ | |
| fps | 1092 |
| iterations | 67 |
| time_elapsed | 502 |
| total_timesteps | 548864 |
| train/ | |
| approx_kl | 0.052148454 |
| clip_fraction | 0.478 |
| clip_range | 0.149 |
| entropy_loss | -7.63 |
| explained_variance | 0.00465 |
| learning_rate | 0.000249 |
| loss | -0.0765 |
| n_updates | 264 |
| policy_gradient_loss | -0.0493 |
| value_loss | 0.000697 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.136 |
| time/ | |
| fps | 1092 |
| iterations | 68 |
| time_elapsed | 509 |
| total_timesteps | 557056 |
| train/ | |
| approx_kl | 0.05289767 |
| clip_fraction | 0.473 |
| clip_range | 0.149 |
| entropy_loss | -7.65 |
| explained_variance | 0.0173 |
| learning_rate | 0.000249 |
| loss | -0.0791 |
| n_updates | 268 |
| policy_gradient_loss | -0.0484 |
| value_loss | 0.000694 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 232 |
| ep_rew_mean | 0.129 |
| time/ | |
| fps | 1092 |
| iterations | 69 |
| time_elapsed | 517 |
| total_timesteps | 565248 |
| train/ | |
| approx_kl | 0.04817179 |
| clip_fraction | 0.454 |
| clip_range | 0.149 |
| entropy_loss | -7.63 |
| explained_variance | 0.0719 |
| learning_rate | 0.000249 |
| loss | -0.0816 |
| n_updates | 272 |
| policy_gradient_loss | -0.048 |
| value_loss | 0.000655 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 226 |
| ep_rew_mean | 0.0997 |
| time/ | |
| fps | 1093 |
| iterations | 70 |
| time_elapsed | 524 |
| total_timesteps | 573440 |
| train/ | |
| approx_kl | 0.042836964 |
| clip_fraction | 0.464 |
| clip_range | 0.149 |
| entropy_loss | -7.61 |
| explained_variance | 0.0555 |
| learning_rate | 0.000249 |
| loss | -0.0779 |
| n_updates | 276 |
| policy_gradient_loss | -0.0442 |
| value_loss | 0.000752 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 222 |
| ep_rew_mean | 0.108 |
| time/ | |
| fps | 1092 |
| iterations | 71 |
| time_elapsed | 532 |
| total_timesteps | 581632 |
| train/ | |
| approx_kl | 0.050688475 |
| clip_fraction | 0.456 |
| clip_range | 0.149 |
| entropy_loss | -7.66 |
| explained_variance | 0.0707 |
| learning_rate | 0.000249 |
| loss | -0.0782 |
| n_updates | 280 |
| policy_gradient_loss | -0.0494 |
| value_loss | 0.000642 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 223 |
| ep_rew_mean | 0.101 |
| time/ | |
| fps | 1093 |
| iterations | 72 |
| time_elapsed | 539 |
| total_timesteps | 589824 |
| train/ | |
| approx_kl | 0.04820112 |
| clip_fraction | 0.451 |
| clip_range | 0.149 |
| entropy_loss | -7.65 |
| explained_variance | 0.129 |
| learning_rate | 0.000249 |
| loss | -0.0823 |
| n_updates | 284 |
| policy_gradient_loss | -0.0507 |
| value_loss | 0.000645 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.125 |
| time/ | |
| fps | 1093 |
| iterations | 73 |
| time_elapsed | 547 |
| total_timesteps | 598016 |
| train/ | |
| approx_kl | 0.04895016 |
| clip_fraction | 0.458 |
| clip_range | 0.149 |
| entropy_loss | -7.67 |
| explained_variance | 0.152 |
| learning_rate | 0.000249 |
| loss | -0.0872 |
| n_updates | 288 |
| policy_gradient_loss | -0.0491 |
| value_loss | 0.000627 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.123 |
| time/ | |
| fps | 1093 |
| iterations | 74 |
| time_elapsed | 554 |
| total_timesteps | 606208 |
| train/ | |
| approx_kl | 0.051398568 |
| clip_fraction | 0.472 |
| clip_range | 0.149 |
| entropy_loss | -7.66 |
| explained_variance | 0.128 |
| learning_rate | 0.000249 |
| loss | -0.087 |
| n_updates | 292 |
| policy_gradient_loss | -0.0499 |
| value_loss | 0.000634 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.149 |
| time/ | |
| fps | 1093 |
| iterations | 75 |
| time_elapsed | 561 |
| total_timesteps | 614400 |
| train/ | |
| approx_kl | 0.047108963 |
| clip_fraction | 0.454 |
| clip_range | 0.149 |
| entropy_loss | -7.63 |
| explained_variance | 0.145 |
| learning_rate | 0.000248 |
| loss | -0.0819 |
| n_updates | 296 |
| policy_gradient_loss | -0.0492 |
| value_loss | 0.000631 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.165 |
| time/ | |
| fps | 1093 |
| iterations | 76 |
| time_elapsed | 569 |
| total_timesteps | 622592 |
| train/ | |
| approx_kl | 0.047998037 |
| clip_fraction | 0.465 |
| clip_range | 0.149 |
| entropy_loss | -7.61 |
| explained_variance | 0.157 |
| learning_rate | 0.000248 |
| loss | -0.086 |
| n_updates | 300 |
| policy_gradient_loss | -0.0498 |
| value_loss | 0.000741 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.162 |
| time/ | |
| fps | 1093 |
| iterations | 77 |
| time_elapsed | 576 |
| total_timesteps | 630784 |
| train/ | |
| approx_kl | 0.052043833 |
| clip_fraction | 0.461 |
| clip_range | 0.149 |
| entropy_loss | -7.64 |
| explained_variance | 0.193 |
| learning_rate | 0.000248 |
| loss | -0.0856 |
| n_updates | 304 |
| policy_gradient_loss | -0.0505 |
| value_loss | 0.00071 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.146 |
| time/ | |
| fps | 1094 |
| iterations | 78 |
| time_elapsed | 583 |
| total_timesteps | 638976 |
| train/ | |
| approx_kl | 0.05115318 |
| clip_fraction | 0.455 |
| clip_range | 0.149 |
| entropy_loss | -7.62 |
| explained_variance | 0.144 |
| learning_rate | 0.000248 |
| loss | -0.0829 |
| n_updates | 308 |
| policy_gradient_loss | -0.05 |
| value_loss | 0.000655 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.123 |
| time/ | |
| fps | 1094 |
| iterations | 79 |
| time_elapsed | 591 |
| total_timesteps | 647168 |
| train/ | |
| approx_kl | 0.05336699 |
| clip_fraction | 0.472 |
| clip_range | 0.149 |
| entropy_loss | -7.6 |
| explained_variance | 0.162 |
| learning_rate | 0.000248 |
| loss | -0.0846 |
| n_updates | 312 |
| policy_gradient_loss | -0.0494 |
| value_loss | 0.000681 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.125 |
| time/ | |
| fps | 1094 |
| iterations | 80 |
| time_elapsed | 599 |
| total_timesteps | 655360 |
| train/ | |
| approx_kl | 0.050866805 |
| clip_fraction | 0.467 |
| clip_range | 0.149 |
| entropy_loss | -7.57 |
| explained_variance | 0.148 |
| learning_rate | 0.000248 |
| loss | -0.0788 |
| n_updates | 316 |
| policy_gradient_loss | -0.0474 |
| value_loss | 0.000746 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 220 |
| ep_rew_mean | 0.137 |
| time/ | |
| fps | 1093 |
| iterations | 81 |
| time_elapsed | 606 |
| total_timesteps | 663552 |
| train/ | |
| approx_kl | 0.056692705 |
| clip_fraction | 0.485 |
| clip_range | 0.149 |
| entropy_loss | -7.56 |
| explained_variance | 0.154 |
| learning_rate | 0.000248 |
| loss | -0.081 |
| n_updates | 320 |
| policy_gradient_loss | -0.0493 |
| value_loss | 0.000719 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 222 |
| ep_rew_mean | 0.151 |
| time/ | |
| fps | 1094 |
| iterations | 82 |
| time_elapsed | 613 |
| total_timesteps | 671744 |
| train/ | |
| approx_kl | 0.049499568 |
| clip_fraction | 0.459 |
| clip_range | 0.149 |
| entropy_loss | -7.62 |
| explained_variance | 0.104 |
| learning_rate | 0.000248 |
| loss | -0.0791 |
| n_updates | 324 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000771 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 213 |
| ep_rew_mean | 0.129 |
| time/ | |
| fps | 1094 |
| iterations | 83 |
| time_elapsed | 621 |
| total_timesteps | 679936 |
| train/ | |
| approx_kl | 0.051906064 |
| clip_fraction | 0.463 |
| clip_range | 0.149 |
| entropy_loss | -7.61 |
| explained_variance | 0.136 |
| learning_rate | 0.000248 |
| loss | -0.0775 |
| n_updates | 328 |
| policy_gradient_loss | -0.0501 |
| value_loss | 0.00071 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 216 |
| ep_rew_mean | 0.134 |
| time/ | |
| fps | 1094 |
| iterations | 84 |
| time_elapsed | 628 |
| total_timesteps | 688128 |
| train/ | |
| approx_kl | 0.049262717 |
| clip_fraction | 0.474 |
| clip_range | 0.149 |
| entropy_loss | -7.61 |
| explained_variance | 0.152 |
| learning_rate | 0.000248 |
| loss | -0.0761 |
| n_updates | 332 |
| policy_gradient_loss | -0.0481 |
| value_loss | 0.000789 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 217 |
| ep_rew_mean | 0.146 |
| time/ | |
| fps | 1094 |
| iterations | 85 |
| time_elapsed | 635 |
| total_timesteps | 696320 |
| train/ | |
| approx_kl | 0.050139796 |
| clip_fraction | 0.459 |
| clip_range | 0.149 |
| entropy_loss | -7.57 |
| explained_variance | 0.19 |
| learning_rate | 0.000248 |
| loss | -0.0825 |
| n_updates | 336 |
| policy_gradient_loss | -0.0484 |
| value_loss | 0.000759 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 221 |
| ep_rew_mean | 0.13 |
| time/ | |
| fps | 1095 |
| iterations | 86 |
| time_elapsed | 643 |
| total_timesteps | 704512 |
| train/ | |
| approx_kl | 0.05926934 |
| clip_fraction | 0.48 |
| clip_range | 0.149 |
| entropy_loss | -7.57 |
| explained_variance | 0.27 |
| learning_rate | 0.000248 |
| loss | -0.0783 |
| n_updates | 340 |
| policy_gradient_loss | -0.0502 |
| value_loss | 0.00066 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 222 |
| ep_rew_mean | 0.135 |
| time/ | |
| fps | 1095 |
| iterations | 87 |
| time_elapsed | 650 |
| total_timesteps | 712704 |
| train/ | |
| approx_kl | 0.052811056 |
| clip_fraction | 0.47 |
| clip_range | 0.149 |
| entropy_loss | -7.58 |
| explained_variance | 0.14 |
| learning_rate | 0.000248 |
| loss | -0.0827 |
| n_updates | 344 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000671 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.154 |
| time/ | |
| fps | 1094 |
| iterations | 88 |
| time_elapsed | 658 |
| total_timesteps | 720896 |
| train/ | |
| approx_kl | 0.05576945 |
| clip_fraction | 0.47 |
| clip_range | 0.149 |
| entropy_loss | -7.56 |
| explained_variance | 0.193 |
| learning_rate | 0.000248 |
| loss | -0.0812 |
| n_updates | 348 |
| policy_gradient_loss | -0.0511 |
| value_loss | 0.000725 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.185 |
| time/ | |
| fps | 1095 |
| iterations | 89 |
| time_elapsed | 665 |
| total_timesteps | 729088 |
| train/ | |
| approx_kl | 0.05484263 |
| clip_fraction | 0.477 |
| clip_range | 0.149 |
| entropy_loss | -7.58 |
| explained_variance | 0.26 |
| learning_rate | 0.000248 |
| loss | -0.0755 |
| n_updates | 352 |
| policy_gradient_loss | -0.0505 |
| value_loss | 0.000608 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.18 |
| time/ | |
| fps | 1095 |
| iterations | 90 |
| time_elapsed | 673 |
| total_timesteps | 737280 |
| train/ | |
| approx_kl | 0.053323437 |
| clip_fraction | 0.483 |
| clip_range | 0.149 |
| entropy_loss | -7.56 |
| explained_variance | 0.298 |
| learning_rate | 0.000248 |
| loss | -0.0808 |
| n_updates | 356 |
| policy_gradient_loss | -0.049 |
| value_loss | 0.000648 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.188 |
| time/ | |
| fps | 1095 |
| iterations | 91 |
| time_elapsed | 680 |
| total_timesteps | 745472 |
| train/ | |
| approx_kl | 0.05433871 |
| clip_fraction | 0.478 |
| clip_range | 0.149 |
| entropy_loss | -7.55 |
| explained_variance | 0.394 |
| learning_rate | 0.000248 |
| loss | -0.0876 |
| n_updates | 360 |
| policy_gradient_loss | -0.048 |
| value_loss | 0.0006 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.203 |
| time/ | |
| fps | 1096 |
| iterations | 92 |
| time_elapsed | 687 |
| total_timesteps | 753664 |
| train/ | |
| approx_kl | 0.05357936 |
| clip_fraction | 0.485 |
| clip_range | 0.149 |
| entropy_loss | -7.53 |
| explained_variance | 0.346 |
| learning_rate | 0.000248 |
| loss | -0.0864 |
| n_updates | 364 |
| policy_gradient_loss | -0.0467 |
| value_loss | 0.000691 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.191 |
| time/ | |
| fps | 1096 |
| iterations | 93 |
| time_elapsed | 694 |
| total_timesteps | 761856 |
| train/ | |
| approx_kl | 0.058348823 |
| clip_fraction | 0.483 |
| clip_range | 0.149 |
| entropy_loss | -7.56 |
| explained_variance | 0.342 |
| learning_rate | 0.000248 |
| loss | -0.0833 |
| n_updates | 368 |
| policy_gradient_loss | -0.0499 |
| value_loss | 0.000693 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.176 |
| time/ | |
| fps | 1096 |
| iterations | 94 |
| time_elapsed | 702 |
| total_timesteps | 770048 |
| train/ | |
| approx_kl | 0.049724404 |
| clip_fraction | 0.461 |
| clip_range | 0.149 |
| entropy_loss | -7.5 |
| explained_variance | 0.35 |
| learning_rate | 0.000248 |
| loss | -0.0754 |
| n_updates | 372 |
| policy_gradient_loss | -0.0442 |
| value_loss | 0.000803 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.157 |
| time/ | |
| fps | 1097 |
| iterations | 95 |
| time_elapsed | 709 |
| total_timesteps | 778240 |
| train/ | |
| approx_kl | 0.053371284 |
| clip_fraction | 0.473 |
| clip_range | 0.149 |
| entropy_loss | -7.52 |
| explained_variance | 0.429 |
| learning_rate | 0.000248 |
| loss | -0.079 |
| n_updates | 376 |
| policy_gradient_loss | -0.0486 |
| value_loss | 0.000602 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.181 |
| time/ | |
| fps | 1097 |
| iterations | 96 |
| time_elapsed | 716 |
| total_timesteps | 786432 |
| train/ | |
| approx_kl | 0.055270787 |
| clip_fraction | 0.475 |
| clip_range | 0.149 |
| entropy_loss | -7.45 |
| explained_variance | 0.437 |
| learning_rate | 0.000248 |
| loss | -0.0825 |
| n_updates | 380 |
| policy_gradient_loss | -0.0482 |
| value_loss | 0.00063 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.185 |
| time/ | |
| fps | 1097 |
| iterations | 97 |
| time_elapsed | 724 |
| total_timesteps | 794624 |
| train/ | |
| approx_kl | 0.056365583 |
| clip_fraction | 0.482 |
| clip_range | 0.149 |
| entropy_loss | -7.44 |
| explained_variance | 0.399 |
| learning_rate | 0.000248 |
| loss | -0.0673 |
| n_updates | 384 |
| policy_gradient_loss | -0.0465 |
| value_loss | 0.000653 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.213 |
| time/ | |
| fps | 1097 |
| iterations | 98 |
| time_elapsed | 731 |
| total_timesteps | 802816 |
| train/ | |
| approx_kl | 0.05440127 |
| clip_fraction | 0.467 |
| clip_range | 0.149 |
| entropy_loss | -7.46 |
| explained_variance | 0.43 |
| learning_rate | 0.000248 |
| loss | -0.0791 |
| n_updates | 388 |
| policy_gradient_loss | -0.0496 |
| value_loss | 0.00059 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.221 |
| time/ | |
| fps | 1097 |
| iterations | 99 |
| time_elapsed | 738 |
| total_timesteps | 811008 |
| train/ | |
| approx_kl | 0.05217243 |
| clip_fraction | 0.466 |
| clip_range | 0.149 |
| entropy_loss | -7.42 |
| explained_variance | 0.41 |
| learning_rate | 0.000248 |
| loss | -0.0794 |
| n_updates | 392 |
| policy_gradient_loss | -0.0479 |
| value_loss | 0.000771 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.237 |
| time/ | |
| fps | 1097 |
| iterations | 100 |
| time_elapsed | 746 |
| total_timesteps | 819200 |
| train/ | |
| approx_kl | 0.05560397 |
| clip_fraction | 0.468 |
| clip_range | 0.149 |
| entropy_loss | -7.48 |
| explained_variance | 0.448 |
| learning_rate | 0.000248 |
| loss | -0.0777 |
| n_updates | 396 |
| policy_gradient_loss | -0.0482 |
| value_loss | 0.000607 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.244 |
| time/ | |
| fps | 1098 |
| iterations | 101 |
| time_elapsed | 753 |
| total_timesteps | 827392 |
| train/ | |
| approx_kl | 0.05901387 |
| clip_fraction | 0.471 |
| clip_range | 0.149 |
| entropy_loss | -7.45 |
| explained_variance | 0.457 |
| learning_rate | 0.000248 |
| loss | -0.0752 |
| n_updates | 400 |
| policy_gradient_loss | -0.0466 |
| value_loss | 0.000684 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.238 |
| time/ | |
| fps | 1098 |
| iterations | 102 |
| time_elapsed | 760 |
| total_timesteps | 835584 |
| train/ | |
| approx_kl | 0.052878335 |
| clip_fraction | 0.477 |
| clip_range | 0.149 |
| entropy_loss | -7.45 |
| explained_variance | 0.402 |
| learning_rate | 0.000248 |
| loss | -0.0702 |
| n_updates | 404 |
| policy_gradient_loss | -0.0466 |
| value_loss | 0.000757 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.242 |
| time/ | |
| fps | 1098 |
| iterations | 103 |
| time_elapsed | 768 |
| total_timesteps | 843776 |
| train/ | |
| approx_kl | 0.059576597 |
| clip_fraction | 0.474 |
| clip_range | 0.149 |
| entropy_loss | -7.41 |
| explained_variance | 0.428 |
| learning_rate | 0.000248 |
| loss | -0.0806 |
| n_updates | 408 |
| policy_gradient_loss | -0.0505 |
| value_loss | 0.000688 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.222 |
| time/ | |
| fps | 1098 |
| iterations | 104 |
| time_elapsed | 775 |
| total_timesteps | 851968 |
| train/ | |
| approx_kl | 0.056462698 |
| clip_fraction | 0.471 |
| clip_range | 0.149 |
| entropy_loss | -7.47 |
| explained_variance | 0.414 |
| learning_rate | 0.000248 |
| loss | -0.0808 |
| n_updates | 412 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000587 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.198 |
| time/ | |
| fps | 1098 |
| iterations | 105 |
| time_elapsed | 782 |
| total_timesteps | 860160 |
| train/ | |
| approx_kl | 0.053794455 |
| clip_fraction | 0.471 |
| clip_range | 0.149 |
| entropy_loss | -7.42 |
| explained_variance | 0.396 |
| learning_rate | 0.000248 |
| loss | -0.083 |
| n_updates | 416 |
| policy_gradient_loss | -0.0473 |
| value_loss | 0.000671 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.206 |
| time/ | |
| fps | 1098 |
| iterations | 106 |
| time_elapsed | 790 |
| total_timesteps | 868352 |
| train/ | |
| approx_kl | 0.05114977 |
| clip_fraction | 0.463 |
| clip_range | 0.149 |
| entropy_loss | -7.47 |
| explained_variance | 0.438 |
| learning_rate | 0.000248 |
| loss | -0.0808 |
| n_updates | 420 |
| policy_gradient_loss | -0.048 |
| value_loss | 0.000614 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 226 |
| ep_rew_mean | 0.199 |
| time/ | |
| fps | 1098 |
| iterations | 107 |
| time_elapsed | 797 |
| total_timesteps | 876544 |
| train/ | |
| approx_kl | 0.04553146 |
| clip_fraction | 0.443 |
| clip_range | 0.149 |
| entropy_loss | -7.5 |
| explained_variance | 0.523 |
| learning_rate | 0.000248 |
| loss | -0.0804 |
| n_updates | 424 |
| policy_gradient_loss | -0.0462 |
| value_loss | 0.000607 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 229 |
| ep_rew_mean | 0.227 |
| time/ | |
| fps | 1098 |
| iterations | 108 |
| time_elapsed | 805 |
| total_timesteps | 884736 |
| train/ | |
| approx_kl | 0.05251344 |
| clip_fraction | 0.459 |
| clip_range | 0.149 |
| entropy_loss | -7.5 |
| explained_variance | 0.484 |
| learning_rate | 0.000248 |
| loss | -0.0821 |
| n_updates | 428 |
| policy_gradient_loss | -0.0505 |
| value_loss | 0.000639 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 226 |
| ep_rew_mean | 0.216 |
| time/ | |
| fps | 1099 |
| iterations | 109 |
| time_elapsed | 812 |
| total_timesteps | 892928 |
| train/ | |
| approx_kl | 0.05173687 |
| clip_fraction | 0.445 |
| clip_range | 0.149 |
| entropy_loss | -7.48 |
| explained_variance | 0.422 |
| learning_rate | 0.000248 |
| loss | -0.076 |
| n_updates | 432 |
| policy_gradient_loss | -0.0508 |
| value_loss | 0.00073 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.229 |
| time/ | |
| fps | 1099 |
| iterations | 110 |
| time_elapsed | 819 |
| total_timesteps | 901120 |
| train/ | |
| approx_kl | 0.052297696 |
| clip_fraction | 0.461 |
| clip_range | 0.149 |
| entropy_loss | -7.53 |
| explained_variance | 0.488 |
| learning_rate | 0.000248 |
| loss | -0.0845 |
| n_updates | 436 |
| policy_gradient_loss | -0.0504 |
| value_loss | 0.000603 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.196 |
| time/ | |
| fps | 1099 |
| iterations | 111 |
| time_elapsed | 827 |
| total_timesteps | 909312 |
| train/ | |
| approx_kl | 0.05267185 |
| clip_fraction | 0.45 |
| clip_range | 0.149 |
| entropy_loss | -7.55 |
| explained_variance | 0.397 |
| learning_rate | 0.000248 |
| loss | -0.0792 |
| n_updates | 440 |
| policy_gradient_loss | -0.0482 |
| value_loss | 0.000686 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.196 |
| time/ | |
| fps | 1099 |
| iterations | 112 |
| time_elapsed | 834 |
| total_timesteps | 917504 |
| train/ | |
| approx_kl | 0.050781623 |
| clip_fraction | 0.451 |
| clip_range | 0.149 |
| entropy_loss | -7.53 |
| explained_variance | 0.419 |
| learning_rate | 0.000248 |
| loss | -0.0802 |
| n_updates | 444 |
| policy_gradient_loss | -0.0498 |
| value_loss | 0.000612 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.191 |
| time/ | |
| fps | 1099 |
| iterations | 113 |
| time_elapsed | 841 |
| total_timesteps | 925696 |
| train/ | |
| approx_kl | 0.056232594 |
| clip_fraction | 0.461 |
| clip_range | 0.149 |
| entropy_loss | -7.53 |
| explained_variance | 0.432 |
| learning_rate | 0.000248 |
| loss | -0.0862 |
| n_updates | 448 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000616 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.201 |
| time/ | |
| fps | 1100 |
| iterations | 114 |
| time_elapsed | 848 |
| total_timesteps | 933888 |
| train/ | |
| approx_kl | 0.05108821 |
| clip_fraction | 0.449 |
| clip_range | 0.149 |
| entropy_loss | -7.52 |
| explained_variance | 0.548 |
| learning_rate | 0.000248 |
| loss | -0.077 |
| n_updates | 452 |
| policy_gradient_loss | -0.0515 |
| value_loss | 0.000543 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.204 |
| time/ | |
| fps | 1100 |
| iterations | 115 |
| time_elapsed | 856 |
| total_timesteps | 942080 |
| train/ | |
| approx_kl | 0.05478944 |
| clip_fraction | 0.459 |
| clip_range | 0.149 |
| entropy_loss | -7.48 |
| explained_variance | 0.498 |
| learning_rate | 0.000248 |
| loss | -0.0769 |
| n_updates | 456 |
| policy_gradient_loss | -0.0476 |
| value_loss | 0.000683 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.214 |
| time/ | |
| fps | 1100 |
| iterations | 116 |
| time_elapsed | 863 |
| total_timesteps | 950272 |
| train/ | |
| approx_kl | 0.057544693 |
| clip_fraction | 0.455 |
| clip_range | 0.149 |
| entropy_loss | -7.55 |
| explained_variance | 0.481 |
| learning_rate | 0.000248 |
| loss | -0.0825 |
| n_updates | 460 |
| policy_gradient_loss | -0.052 |
| value_loss | 0.000593 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.212 |
| time/ | |
| fps | 1100 |
| iterations | 117 |
| time_elapsed | 871 |
| total_timesteps | 958464 |
| train/ | |
| approx_kl | 0.053028636 |
| clip_fraction | 0.456 |
| clip_range | 0.149 |
| entropy_loss | -7.54 |
| explained_variance | 0.419 |
| learning_rate | 0.000248 |
| loss | -0.0821 |
| n_updates | 464 |
| policy_gradient_loss | -0.0514 |
| value_loss | 0.000663 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 250 |
| ep_rew_mean | 0.232 |
| time/ | |
| fps | 1100 |
| iterations | 118 |
| time_elapsed | 878 |
| total_timesteps | 966656 |
| train/ | |
| approx_kl | 0.05402498 |
| clip_fraction | 0.449 |
| clip_range | 0.149 |
| entropy_loss | -7.51 |
| explained_variance | 0.52 |
| learning_rate | 0.000248 |
| loss | -0.0773 |
| n_updates | 468 |
| policy_gradient_loss | -0.0504 |
| value_loss | 0.000514 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.213 |
| time/ | |
| fps | 1100 |
| iterations | 119 |
| time_elapsed | 885 |
| total_timesteps | 974848 |
| train/ | |
| approx_kl | 0.056870513 |
| clip_fraction | 0.459 |
| clip_range | 0.149 |
| entropy_loss | -7.53 |
| explained_variance | 0.457 |
| learning_rate | 0.000248 |
| loss | -0.0811 |
| n_updates | 472 |
| policy_gradient_loss | -0.0497 |
| value_loss | 0.00064 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.223 |
| time/ | |
| fps | 1100 |
| iterations | 120 |
| time_elapsed | 893 |
| total_timesteps | 983040 |
| train/ | |
| approx_kl | 0.062582076 |
| clip_fraction | 0.468 |
| clip_range | 0.149 |
| entropy_loss | -7.51 |
| explained_variance | 0.501 |
| learning_rate | 0.000248 |
| loss | -0.0759 |
| n_updates | 476 |
| policy_gradient_loss | -0.0513 |
| value_loss | 0.000589 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.214 |
| time/ | |
| fps | 1100 |
| iterations | 121 |
| time_elapsed | 900 |
| total_timesteps | 991232 |
| train/ | |
| approx_kl | 0.056241278 |
| clip_fraction | 0.456 |
| clip_range | 0.149 |
| entropy_loss | -7.5 |
| explained_variance | 0.482 |
| learning_rate | 0.000248 |
| loss | -0.0767 |
| n_updates | 480 |
| policy_gradient_loss | -0.0468 |
| value_loss | 0.000643 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.233 |
| time/ | |
| fps | 1100 |
| iterations | 122 |
| time_elapsed | 908 |
| total_timesteps | 999424 |
| train/ | |
| approx_kl | 0.059981856 |
| clip_fraction | 0.461 |
| clip_range | 0.149 |
| entropy_loss | -7.47 |
| explained_variance | 0.487 |
| learning_rate | 0.000248 |
| loss | -0.0846 |
| n_updates | 484 |
| policy_gradient_loss | -0.0503 |
| value_loss | 0.000621 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.247 |
| time/ | |
| fps | 1100 |
| iterations | 123 |
| time_elapsed | 915 |
| total_timesteps | 1007616 |
| train/ | |
| approx_kl | 0.06341614 |
| clip_fraction | 0.466 |
| clip_range | 0.149 |
| entropy_loss | -7.44 |
| explained_variance | 0.407 |
| learning_rate | 0.000248 |
| loss | -0.0819 |
| n_updates | 488 |
| policy_gradient_loss | -0.0497 |
| value_loss | 0.000712 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.224 |
| time/ | |
| fps | 1100 |
| iterations | 124 |
| time_elapsed | 923 |
| total_timesteps | 1015808 |
| train/ | |
| approx_kl | 0.062366627 |
| clip_fraction | 0.468 |
| clip_range | 0.149 |
| entropy_loss | -7.47 |
| explained_variance | 0.462 |
| learning_rate | 0.000248 |
| loss | -0.0792 |
| n_updates | 492 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000579 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.217 |
| time/ | |
| fps | 1100 |
| iterations | 125 |
| time_elapsed | 930 |
| total_timesteps | 1024000 |
| train/ | |
| approx_kl | 0.06348276 |
| clip_fraction | 0.482 |
| clip_range | 0.149 |
| entropy_loss | -7.42 |
| explained_variance | 0.5 |
| learning_rate | 0.000247 |
| loss | -0.0827 |
| n_updates | 496 |
| policy_gradient_loss | -0.0479 |
| value_loss | 0.000599 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.234 |
| time/ | |
| fps | 1100 |
| iterations | 126 |
| time_elapsed | 938 |
| total_timesteps | 1032192 |
| train/ | |
| approx_kl | 0.06243682 |
| clip_fraction | 0.475 |
| clip_range | 0.149 |
| entropy_loss | -7.4 |
| explained_variance | 0.504 |
| learning_rate | 0.000247 |
| loss | -0.079 |
| n_updates | 500 |
| policy_gradient_loss | -0.0477 |
| value_loss | 0.000676 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.253 |
| time/ | |
| fps | 1100 |
| iterations | 127 |
| time_elapsed | 945 |
| total_timesteps | 1040384 |
| train/ | |
| approx_kl | 0.0657691 |
| clip_fraction | 0.477 |
| clip_range | 0.149 |
| entropy_loss | -7.42 |
| explained_variance | 0.439 |
| learning_rate | 0.000247 |
| loss | -0.0825 |
| n_updates | 504 |
| policy_gradient_loss | -0.0494 |
| value_loss | 0.000716 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.255 |
| time/ | |
| fps | 1100 |
| iterations | 128 |
| time_elapsed | 953 |
| total_timesteps | 1048576 |
| train/ | |
| approx_kl | 0.06508583 |
| clip_fraction | 0.483 |
| clip_range | 0.149 |
| entropy_loss | -7.41 |
| explained_variance | 0.451 |
| learning_rate | 0.000247 |
| loss | -0.0874 |
| n_updates | 508 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000709 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.259 |
| time/ | |
| fps | 1100 |
| iterations | 129 |
| time_elapsed | 960 |
| total_timesteps | 1056768 |
| train/ | |
| approx_kl | 0.06456785 |
| clip_fraction | 0.485 |
| clip_range | 0.149 |
| entropy_loss | -7.42 |
| explained_variance | 0.484 |
| learning_rate | 0.000247 |
| loss | -0.0837 |
| n_updates | 512 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000635 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 251 |
| ep_rew_mean | 0.254 |
| time/ | |
| fps | 1101 |
| iterations | 130 |
| time_elapsed | 967 |
| total_timesteps | 1064960 |
| train/ | |
| approx_kl | 0.06530982 |
| clip_fraction | 0.486 |
| clip_range | 0.149 |
| entropy_loss | -7.41 |
| explained_variance | 0.423 |
| learning_rate | 0.000247 |
| loss | -0.0849 |
| n_updates | 516 |
| policy_gradient_loss | -0.0514 |
| value_loss | 0.000651 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 252 |
| ep_rew_mean | 0.257 |
| time/ | |
| fps | 1100 |
| iterations | 131 |
| time_elapsed | 974 |
| total_timesteps | 1073152 |
| train/ | |
| approx_kl | 0.06795773 |
| clip_fraction | 0.484 |
| clip_range | 0.149 |
| entropy_loss | -7.43 |
| explained_variance | 0.451 |
| learning_rate | 0.000247 |
| loss | -0.0793 |
| n_updates | 520 |
| policy_gradient_loss | -0.0525 |
| value_loss | 0.000579 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.231 |
| time/ | |
| fps | 1101 |
| iterations | 132 |
| time_elapsed | 982 |
| total_timesteps | 1081344 |
| train/ | |
| approx_kl | 0.06525904 |
| clip_fraction | 0.476 |
| clip_range | 0.149 |
| entropy_loss | -7.38 |
| explained_variance | 0.49 |
| learning_rate | 0.000247 |
| loss | -0.0683 |
| n_updates | 524 |
| policy_gradient_loss | -0.0502 |
| value_loss | 0.000646 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.22 |
| time/ | |
| fps | 1100 |
| iterations | 133 |
| time_elapsed | 989 |
| total_timesteps | 1089536 |
| train/ | |
| approx_kl | 0.06675568 |
| clip_fraction | 0.478 |
| clip_range | 0.149 |
| entropy_loss | -7.47 |
| explained_variance | 0.427 |
| learning_rate | 0.000247 |
| loss | -0.0805 |
| n_updates | 528 |
| policy_gradient_loss | -0.0517 |
| value_loss | 0.000694 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.203 |
| time/ | |
| fps | 1100 |
| iterations | 134 |
| time_elapsed | 997 |
| total_timesteps | 1097728 |
| train/ | |
| approx_kl | 0.059254743 |
| clip_fraction | 0.471 |
| clip_range | 0.149 |
| entropy_loss | -7.4 |
| explained_variance | 0.437 |
| learning_rate | 0.000247 |
| loss | -0.0709 |
| n_updates | 532 |
| policy_gradient_loss | -0.0471 |
| value_loss | 0.000702 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.213 |
| time/ | |
| fps | 1100 |
| iterations | 135 |
| time_elapsed | 1004 |
| total_timesteps | 1105920 |
| train/ | |
| approx_kl | 0.0610163 |
| clip_fraction | 0.465 |
| clip_range | 0.149 |
| entropy_loss | -7.47 |
| explained_variance | 0.461 |
| learning_rate | 0.000247 |
| loss | -0.0764 |
| n_updates | 536 |
| policy_gradient_loss | -0.0493 |
| value_loss | 0.000674 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.22 |
| time/ | |
| fps | 1101 |
| iterations | 136 |
| time_elapsed | 1011 |
| total_timesteps | 1114112 |
| train/ | |
| approx_kl | 0.062838554 |
| clip_fraction | 0.472 |
| clip_range | 0.149 |
| entropy_loss | -7.5 |
| explained_variance | 0.483 |
| learning_rate | 0.000247 |
| loss | -0.0832 |
| n_updates | 540 |
| policy_gradient_loss | -0.0534 |
| value_loss | 0.000604 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.205 |
| time/ | |
| fps | 1101 |
| iterations | 137 |
| time_elapsed | 1019 |
| total_timesteps | 1122304 |
| train/ | |
| approx_kl | 0.060988206 |
| clip_fraction | 0.47 |
| clip_range | 0.149 |
| entropy_loss | -7.5 |
| explained_variance | 0.56 |
| learning_rate | 0.000247 |
| loss | -0.0823 |
| n_updates | 544 |
| policy_gradient_loss | -0.0516 |
| value_loss | 0.000554 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.204 |
| time/ | |
| fps | 1101 |
| iterations | 138 |
| time_elapsed | 1026 |
| total_timesteps | 1130496 |
| train/ | |
| approx_kl | 0.0639313 |
| clip_fraction | 0.474 |
| clip_range | 0.149 |
| entropy_loss | -7.48 |
| explained_variance | 0.51 |
| learning_rate | 0.000247 |
| loss | -0.0832 |
| n_updates | 548 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000564 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.212 |
| time/ | |
| fps | 1101 |
| iterations | 139 |
| time_elapsed | 1034 |
| total_timesteps | 1138688 |
| train/ | |
| approx_kl | 0.07040946 |
| clip_fraction | 0.501 |
| clip_range | 0.149 |
| entropy_loss | -7.42 |
| explained_variance | 0.483 |
| learning_rate | 0.000247 |
| loss | -0.0774 |
| n_updates | 552 |
| policy_gradient_loss | -0.0516 |
| value_loss | 0.000648 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.257 |
| time/ | |
| fps | 1101 |
| iterations | 140 |
| time_elapsed | 1041 |
| total_timesteps | 1146880 |
| train/ | |
| approx_kl | 0.06612257 |
| clip_fraction | 0.488 |
| clip_range | 0.149 |
| entropy_loss | -7.36 |
| explained_variance | 0.498 |
| learning_rate | 0.000247 |
| loss | -0.0829 |
| n_updates | 556 |
| policy_gradient_loss | -0.0498 |
| value_loss | 0.000677 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.243 |
| time/ | |
| fps | 1101 |
| iterations | 141 |
| time_elapsed | 1048 |
| total_timesteps | 1155072 |
| train/ | |
| approx_kl | 0.069440186 |
| clip_fraction | 0.488 |
| clip_range | 0.149 |
| entropy_loss | -7.4 |
| explained_variance | 0.457 |
| learning_rate | 0.000247 |
| loss | -0.085 |
| n_updates | 560 |
| policy_gradient_loss | -0.0504 |
| value_loss | 0.00073 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.23 |
| time/ | |
| fps | 1101 |
| iterations | 142 |
| time_elapsed | 1056 |
| total_timesteps | 1163264 |
| train/ | |
| approx_kl | 0.06863488 |
| clip_fraction | 0.485 |
| clip_range | 0.149 |
| entropy_loss | -7.35 |
| explained_variance | 0.526 |
| learning_rate | 0.000247 |
| loss | -0.0759 |
| n_updates | 564 |
| policy_gradient_loss | -0.0502 |
| value_loss | 0.000554 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.205 |
| time/ | |
| fps | 1101 |
| iterations | 143 |
| time_elapsed | 1063 |
| total_timesteps | 1171456 |
| train/ | |
| approx_kl | 0.06616072 |
| clip_fraction | 0.482 |
| clip_range | 0.149 |
| entropy_loss | -7.37 |
| explained_variance | 0.518 |
| learning_rate | 0.000247 |
| loss | -0.0772 |
| n_updates | 568 |
| policy_gradient_loss | -0.0499 |
| value_loss | 0.000596 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.226 |
| time/ | |
| fps | 1101 |
| iterations | 144 |
| time_elapsed | 1070 |
| total_timesteps | 1179648 |
| train/ | |
| approx_kl | 0.0670695 |
| clip_fraction | 0.49 |
| clip_range | 0.149 |
| entropy_loss | -7.35 |
| explained_variance | 0.509 |
| learning_rate | 0.000247 |
| loss | -0.0777 |
| n_updates | 572 |
| policy_gradient_loss | -0.05 |
| value_loss | 0.000626 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 248 |
| ep_rew_mean | 0.268 |
| time/ | |
| fps | 1101 |
| iterations | 145 |
| time_elapsed | 1078 |
| total_timesteps | 1187840 |
| train/ | |
| approx_kl | 0.07294311 |
| clip_fraction | 0.491 |
| clip_range | 0.149 |
| entropy_loss | -7.39 |
| explained_variance | 0.555 |
| learning_rate | 0.000247 |
| loss | -0.0833 |
| n_updates | 576 |
| policy_gradient_loss | -0.0511 |
| value_loss | 0.00059 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 248 |
| ep_rew_mean | 0.274 |
| time/ | |
| fps | 1101 |
| iterations | 146 |
| time_elapsed | 1085 |
| total_timesteps | 1196032 |
| train/ | |
| approx_kl | 0.07638498 |
| clip_fraction | 0.492 |
| clip_range | 0.149 |
| entropy_loss | -7.39 |
| explained_variance | 0.498 |
| learning_rate | 0.000247 |
| loss | -0.0836 |
| n_updates | 580 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.00069 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.267 |
| time/ | |
| fps | 1101 |
| iterations | 147 |
| time_elapsed | 1093 |
| total_timesteps | 1204224 |
| train/ | |
| approx_kl | 0.065296106 |
| clip_fraction | 0.491 |
| clip_range | 0.149 |
| entropy_loss | -7.38 |
| explained_variance | 0.485 |
| learning_rate | 0.000247 |
| loss | -0.081 |
| n_updates | 584 |
| policy_gradient_loss | -0.0514 |
| value_loss | 0.000653 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.242 |
| time/ | |
| fps | 1101 |
| iterations | 148 |
| time_elapsed | 1100 |
| total_timesteps | 1212416 |
| train/ | |
| approx_kl | 0.069784686 |
| clip_fraction | 0.486 |
| clip_range | 0.148 |
| entropy_loss | -7.41 |
| explained_variance | 0.562 |
| learning_rate | 0.000247 |
| loss | -0.0777 |
| n_updates | 588 |
| policy_gradient_loss | -0.0496 |
| value_loss | 0.000554 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.249 |
| time/ | |
| fps | 1101 |
| iterations | 149 |
| time_elapsed | 1108 |
| total_timesteps | 1220608 |
| train/ | |
| approx_kl | 0.069644995 |
| clip_fraction | 0.493 |
| clip_range | 0.148 |
| entropy_loss | -7.44 |
| explained_variance | 0.528 |
| learning_rate | 0.000247 |
| loss | -0.0849 |
| n_updates | 592 |
| policy_gradient_loss | -0.0529 |
| value_loss | 0.000601 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 251 |
| ep_rew_mean | 0.264 |
| time/ | |
| fps | 1101 |
| iterations | 150 |
| time_elapsed | 1115 |
| total_timesteps | 1228800 |
| train/ | |
| approx_kl | 0.06458496 |
| clip_fraction | 0.474 |
| clip_range | 0.148 |
| entropy_loss | -7.42 |
| explained_variance | 0.563 |
| learning_rate | 0.000247 |
| loss | -0.0852 |
| n_updates | 596 |
| policy_gradient_loss | -0.0478 |
| value_loss | 0.000594 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 253 |
| ep_rew_mean | 0.264 |
| time/ | |
| fps | 1101 |
| iterations | 151 |
| time_elapsed | 1123 |
| total_timesteps | 1236992 |
| train/ | |
| approx_kl | 0.063582435 |
| clip_fraction | 0.476 |
| clip_range | 0.148 |
| entropy_loss | -7.5 |
| explained_variance | 0.478 |
| learning_rate | 0.000247 |
| loss | -0.0843 |
| n_updates | 600 |
| policy_gradient_loss | -0.0522 |
| value_loss | 0.000626 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.257 |
| time/ | |
| fps | 1101 |
| iterations | 152 |
| time_elapsed | 1130 |
| total_timesteps | 1245184 |
| train/ | |
| approx_kl | 0.06584619 |
| clip_fraction | 0.485 |
| clip_range | 0.148 |
| entropy_loss | -7.45 |
| explained_variance | 0.519 |
| learning_rate | 0.000247 |
| loss | -0.0879 |
| n_updates | 604 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.000605 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.24 |
| time/ | |
| fps | 1101 |
| iterations | 153 |
| time_elapsed | 1138 |
| total_timesteps | 1253376 |
| train/ | |
| approx_kl | 0.06833681 |
| clip_fraction | 0.489 |
| clip_range | 0.148 |
| entropy_loss | -7.42 |
| explained_variance | 0.521 |
| learning_rate | 0.000247 |
| loss | -0.0827 |
| n_updates | 608 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000663 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.232 |
| time/ | |
| fps | 1101 |
| iterations | 154 |
| time_elapsed | 1145 |
| total_timesteps | 1261568 |
| train/ | |
| approx_kl | 0.06440784 |
| clip_fraction | 0.474 |
| clip_range | 0.148 |
| entropy_loss | -7.41 |
| explained_variance | 0.537 |
| learning_rate | 0.000247 |
| loss | -0.0784 |
| n_updates | 612 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000569 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 244 |
| ep_rew_mean | 0.24 |
| time/ | |
| fps | 1101 |
| iterations | 155 |
| time_elapsed | 1152 |
| total_timesteps | 1269760 |
| train/ | |
| approx_kl | 0.06900003 |
| clip_fraction | 0.483 |
| clip_range | 0.148 |
| entropy_loss | -7.44 |
| explained_variance | 0.558 |
| learning_rate | 0.000247 |
| loss | -0.0829 |
| n_updates | 616 |
| policy_gradient_loss | -0.0532 |
| value_loss | 0.000536 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.243 |
| time/ | |
| fps | 1101 |
| iterations | 156 |
| time_elapsed | 1160 |
| total_timesteps | 1277952 |
| train/ | |
| approx_kl | 0.0679577 |
| clip_fraction | 0.459 |
| clip_range | 0.148 |
| entropy_loss | -7.4 |
| explained_variance | 0.526 |
| learning_rate | 0.000247 |
| loss | -0.0861 |
| n_updates | 620 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000626 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.268 |
| time/ | |
| fps | 1101 |
| iterations | 157 |
| time_elapsed | 1167 |
| total_timesteps | 1286144 |
| train/ | |
| approx_kl | 0.06856276 |
| clip_fraction | 0.476 |
| clip_range | 0.148 |
| entropy_loss | -7.42 |
| explained_variance | 0.461 |
| learning_rate | 0.000247 |
| loss | -0.0855 |
| n_updates | 624 |
| policy_gradient_loss | -0.0533 |
| value_loss | 0.000696 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.292 |
| time/ | |
| fps | 1101 |
| iterations | 158 |
| time_elapsed | 1174 |
| total_timesteps | 1294336 |
| train/ | |
| approx_kl | 0.06775929 |
| clip_fraction | 0.472 |
| clip_range | 0.148 |
| entropy_loss | -7.37 |
| explained_variance | 0.494 |
| learning_rate | 0.000247 |
| loss | -0.0778 |
| n_updates | 628 |
| policy_gradient_loss | -0.0511 |
| value_loss | 0.000695 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.311 |
| time/ | |
| fps | 1101 |
| iterations | 159 |
| time_elapsed | 1182 |
| total_timesteps | 1302528 |
| train/ | |
| approx_kl | 0.06944973 |
| clip_fraction | 0.481 |
| clip_range | 0.148 |
| entropy_loss | -7.37 |
| explained_variance | 0.483 |
| learning_rate | 0.000247 |
| loss | -0.0822 |
| n_updates | 632 |
| policy_gradient_loss | -0.0514 |
| value_loss | 0.000778 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.311 |
| time/ | |
| fps | 1102 |
| iterations | 160 |
| time_elapsed | 1189 |
| total_timesteps | 1310720 |
| train/ | |
| approx_kl | 0.065226234 |
| clip_fraction | 0.476 |
| clip_range | 0.148 |
| entropy_loss | -7.44 |
| explained_variance | 0.466 |
| learning_rate | 0.000247 |
| loss | -0.092 |
| n_updates | 636 |
| policy_gradient_loss | -0.0553 |
| value_loss | 0.000704 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.287 |
| time/ | |
| fps | 1102 |
| iterations | 161 |
| time_elapsed | 1196 |
| total_timesteps | 1318912 |
| train/ | |
| approx_kl | 0.07137236 |
| clip_fraction | 0.477 |
| clip_range | 0.148 |
| entropy_loss | -7.34 |
| explained_variance | 0.507 |
| learning_rate | 0.000247 |
| loss | -0.0856 |
| n_updates | 640 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000724 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.255 |
| time/ | |
| fps | 1102 |
| iterations | 162 |
| time_elapsed | 1204 |
| total_timesteps | 1327104 |
| train/ | |
| approx_kl | 0.067628235 |
| clip_fraction | 0.476 |
| clip_range | 0.148 |
| entropy_loss | -7.38 |
| explained_variance | 0.467 |
| learning_rate | 0.000247 |
| loss | -0.0807 |
| n_updates | 644 |
| policy_gradient_loss | -0.0491 |
| value_loss | 0.000708 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.244 |
| time/ | |
| fps | 1101 |
| iterations | 163 |
| time_elapsed | 1211 |
| total_timesteps | 1335296 |
| train/ | |
| approx_kl | 0.07429933 |
| clip_fraction | 0.498 |
| clip_range | 0.148 |
| entropy_loss | -7.37 |
| explained_variance | 0.526 |
| learning_rate | 0.000247 |
| loss | -0.0826 |
| n_updates | 648 |
| policy_gradient_loss | -0.0524 |
| value_loss | 0.000659 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.241 |
| time/ | |
| fps | 1101 |
| iterations | 164 |
| time_elapsed | 1219 |
| total_timesteps | 1343488 |
| train/ | |
| approx_kl | 0.0692776 |
| clip_fraction | 0.487 |
| clip_range | 0.148 |
| entropy_loss | -7.4 |
| explained_variance | 0.513 |
| learning_rate | 0.000247 |
| loss | -0.0835 |
| n_updates | 652 |
| policy_gradient_loss | -0.0509 |
| value_loss | 0.000613 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.241 |
| time/ | |
| fps | 1102 |
| iterations | 165 |
| time_elapsed | 1226 |
| total_timesteps | 1351680 |
| train/ | |
| approx_kl | 0.075196624 |
| clip_fraction | 0.478 |
| clip_range | 0.148 |
| entropy_loss | -7.38 |
| explained_variance | 0.513 |
| learning_rate | 0.000247 |
| loss | -0.0857 |
| n_updates | 656 |
| policy_gradient_loss | -0.0513 |
| value_loss | 0.000632 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.233 |
| time/ | |
| fps | 1102 |
| iterations | 166 |
| time_elapsed | 1233 |
| total_timesteps | 1359872 |
| train/ | |
| approx_kl | 0.07038708 |
| clip_fraction | 0.471 |
| clip_range | 0.148 |
| entropy_loss | -7.37 |
| explained_variance | 0.577 |
| learning_rate | 0.000247 |
| loss | -0.0752 |
| n_updates | 660 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000527 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 232 |
| ep_rew_mean | 0.249 |
| time/ | |
| fps | 1102 |
| iterations | 167 |
| time_elapsed | 1241 |
| total_timesteps | 1368064 |
| train/ | |
| approx_kl | 0.07103458 |
| clip_fraction | 0.475 |
| clip_range | 0.148 |
| entropy_loss | -7.31 |
| explained_variance | 0.492 |
| learning_rate | 0.000247 |
| loss | -0.0775 |
| n_updates | 664 |
| policy_gradient_loss | -0.0504 |
| value_loss | 0.000698 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 220 |
| ep_rew_mean | 0.248 |
| time/ | |
| fps | 1102 |
| iterations | 168 |
| time_elapsed | 1248 |
| total_timesteps | 1376256 |
| train/ | |
| approx_kl | 0.07026996 |
| clip_fraction | 0.482 |
| clip_range | 0.148 |
| entropy_loss | -7.34 |
| explained_variance | 0.505 |
| learning_rate | 0.000247 |
| loss | -0.0833 |
| n_updates | 668 |
| policy_gradient_loss | -0.0517 |
| value_loss | 0.000684 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.254 |
| time/ | |
| fps | 1101 |
| iterations | 169 |
| time_elapsed | 1256 |
| total_timesteps | 1384448 |
| train/ | |
| approx_kl | 0.07088623 |
| clip_fraction | 0.491 |
| clip_range | 0.148 |
| entropy_loss | -7.3 |
| explained_variance | 0.49 |
| learning_rate | 0.000247 |
| loss | -0.0831 |
| n_updates | 672 |
| policy_gradient_loss | -0.0529 |
| value_loss | 0.000713 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.247 |
| time/ | |
| fps | 1102 |
| iterations | 170 |
| time_elapsed | 1263 |
| total_timesteps | 1392640 |
| train/ | |
| approx_kl | 0.07031077 |
| clip_fraction | 0.476 |
| clip_range | 0.148 |
| entropy_loss | -7.39 |
| explained_variance | 0.462 |
| learning_rate | 0.000247 |
| loss | -0.0871 |
| n_updates | 676 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000661 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 232 |
| ep_rew_mean | 0.281 |
| time/ | |
| fps | 1102 |
| iterations | 171 |
| time_elapsed | 1271 |
| total_timesteps | 1400832 |
| train/ | |
| approx_kl | 0.069827735 |
| clip_fraction | 0.481 |
| clip_range | 0.148 |
| entropy_loss | -7.34 |
| explained_variance | 0.467 |
| learning_rate | 0.000247 |
| loss | -0.0843 |
| n_updates | 680 |
| policy_gradient_loss | -0.051 |
| value_loss | 0.000794 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.283 |
| time/ | |
| fps | 1102 |
| iterations | 172 |
| time_elapsed | 1278 |
| total_timesteps | 1409024 |
| train/ | |
| approx_kl | 0.06918645 |
| clip_fraction | 0.49 |
| clip_range | 0.148 |
| entropy_loss | -7.34 |
| explained_variance | 0.519 |
| learning_rate | 0.000247 |
| loss | -0.0802 |
| n_updates | 684 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000695 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 229 |
| ep_rew_mean | 0.281 |
| time/ | |
| fps | 1102 |
| iterations | 173 |
| time_elapsed | 1285 |
| total_timesteps | 1417216 |
| train/ | |
| approx_kl | 0.07108036 |
| clip_fraction | 0.477 |
| clip_range | 0.148 |
| entropy_loss | -7.34 |
| explained_variance | 0.541 |
| learning_rate | 0.000247 |
| loss | -0.0831 |
| n_updates | 688 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000718 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.272 |
| time/ | |
| fps | 1102 |
| iterations | 174 |
| time_elapsed | 1293 |
| total_timesteps | 1425408 |
| train/ | |
| approx_kl | 0.07708906 |
| clip_fraction | 0.493 |
| clip_range | 0.148 |
| entropy_loss | -7.35 |
| explained_variance | 0.496 |
| learning_rate | 0.000246 |
| loss | -0.0849 |
| n_updates | 692 |
| policy_gradient_loss | -0.0521 |
| value_loss | 0.000681 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.267 |
| time/ | |
| fps | 1102 |
| iterations | 175 |
| time_elapsed | 1300 |
| total_timesteps | 1433600 |
| train/ | |
| approx_kl | 0.08033413 |
| clip_fraction | 0.474 |
| clip_range | 0.148 |
| entropy_loss | -7.32 |
| explained_variance | 0.541 |
| learning_rate | 0.000246 |
| loss | -0.0824 |
| n_updates | 696 |
| policy_gradient_loss | -0.0523 |
| value_loss | 0.000622 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.295 |
| time/ | |
| fps | 1102 |
| iterations | 176 |
| time_elapsed | 1307 |
| total_timesteps | 1441792 |
| train/ | |
| approx_kl | 0.07896854 |
| clip_fraction | 0.498 |
| clip_range | 0.148 |
| entropy_loss | -7.29 |
| explained_variance | 0.523 |
| learning_rate | 0.000246 |
| loss | -0.081 |
| n_updates | 700 |
| policy_gradient_loss | -0.054 |
| value_loss | 0.000656 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.306 |
| time/ | |
| fps | 1102 |
| iterations | 177 |
| time_elapsed | 1315 |
| total_timesteps | 1449984 |
| train/ | |
| approx_kl | 0.07502931 |
| clip_fraction | 0.492 |
| clip_range | 0.148 |
| entropy_loss | -7.26 |
| explained_variance | 0.54 |
| learning_rate | 0.000246 |
| loss | -0.0802 |
| n_updates | 704 |
| policy_gradient_loss | -0.0502 |
| value_loss | 0.000696 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.319 |
| time/ | |
| fps | 1102 |
| iterations | 178 |
| time_elapsed | 1322 |
| total_timesteps | 1458176 |
| train/ | |
| approx_kl | 0.08186533 |
| clip_fraction | 0.49 |
| clip_range | 0.148 |
| entropy_loss | -7.3 |
| explained_variance | 0.494 |
| learning_rate | 0.000246 |
| loss | -0.0805 |
| n_updates | 708 |
| policy_gradient_loss | -0.0546 |
| value_loss | 0.000682 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.314 |
| time/ | |
| fps | 1102 |
| iterations | 179 |
| time_elapsed | 1330 |
| total_timesteps | 1466368 |
| train/ | |
| approx_kl | 0.08714326 |
| clip_fraction | 0.508 |
| clip_range | 0.148 |
| entropy_loss | -7.22 |
| explained_variance | 0.501 |
| learning_rate | 0.000246 |
| loss | -0.0868 |
| n_updates | 712 |
| policy_gradient_loss | -0.0513 |
| value_loss | 0.00078 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.293 |
| time/ | |
| fps | 1102 |
| iterations | 180 |
| time_elapsed | 1337 |
| total_timesteps | 1474560 |
| train/ | |
| approx_kl | 0.07917763 |
| clip_fraction | 0.495 |
| clip_range | 0.148 |
| entropy_loss | -7.2 |
| explained_variance | 0.505 |
| learning_rate | 0.000246 |
| loss | -0.0833 |
| n_updates | 716 |
| policy_gradient_loss | -0.0526 |
| value_loss | 0.000716 |
----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.281 |
| time/ | |
| fps | 1102 |
| iterations | 181 |
| time_elapsed | 1345 |
| total_timesteps | 1482752 |
| train/ | |
| approx_kl | 0.080517 |
| clip_fraction | 0.503 |
| clip_range | 0.148 |
| entropy_loss | -7.22 |
| explained_variance | 0.53 |
| learning_rate | 0.000246 |
| loss | -0.0825 |
| n_updates | 720 |
| policy_gradient_loss | -0.0532 |
| value_loss | 0.000607 |
--------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.284 |
| time/ | |
| fps | 1102 |
| iterations | 182 |
| time_elapsed | 1352 |
| total_timesteps | 1490944 |
| train/ | |
| approx_kl | 0.0825504 |
| clip_fraction | 0.499 |
| clip_range | 0.148 |
| entropy_loss | -7.25 |
| explained_variance | 0.474 |
| learning_rate | 0.000246 |
| loss | -0.0777 |
| n_updates | 724 |
| policy_gradient_loss | -0.0525 |
| value_loss | 0.000654 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.295 |
| time/ | |
| fps | 1102 |
| iterations | 183 |
| time_elapsed | 1359 |
| total_timesteps | 1499136 |
| train/ | |
| approx_kl | 0.07920864 |
| clip_fraction | 0.505 |
| clip_range | 0.148 |
| entropy_loss | -7.24 |
| explained_variance | 0.489 |
| learning_rate | 0.000246 |
| loss | -0.0724 |
| n_updates | 728 |
| policy_gradient_loss | -0.0491 |
| value_loss | 0.000807 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.3 |
| time/ | |
| fps | 1102 |
| iterations | 184 |
| time_elapsed | 1367 |
| total_timesteps | 1507328 |
| train/ | |
| approx_kl | 0.08776355 |
| clip_fraction | 0.492 |
| clip_range | 0.148 |
| entropy_loss | -7.25 |
| explained_variance | 0.468 |
| learning_rate | 0.000246 |
| loss | -0.0812 |
| n_updates | 732 |
| policy_gradient_loss | -0.0536 |
| value_loss | 0.000796 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.276 |
| time/ | |
| fps | 1102 |
| iterations | 185 |
| time_elapsed | 1374 |
| total_timesteps | 1515520 |
| train/ | |
| approx_kl | 0.08111123 |
| clip_fraction | 0.496 |
| clip_range | 0.148 |
| entropy_loss | -7.32 |
| explained_variance | 0.491 |
| learning_rate | 0.000246 |
| loss | -0.0815 |
| n_updates | 736 |
| policy_gradient_loss | -0.0535 |
| value_loss | 0.00062 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 248 |
| ep_rew_mean | 0.291 |
| time/ | |
| fps | 1102 |
| iterations | 186 |
| time_elapsed | 1381 |
| total_timesteps | 1523712 |
| train/ | |
| approx_kl | 0.085650064 |
| clip_fraction | 0.498 |
| clip_range | 0.148 |
| entropy_loss | -7.29 |
| explained_variance | 0.527 |
| learning_rate | 0.000246 |
| loss | -0.0878 |
| n_updates | 740 |
| policy_gradient_loss | -0.0539 |
| value_loss | 0.000717 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.274 |
| time/ | |
| fps | 1102 |
| iterations | 187 |
| time_elapsed | 1389 |
| total_timesteps | 1531904 |
| train/ | |
| approx_kl | 0.08082384 |
| clip_fraction | 0.501 |
| clip_range | 0.148 |
| entropy_loss | -7.36 |
| explained_variance | 0.523 |
| learning_rate | 0.000246 |
| loss | -0.0867 |
| n_updates | 744 |
| policy_gradient_loss | -0.0506 |
| value_loss | 0.000653 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 249 |
| ep_rew_mean | 0.291 |
| time/ | |
| fps | 1103 |
| iterations | 188 |
| time_elapsed | 1396 |
| total_timesteps | 1540096 |
| train/ | |
| approx_kl | 0.08884859 |
| clip_fraction | 0.501 |
| clip_range | 0.148 |
| entropy_loss | -7.32 |
| explained_variance | 0.578 |
| learning_rate | 0.000246 |
| loss | -0.0798 |
| n_updates | 748 |
| policy_gradient_loss | -0.0545 |
| value_loss | 0.000621 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 250 |
| ep_rew_mean | 0.282 |
| time/ | |
| fps | 1103 |
| iterations | 189 |
| time_elapsed | 1403 |
| total_timesteps | 1548288 |
| train/ | |
| approx_kl | 0.08770391 |
| clip_fraction | 0.496 |
| clip_range | 0.148 |
| entropy_loss | -7.37 |
| explained_variance | 0.527 |
| learning_rate | 0.000246 |
| loss | -0.0893 |
| n_updates | 752 |
| policy_gradient_loss | -0.055 |
| value_loss | 0.000599 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 254 |
| ep_rew_mean | 0.283 |
| time/ | |
| fps | 1103 |
| iterations | 190 |
| time_elapsed | 1410 |
| total_timesteps | 1556480 |
| train/ | |
| approx_kl | 0.083978266 |
| clip_fraction | 0.504 |
| clip_range | 0.148 |
| entropy_loss | -7.31 |
| explained_variance | 0.494 |
| learning_rate | 0.000246 |
| loss | -0.0873 |
| n_updates | 756 |
| policy_gradient_loss | -0.0519 |
| value_loss | 0.000644 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 249 |
| ep_rew_mean | 0.278 |
| time/ | |
| fps | 1103 |
| iterations | 191 |
| time_elapsed | 1417 |
| total_timesteps | 1564672 |
| train/ | |
| approx_kl | 0.079572804 |
| clip_fraction | 0.496 |
| clip_range | 0.148 |
| entropy_loss | -7.31 |
| explained_variance | 0.572 |
| learning_rate | 0.000246 |
| loss | -0.0848 |
| n_updates | 760 |
| policy_gradient_loss | -0.0539 |
| value_loss | 0.000555 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 249 |
| ep_rew_mean | 0.277 |
| time/ | |
| fps | 1103 |
| iterations | 192 |
| time_elapsed | 1425 |
| total_timesteps | 1572864 |
| train/ | |
| approx_kl | 0.08504398 |
| clip_fraction | 0.501 |
| clip_range | 0.148 |
| entropy_loss | -7.3 |
| explained_variance | 0.539 |
| learning_rate | 0.000246 |
| loss | -0.0821 |
| n_updates | 764 |
| policy_gradient_loss | -0.0515 |
| value_loss | 0.000653 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.278 |
| time/ | |
| fps | 1103 |
| iterations | 193 |
| time_elapsed | 1432 |
| total_timesteps | 1581056 |
| train/ | |
| approx_kl | 0.085106105 |
| clip_fraction | 0.504 |
| clip_range | 0.148 |
| entropy_loss | -7.33 |
| explained_variance | 0.482 |
| learning_rate | 0.000246 |
| loss | -0.0858 |
| n_updates | 768 |
| policy_gradient_loss | -0.0521 |
| value_loss | 0.00065 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 234 |
| ep_rew_mean | 0.27 |
| time/ | |
| fps | 1103 |
| iterations | 194 |
| time_elapsed | 1440 |
| total_timesteps | 1589248 |
| train/ | |
| approx_kl | 0.0826439 |
| clip_fraction | 0.502 |
| clip_range | 0.148 |
| entropy_loss | -7.29 |
| explained_variance | 0.54 |
| learning_rate | 0.000246 |
| loss | -0.0848 |
| n_updates | 772 |
| policy_gradient_loss | -0.0525 |
| value_loss | 0.000647 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 229 |
| ep_rew_mean | 0.265 |
| time/ | |
| fps | 1103 |
| iterations | 195 |
| time_elapsed | 1447 |
| total_timesteps | 1597440 |
| train/ | |
| approx_kl | 0.08335239 |
| clip_fraction | 0.494 |
| clip_range | 0.148 |
| entropy_loss | -7.3 |
| explained_variance | 0.486 |
| learning_rate | 0.000246 |
| loss | -0.0819 |
| n_updates | 776 |
| policy_gradient_loss | -0.0544 |
| value_loss | 0.000715 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.281 |
| time/ | |
| fps | 1103 |
| iterations | 196 |
| time_elapsed | 1454 |
| total_timesteps | 1605632 |
| train/ | |
| approx_kl | 0.081063315 |
| clip_fraction | 0.483 |
| clip_range | 0.148 |
| entropy_loss | -7.24 |
| explained_variance | 0.522 |
| learning_rate | 0.000246 |
| loss | -0.0847 |
| n_updates | 780 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.000673 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.284 |
| time/ | |
| fps | 1103 |
| iterations | 197 |
| time_elapsed | 1462 |
| total_timesteps | 1613824 |
| train/ | |
| approx_kl | 0.07722767 |
| clip_fraction | 0.491 |
| clip_range | 0.148 |
| entropy_loss | -7.29 |
| explained_variance | 0.528 |
| learning_rate | 0.000246 |
| loss | -0.0865 |
| n_updates | 784 |
| policy_gradient_loss | -0.0538 |
| value_loss | 0.000592 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 249 |
| ep_rew_mean | 0.283 |
| time/ | |
| fps | 1103 |
| iterations | 198 |
| time_elapsed | 1469 |
| total_timesteps | 1622016 |
| train/ | |
| approx_kl | 0.07998459 |
| clip_fraction | 0.505 |
| clip_range | 0.148 |
| entropy_loss | -7.22 |
| explained_variance | 0.497 |
| learning_rate | 0.000246 |
| loss | -0.0833 |
| n_updates | 788 |
| policy_gradient_loss | -0.0538 |
| value_loss | 0.000727 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.272 |
| time/ | |
| fps | 1103 |
| iterations | 199 |
| time_elapsed | 1477 |
| total_timesteps | 1630208 |
| train/ | |
| approx_kl | 0.084796876 |
| clip_fraction | 0.503 |
| clip_range | 0.148 |
| entropy_loss | -7.23 |
| explained_variance | 0.563 |
| learning_rate | 0.000246 |
| loss | -0.0848 |
| n_updates | 792 |
| policy_gradient_loss | -0.0541 |
| value_loss | 0.000575 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 246 |
| ep_rew_mean | 0.302 |
| time/ | |
| fps | 1103 |
| iterations | 200 |
| time_elapsed | 1484 |
| total_timesteps | 1638400 |
| train/ | |
| approx_kl | 0.08930965 |
| clip_fraction | 0.517 |
| clip_range | 0.148 |
| entropy_loss | -7.24 |
| explained_variance | 0.572 |
| learning_rate | 0.000246 |
| loss | -0.0881 |
| n_updates | 796 |
| policy_gradient_loss | -0.0535 |
| value_loss | 0.000577 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.322 |
| time/ | |
| fps | 1103 |
| iterations | 201 |
| time_elapsed | 1492 |
| total_timesteps | 1646592 |
| train/ | |
| approx_kl | 0.08401638 |
| clip_fraction | 0.511 |
| clip_range | 0.148 |
| entropy_loss | -7.22 |
| explained_variance | 0.503 |
| learning_rate | 0.000246 |
| loss | -0.087 |
| n_updates | 800 |
| policy_gradient_loss | -0.0544 |
| value_loss | 0.000742 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.337 |
| time/ | |
| fps | 1103 |
| iterations | 202 |
| time_elapsed | 1499 |
| total_timesteps | 1654784 |
| train/ | |
| approx_kl | 0.09070188 |
| clip_fraction | 0.511 |
| clip_range | 0.148 |
| entropy_loss | -7.16 |
| explained_variance | 0.512 |
| learning_rate | 0.000246 |
| loss | -0.0904 |
| n_updates | 804 |
| policy_gradient_loss | -0.0543 |
| value_loss | 0.000733 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 244 |
| ep_rew_mean | 0.325 |
| time/ | |
| fps | 1103 |
| iterations | 203 |
| time_elapsed | 1506 |
| total_timesteps | 1662976 |
| train/ | |
| approx_kl | 0.098129004 |
| clip_fraction | 0.519 |
| clip_range | 0.148 |
| entropy_loss | -7.16 |
| explained_variance | 0.456 |
| learning_rate | 0.000246 |
| loss | -0.0852 |
| n_updates | 808 |
| policy_gradient_loss | -0.0559 |
| value_loss | 0.000683 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.315 |
| time/ | |
| fps | 1103 |
| iterations | 204 |
| time_elapsed | 1514 |
| total_timesteps | 1671168 |
| train/ | |
| approx_kl | 0.09626436 |
| clip_fraction | 0.52 |
| clip_range | 0.148 |
| entropy_loss | -7.13 |
| explained_variance | 0.553 |
| learning_rate | 0.000246 |
| loss | -0.0847 |
| n_updates | 812 |
| policy_gradient_loss | -0.0532 |
| value_loss | 0.000656 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.301 |
| time/ | |
| fps | 1103 |
| iterations | 205 |
| time_elapsed | 1521 |
| total_timesteps | 1679360 |
| train/ | |
| approx_kl | 0.09632793 |
| clip_fraction | 0.506 |
| clip_range | 0.148 |
| entropy_loss | -7.13 |
| explained_variance | 0.505 |
| learning_rate | 0.000246 |
| loss | -0.0839 |
| n_updates | 816 |
| policy_gradient_loss | -0.0525 |
| value_loss | 0.000782 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 232 |
| ep_rew_mean | 0.258 |
| time/ | |
| fps | 1103 |
| iterations | 206 |
| time_elapsed | 1529 |
| total_timesteps | 1687552 |
| train/ | |
| approx_kl | 0.10363456 |
| clip_fraction | 0.517 |
| clip_range | 0.148 |
| entropy_loss | -7.15 |
| explained_variance | 0.568 |
| learning_rate | 0.000246 |
| loss | -0.0799 |
| n_updates | 820 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.000572 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.268 |
| time/ | |
| fps | 1103 |
| iterations | 207 |
| time_elapsed | 1536 |
| total_timesteps | 1695744 |
| train/ | |
| approx_kl | 0.08010447 |
| clip_fraction | 0.494 |
| clip_range | 0.148 |
| entropy_loss | -7.18 |
| explained_variance | 0.595 |
| learning_rate | 0.000246 |
| loss | -0.0817 |
| n_updates | 824 |
| policy_gradient_loss | -0.052 |
| value_loss | 0.000584 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.272 |
| time/ | |
| fps | 1103 |
| iterations | 208 |
| time_elapsed | 1543 |
| total_timesteps | 1703936 |
| train/ | |
| approx_kl | 0.08379765 |
| clip_fraction | 0.498 |
| clip_range | 0.148 |
| entropy_loss | -7.14 |
| explained_variance | 0.535 |
| learning_rate | 0.000246 |
| loss | -0.0845 |
| n_updates | 828 |
| policy_gradient_loss | -0.0533 |
| value_loss | 0.000772 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.272 |
| time/ | |
| fps | 1104 |
| iterations | 209 |
| time_elapsed | 1550 |
| total_timesteps | 1712128 |
| train/ | |
| approx_kl | 0.084038556 |
| clip_fraction | 0.495 |
| clip_range | 0.148 |
| entropy_loss | -7.2 |
| explained_variance | 0.611 |
| learning_rate | 0.000246 |
| loss | -0.0856 |
| n_updates | 832 |
| policy_gradient_loss | -0.0535 |
| value_loss | 0.000571 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.274 |
| time/ | |
| fps | 1104 |
| iterations | 210 |
| time_elapsed | 1557 |
| total_timesteps | 1720320 |
| train/ | |
| approx_kl | 0.08232991 |
| clip_fraction | 0.489 |
| clip_range | 0.148 |
| entropy_loss | -7.18 |
| explained_variance | 0.494 |
| learning_rate | 0.000246 |
| loss | -0.0902 |
| n_updates | 836 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000725 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.289 |
| time/ | |
| fps | 1104 |
| iterations | 211 |
| time_elapsed | 1564 |
| total_timesteps | 1728512 |
| train/ | |
| approx_kl | 0.090407774 |
| clip_fraction | 0.501 |
| clip_range | 0.148 |
| entropy_loss | -7.17 |
| explained_variance | 0.538 |
| learning_rate | 0.000246 |
| loss | -0.0869 |
| n_updates | 840 |
| policy_gradient_loss | -0.0516 |
| value_loss | 0.000716 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.316 |
| time/ | |
| fps | 1104 |
| iterations | 212 |
| time_elapsed | 1571 |
| total_timesteps | 1736704 |
| train/ | |
| approx_kl | 0.0919661 |
| clip_fraction | 0.509 |
| clip_range | 0.148 |
| entropy_loss | -7.11 |
| explained_variance | 0.523 |
| learning_rate | 0.000246 |
| loss | -0.0711 |
| n_updates | 844 |
| policy_gradient_loss | -0.0529 |
| value_loss | 0.000704 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 242 |
| ep_rew_mean | 0.315 |
| time/ | |
| fps | 1105 |
| iterations | 213 |
| time_elapsed | 1578 |
| total_timesteps | 1744896 |
| train/ | |
| approx_kl | 0.09922445 |
| clip_fraction | 0.513 |
| clip_range | 0.148 |
| entropy_loss | -7.16 |
| explained_variance | 0.486 |
| learning_rate | 0.000246 |
| loss | -0.0795 |
| n_updates | 848 |
| policy_gradient_loss | -0.054 |
| value_loss | 0.000737 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.309 |
| time/ | |
| fps | 1105 |
| iterations | 214 |
| time_elapsed | 1585 |
| total_timesteps | 1753088 |
| train/ | |
| approx_kl | 0.088032275 |
| clip_fraction | 0.496 |
| clip_range | 0.148 |
| entropy_loss | -7.1 |
| explained_variance | 0.493 |
| learning_rate | 0.000246 |
| loss | -0.0836 |
| n_updates | 852 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.00075 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.284 |
| time/ | |
| fps | 1105 |
| iterations | 215 |
| time_elapsed | 1592 |
| total_timesteps | 1761280 |
| train/ | |
| approx_kl | 0.08731289 |
| clip_fraction | 0.507 |
| clip_range | 0.148 |
| entropy_loss | -7.1 |
| explained_variance | 0.591 |
| learning_rate | 0.000246 |
| loss | -0.0829 |
| n_updates | 856 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000611 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.294 |
| time/ | |
| fps | 1106 |
| iterations | 216 |
| time_elapsed | 1599 |
| total_timesteps | 1769472 |
| train/ | |
| approx_kl | 0.08080551 |
| clip_fraction | 0.498 |
| clip_range | 0.148 |
| entropy_loss | -7.1 |
| explained_variance | 0.606 |
| learning_rate | 0.000246 |
| loss | -0.0867 |
| n_updates | 860 |
| policy_gradient_loss | -0.0514 |
| value_loss | 0.000594 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.297 |
| time/ | |
| fps | 1106 |
| iterations | 217 |
| time_elapsed | 1607 |
| total_timesteps | 1777664 |
| train/ | |
| approx_kl | 0.09105197 |
| clip_fraction | 0.51 |
| clip_range | 0.148 |
| entropy_loss | -7.06 |
| explained_variance | 0.555 |
| learning_rate | 0.000246 |
| loss | -0.0835 |
| n_updates | 864 |
| policy_gradient_loss | -0.0519 |
| value_loss | 0.000714 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.29 |
| time/ | |
| fps | 1106 |
| iterations | 218 |
| time_elapsed | 1614 |
| total_timesteps | 1785856 |
| train/ | |
| approx_kl | 0.09286306 |
| clip_fraction | 0.505 |
| clip_range | 0.148 |
| entropy_loss | -7.14 |
| explained_variance | 0.558 |
| learning_rate | 0.000246 |
| loss | -0.0943 |
| n_updates | 868 |
| policy_gradient_loss | -0.0558 |
| value_loss | 0.000638 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.281 |
| time/ | |
| fps | 1106 |
| iterations | 219 |
| time_elapsed | 1621 |
| total_timesteps | 1794048 |
| train/ | |
| approx_kl | 0.08781908 |
| clip_fraction | 0.497 |
| clip_range | 0.148 |
| entropy_loss | -7.15 |
| explained_variance | 0.579 |
| learning_rate | 0.000246 |
| loss | -0.078 |
| n_updates | 872 |
| policy_gradient_loss | -0.0526 |
| value_loss | 0.000587 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.298 |
| time/ | |
| fps | 1106 |
| iterations | 220 |
| time_elapsed | 1628 |
| total_timesteps | 1802240 |
| train/ | |
| approx_kl | 0.08710103 |
| clip_fraction | 0.489 |
| clip_range | 0.148 |
| entropy_loss | -7.14 |
| explained_variance | 0.602 |
| learning_rate | 0.000246 |
| loss | -0.0747 |
| n_updates | 876 |
| policy_gradient_loss | -0.0515 |
| value_loss | 0.000608 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 221 |
| ep_rew_mean | 0.308 |
| time/ | |
| fps | 1106 |
| iterations | 221 |
| time_elapsed | 1636 |
| total_timesteps | 1810432 |
| train/ | |
| approx_kl | 0.09429751 |
| clip_fraction | 0.517 |
| clip_range | 0.148 |
| entropy_loss | -7.02 |
| explained_variance | 0.52 |
| learning_rate | 0.000246 |
| loss | -0.0814 |
| n_updates | 880 |
| policy_gradient_loss | -0.0508 |
| value_loss | 0.000796 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 226 |
| ep_rew_mean | 0.326 |
| time/ | |
| fps | 1106 |
| iterations | 222 |
| time_elapsed | 1643 |
| total_timesteps | 1818624 |
| train/ | |
| approx_kl | 0.092921875 |
| clip_fraction | 0.51 |
| clip_range | 0.148 |
| entropy_loss | -7.1 |
| explained_variance | 0.501 |
| learning_rate | 0.000246 |
| loss | -0.0872 |
| n_updates | 884 |
| policy_gradient_loss | -0.0529 |
| value_loss | 0.000729 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.306 |
| time/ | |
| fps | 1106 |
| iterations | 223 |
| time_elapsed | 1650 |
| total_timesteps | 1826816 |
| train/ | |
| approx_kl | 0.0943868 |
| clip_fraction | 0.514 |
| clip_range | 0.148 |
| entropy_loss | -7.06 |
| explained_variance | 0.589 |
| learning_rate | 0.000245 |
| loss | -0.0838 |
| n_updates | 888 |
| policy_gradient_loss | -0.0536 |
| value_loss | 0.000596 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.31 |
| time/ | |
| fps | 1106 |
| iterations | 224 |
| time_elapsed | 1658 |
| total_timesteps | 1835008 |
| train/ | |
| approx_kl | 0.101720184 |
| clip_fraction | 0.519 |
| clip_range | 0.148 |
| entropy_loss | -7.09 |
| explained_variance | 0.601 |
| learning_rate | 0.000245 |
| loss | -0.088 |
| n_updates | 892 |
| policy_gradient_loss | -0.0543 |
| value_loss | 0.000597 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 237 |
| ep_rew_mean | 0.302 |
| time/ | |
| fps | 1106 |
| iterations | 225 |
| time_elapsed | 1665 |
| total_timesteps | 1843200 |
| train/ | |
| approx_kl | 0.094355926 |
| clip_fraction | 0.499 |
| clip_range | 0.148 |
| entropy_loss | -7.06 |
| explained_variance | 0.567 |
| learning_rate | 0.000245 |
| loss | -0.0839 |
| n_updates | 896 |
| policy_gradient_loss | -0.0538 |
| value_loss | 0.000641 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.3 |
| time/ | |
| fps | 1106 |
| iterations | 226 |
| time_elapsed | 1672 |
| total_timesteps | 1851392 |
| train/ | |
| approx_kl | 0.10181391 |
| clip_fraction | 0.502 |
| clip_range | 0.148 |
| entropy_loss | -7.07 |
| explained_variance | 0.557 |
| learning_rate | 0.000245 |
| loss | -0.0807 |
| n_updates | 900 |
| policy_gradient_loss | -0.0547 |
| value_loss | 0.000658 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.306 |
| time/ | |
| fps | 1107 |
| iterations | 227 |
| time_elapsed | 1679 |
| total_timesteps | 1859584 |
| train/ | |
| approx_kl | 0.108819306 |
| clip_fraction | 0.524 |
| clip_range | 0.148 |
| entropy_loss | -7.06 |
| explained_variance | 0.602 |
| learning_rate | 0.000245 |
| loss | -0.0795 |
| n_updates | 904 |
| policy_gradient_loss | -0.0548 |
| value_loss | 0.000544 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.313 |
| time/ | |
| fps | 1107 |
| iterations | 228 |
| time_elapsed | 1686 |
| total_timesteps | 1867776 |
| train/ | |
| approx_kl | 0.106578164 |
| clip_fraction | 0.526 |
| clip_range | 0.148 |
| entropy_loss | -6.96 |
| explained_variance | 0.52 |
| learning_rate | 0.000245 |
| loss | -0.0898 |
| n_updates | 908 |
| policy_gradient_loss | -0.0534 |
| value_loss | 0.00073 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.33 |
| time/ | |
| fps | 1107 |
| iterations | 229 |
| time_elapsed | 1694 |
| total_timesteps | 1875968 |
| train/ | |
| approx_kl | 0.10179232 |
| clip_fraction | 0.525 |
| clip_range | 0.148 |
| entropy_loss | -6.91 |
| explained_variance | 0.538 |
| learning_rate | 0.000245 |
| loss | -0.0812 |
| n_updates | 912 |
| policy_gradient_loss | -0.054 |
| value_loss | 0.000702 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.326 |
| time/ | |
| fps | 1107 |
| iterations | 230 |
| time_elapsed | 1701 |
| total_timesteps | 1884160 |
| train/ | |
| approx_kl | 0.107317895 |
| clip_fraction | 0.536 |
| clip_range | 0.148 |
| entropy_loss | -6.94 |
| explained_variance | 0.571 |
| learning_rate | 0.000245 |
| loss | -0.0896 |
| n_updates | 916 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000591 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.328 |
| time/ | |
| fps | 1107 |
| iterations | 231 |
| time_elapsed | 1708 |
| total_timesteps | 1892352 |
| train/ | |
| approx_kl | 0.11547114 |
| clip_fraction | 0.516 |
| clip_range | 0.148 |
| entropy_loss | -6.91 |
| explained_variance | 0.493 |
| learning_rate | 0.000245 |
| loss | -0.082 |
| n_updates | 920 |
| policy_gradient_loss | -0.053 |
| value_loss | 0.00078 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.317 |
| time/ | |
| fps | 1107 |
| iterations | 232 |
| time_elapsed | 1715 |
| total_timesteps | 1900544 |
| train/ | |
| approx_kl | 0.10672625 |
| clip_fraction | 0.524 |
| clip_range | 0.148 |
| entropy_loss | -6.9 |
| explained_variance | 0.553 |
| learning_rate | 0.000245 |
| loss | -0.0823 |
| n_updates | 924 |
| policy_gradient_loss | -0.053 |
| value_loss | 0.000671 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.329 |
| time/ | |
| fps | 1107 |
| iterations | 233 |
| time_elapsed | 1722 |
| total_timesteps | 1908736 |
| train/ | |
| approx_kl | 0.110047564 |
| clip_fraction | 0.52 |
| clip_range | 0.148 |
| entropy_loss | -6.84 |
| explained_variance | 0.569 |
| learning_rate | 0.000245 |
| loss | -0.085 |
| n_updates | 928 |
| policy_gradient_loss | -0.0535 |
| value_loss | 0.000671 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 229 |
| ep_rew_mean | 0.341 |
| time/ | |
| fps | 1107 |
| iterations | 234 |
| time_elapsed | 1730 |
| total_timesteps | 1916928 |
| train/ | |
| approx_kl | 0.10164595 |
| clip_fraction | 0.518 |
| clip_range | 0.148 |
| entropy_loss | -6.82 |
| explained_variance | 0.559 |
| learning_rate | 0.000245 |
| loss | -0.0818 |
| n_updates | 932 |
| policy_gradient_loss | -0.0522 |
| value_loss | 0.000761 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.363 |
| time/ | |
| fps | 1108 |
| iterations | 235 |
| time_elapsed | 1737 |
| total_timesteps | 1925120 |
| train/ | |
| approx_kl | 0.10495236 |
| clip_fraction | 0.52 |
| clip_range | 0.148 |
| entropy_loss | -6.84 |
| explained_variance | 0.554 |
| learning_rate | 0.000245 |
| loss | -0.0819 |
| n_updates | 936 |
| policy_gradient_loss | -0.052 |
| value_loss | 0.000708 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.367 |
| time/ | |
| fps | 1108 |
| iterations | 236 |
| time_elapsed | 1744 |
| total_timesteps | 1933312 |
| train/ | |
| approx_kl | 0.10555805 |
| clip_fraction | 0.53 |
| clip_range | 0.148 |
| entropy_loss | -6.77 |
| explained_variance | 0.496 |
| learning_rate | 0.000245 |
| loss | -0.0833 |
| n_updates | 940 |
| policy_gradient_loss | -0.0521 |
| value_loss | 0.000913 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.34 |
| time/ | |
| fps | 1108 |
| iterations | 237 |
| time_elapsed | 1751 |
| total_timesteps | 1941504 |
| train/ | |
| approx_kl | 0.10862024 |
| clip_fraction | 0.523 |
| clip_range | 0.148 |
| entropy_loss | -6.76 |
| explained_variance | 0.472 |
| learning_rate | 0.000245 |
| loss | -0.0828 |
| n_updates | 944 |
| policy_gradient_loss | -0.0519 |
| value_loss | 0.00082 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.337 |
| time/ | |
| fps | 1108 |
| iterations | 238 |
| time_elapsed | 1759 |
| total_timesteps | 1949696 |
| train/ | |
| approx_kl | 0.11077298 |
| clip_fraction | 0.521 |
| clip_range | 0.148 |
| entropy_loss | -6.77 |
| explained_variance | 0.546 |
| learning_rate | 0.000245 |
| loss | -0.0853 |
| n_updates | 948 |
| policy_gradient_loss | -0.0534 |
| value_loss | 0.000666 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.32 |
| time/ | |
| fps | 1108 |
| iterations | 239 |
| time_elapsed | 1766 |
| total_timesteps | 1957888 |
| train/ | |
| approx_kl | 0.10972123 |
| clip_fraction | 0.517 |
| clip_range | 0.148 |
| entropy_loss | -6.79 |
| explained_variance | 0.576 |
| learning_rate | 0.000245 |
| loss | -0.0837 |
| n_updates | 952 |
| policy_gradient_loss | -0.053 |
| value_loss | 0.000693 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.345 |
| time/ | |
| fps | 1108 |
| iterations | 240 |
| time_elapsed | 1773 |
| total_timesteps | 1966080 |
| train/ | |
| approx_kl | 0.11470166 |
| clip_fraction | 0.515 |
| clip_range | 0.148 |
| entropy_loss | -6.81 |
| explained_variance | 0.538 |
| learning_rate | 0.000245 |
| loss | -0.0831 |
| n_updates | 956 |
| policy_gradient_loss | -0.0527 |
| value_loss | 0.000701 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 251 |
| ep_rew_mean | 0.354 |
| time/ | |
| fps | 1108 |
| iterations | 241 |
| time_elapsed | 1781 |
| total_timesteps | 1974272 |
| train/ | |
| approx_kl | 0.11648223 |
| clip_fraction | 0.534 |
| clip_range | 0.148 |
| entropy_loss | -6.74 |
| explained_variance | 0.602 |
| learning_rate | 0.000245 |
| loss | -0.0903 |
| n_updates | 960 |
| policy_gradient_loss | -0.0544 |
| value_loss | 0.000577 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 246 |
| ep_rew_mean | 0.363 |
| time/ | |
| fps | 1108 |
| iterations | 242 |
| time_elapsed | 1788 |
| total_timesteps | 1982464 |
| train/ | |
| approx_kl | 0.10504311 |
| clip_fraction | 0.521 |
| clip_range | 0.148 |
| entropy_loss | -6.7 |
| explained_variance | 0.522 |
| learning_rate | 0.000245 |
| loss | -0.0796 |
| n_updates | 964 |
| policy_gradient_loss | -0.0522 |
| value_loss | 0.000778 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.357 |
| time/ | |
| fps | 1108 |
| iterations | 243 |
| time_elapsed | 1795 |
| total_timesteps | 1990656 |
| train/ | |
| approx_kl | 0.12133829 |
| clip_fraction | 0.528 |
| clip_range | 0.148 |
| entropy_loss | -6.73 |
| explained_variance | 0.528 |
| learning_rate | 0.000245 |
| loss | -0.085 |
| n_updates | 968 |
| policy_gradient_loss | -0.0512 |
| value_loss | 0.00075 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.35 |
| time/ | |
| fps | 1108 |
| iterations | 244 |
| time_elapsed | 1802 |
| total_timesteps | 1998848 |
| train/ | |
| approx_kl | 0.12634405 |
| clip_fraction | 0.527 |
| clip_range | 0.148 |
| entropy_loss | -6.77 |
| explained_variance | 0.565 |
| learning_rate | 0.000245 |
| loss | -0.0839 |
| n_updates | 972 |
| policy_gradient_loss | -0.0533 |
| value_loss | 0.000669 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.356 |
| time/ | |
| fps | 1108 |
| iterations | 245 |
| time_elapsed | 1810 |
| total_timesteps | 2007040 |
| train/ | |
| approx_kl | 0.10862511 |
| clip_fraction | 0.521 |
| clip_range | 0.148 |
| entropy_loss | -6.74 |
| explained_variance | 0.563 |
| learning_rate | 0.000245 |
| loss | -0.0893 |
| n_updates | 976 |
| policy_gradient_loss | -0.054 |
| value_loss | 0.000653 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.346 |
| time/ | |
| fps | 1108 |
| iterations | 246 |
| time_elapsed | 1817 |
| total_timesteps | 2015232 |
| train/ | |
| approx_kl | 0.11088178 |
| clip_fraction | 0.523 |
| clip_range | 0.147 |
| entropy_loss | -6.73 |
| explained_variance | 0.544 |
| learning_rate | 0.000245 |
| loss | -0.0793 |
| n_updates | 980 |
| policy_gradient_loss | -0.0515 |
| value_loss | 0.000754 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.331 |
| time/ | |
| fps | 1109 |
| iterations | 247 |
| time_elapsed | 1824 |
| total_timesteps | 2023424 |
| train/ | |
| approx_kl | 0.12056622 |
| clip_fraction | 0.521 |
| clip_range | 0.147 |
| entropy_loss | -6.68 |
| explained_variance | 0.584 |
| learning_rate | 0.000245 |
| loss | -0.0903 |
| n_updates | 984 |
| policy_gradient_loss | -0.0549 |
| value_loss | 0.000677 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 241 |
| ep_rew_mean | 0.337 |
| time/ | |
| fps | 1109 |
| iterations | 248 |
| time_elapsed | 1831 |
| total_timesteps | 2031616 |
| train/ | |
| approx_kl | 0.114841856 |
| clip_fraction | 0.52 |
| clip_range | 0.147 |
| entropy_loss | -6.7 |
| explained_variance | 0.54 |
| learning_rate | 0.000245 |
| loss | -0.0859 |
| n_updates | 988 |
| policy_gradient_loss | -0.0523 |
| value_loss | 0.000734 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 240 |
| ep_rew_mean | 0.342 |
| time/ | |
| fps | 1109 |
| iterations | 249 |
| time_elapsed | 1838 |
| total_timesteps | 2039808 |
| train/ | |
| approx_kl | 0.09891673 |
| clip_fraction | 0.518 |
| clip_range | 0.147 |
| entropy_loss | -6.7 |
| explained_variance | 0.56 |
| learning_rate | 0.000245 |
| loss | -0.0801 |
| n_updates | 992 |
| policy_gradient_loss | -0.0497 |
| value_loss | 0.000706 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.349 |
| time/ | |
| fps | 1109 |
| iterations | 250 |
| time_elapsed | 1845 |
| total_timesteps | 2048000 |
| train/ | |
| approx_kl | 0.11758677 |
| clip_fraction | 0.52 |
| clip_range | 0.147 |
| entropy_loss | -6.69 |
| explained_variance | 0.543 |
| learning_rate | 0.000245 |
| loss | -0.0815 |
| n_updates | 996 |
| policy_gradient_loss | -0.052 |
| value_loss | 0.000712 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.332 |
| time/ | |
| fps | 1109 |
| iterations | 251 |
| time_elapsed | 1853 |
| total_timesteps | 2056192 |
| train/ | |
| approx_kl | 0.10824573 |
| clip_fraction | 0.522 |
| clip_range | 0.147 |
| entropy_loss | -6.7 |
| explained_variance | 0.554 |
| learning_rate | 0.000245 |
| loss | -0.0836 |
| n_updates | 1000 |
| policy_gradient_loss | -0.0525 |
| value_loss | 0.000679 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 244 |
| ep_rew_mean | 0.331 |
| time/ | |
| fps | 1109 |
| iterations | 252 |
| time_elapsed | 1860 |
| total_timesteps | 2064384 |
| train/ | |
| approx_kl | 0.11809596 |
| clip_fraction | 0.526 |
| clip_range | 0.147 |
| entropy_loss | -6.71 |
| explained_variance | 0.553 |
| learning_rate | 0.000245 |
| loss | -0.0845 |
| n_updates | 1004 |
| policy_gradient_loss | -0.0532 |
| value_loss | 0.000707 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.33 |
| time/ | |
| fps | 1109 |
| iterations | 253 |
| time_elapsed | 1867 |
| total_timesteps | 2072576 |
| train/ | |
| approx_kl | 0.11030411 |
| clip_fraction | 0.517 |
| clip_range | 0.147 |
| entropy_loss | -6.66 |
| explained_variance | 0.58 |
| learning_rate | 0.000245 |
| loss | -0.0853 |
| n_updates | 1008 |
| policy_gradient_loss | -0.0527 |
| value_loss | 0.000696 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.363 |
| time/ | |
| fps | 1110 |
| iterations | 254 |
| time_elapsed | 1874 |
| total_timesteps | 2080768 |
| train/ | |
| approx_kl | 0.106722206 |
| clip_fraction | 0.518 |
| clip_range | 0.147 |
| entropy_loss | -6.63 |
| explained_variance | 0.588 |
| learning_rate | 0.000245 |
| loss | -0.0868 |
| n_updates | 1012 |
| policy_gradient_loss | -0.0539 |
| value_loss | 0.000647 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.38 |
| time/ | |
| fps | 1110 |
| iterations | 255 |
| time_elapsed | 1881 |
| total_timesteps | 2088960 |
| train/ | |
| approx_kl | 0.10282806 |
| clip_fraction | 0.515 |
| clip_range | 0.147 |
| entropy_loss | -6.59 |
| explained_variance | 0.533 |
| learning_rate | 0.000245 |
| loss | -0.0815 |
| n_updates | 1016 |
| policy_gradient_loss | -0.0513 |
| value_loss | 0.000837 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 243 |
| ep_rew_mean | 0.396 |
| time/ | |
| fps | 1110 |
| iterations | 256 |
| time_elapsed | 1888 |
| total_timesteps | 2097152 |
| train/ | |
| approx_kl | 0.105213836 |
| clip_fraction | 0.523 |
| clip_range | 0.147 |
| entropy_loss | -6.64 |
| explained_variance | 0.553 |
| learning_rate | 0.000245 |
| loss | -0.082 |
| n_updates | 1020 |
| policy_gradient_loss | -0.0533 |
| value_loss | 0.000672 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 247 |
| ep_rew_mean | 0.373 |
| time/ | |
| fps | 1110 |
| iterations | 257 |
| time_elapsed | 1895 |
| total_timesteps | 2105344 |
| train/ | |
| approx_kl | 0.12586427 |
| clip_fraction | 0.518 |
| clip_range | 0.147 |
| entropy_loss | -6.64 |
| explained_variance | 0.504 |
| learning_rate | 0.000245 |
| loss | -0.0802 |
| n_updates | 1024 |
| policy_gradient_loss | -0.0521 |
| value_loss | 0.000706 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.373 |
| time/ | |
| fps | 1110 |
| iterations | 258 |
| time_elapsed | 1902 |
| total_timesteps | 2113536 |
| train/ | |
| approx_kl | 0.11450364 |
| clip_fraction | 0.525 |
| clip_range | 0.147 |
| entropy_loss | -6.67 |
| explained_variance | 0.55 |
| learning_rate | 0.000245 |
| loss | -0.0845 |
| n_updates | 1028 |
| policy_gradient_loss | -0.0524 |
| value_loss | 0.000756 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 248 |
| ep_rew_mean | 0.365 |
| time/ | |
| fps | 1110 |
| iterations | 259 |
| time_elapsed | 1909 |
| total_timesteps | 2121728 |
| train/ | |
| approx_kl | 0.11675545 |
| clip_fraction | 0.532 |
| clip_range | 0.147 |
| entropy_loss | -6.66 |
| explained_variance | 0.572 |
| learning_rate | 0.000245 |
| loss | -0.0817 |
| n_updates | 1032 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.000662 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 249 |
| ep_rew_mean | 0.348 |
| time/ | |
| fps | 1111 |
| iterations | 260 |
| time_elapsed | 1917 |
| total_timesteps | 2129920 |
| train/ | |
| approx_kl | 0.11905363 |
| clip_fraction | 0.522 |
| clip_range | 0.147 |
| entropy_loss | -6.7 |
| explained_variance | 0.539 |
| learning_rate | 0.000245 |
| loss | -0.0863 |
| n_updates | 1036 |
| policy_gradient_loss | -0.0515 |
| value_loss | 0.000692 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 245 |
| ep_rew_mean | 0.359 |
| time/ | |
| fps | 1111 |
| iterations | 261 |
| time_elapsed | 1924 |
| total_timesteps | 2138112 |
| train/ | |
| approx_kl | 0.13341506 |
| clip_fraction | 0.537 |
| clip_range | 0.147 |
| entropy_loss | -6.62 |
| explained_variance | 0.575 |
| learning_rate | 0.000245 |
| loss | -0.0802 |
| n_updates | 1040 |
| policy_gradient_loss | -0.0534 |
| value_loss | 0.000626 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 235 |
| ep_rew_mean | 0.359 |
| time/ | |
| fps | 1111 |
| iterations | 262 |
| time_elapsed | 1931 |
| total_timesteps | 2146304 |
| train/ | |
| approx_kl | 0.12757908 |
| clip_fraction | 0.537 |
| clip_range | 0.147 |
| entropy_loss | -6.59 |
| explained_variance | 0.534 |
| learning_rate | 0.000245 |
| loss | -0.0836 |
| n_updates | 1044 |
| policy_gradient_loss | -0.0542 |
| value_loss | 0.000829 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 226 |
| ep_rew_mean | 0.376 |
| time/ | |
| fps | 1111 |
| iterations | 263 |
| time_elapsed | 1938 |
| total_timesteps | 2154496 |
| train/ | |
| approx_kl | 0.11697957 |
| clip_fraction | 0.524 |
| clip_range | 0.147 |
| entropy_loss | -6.6 |
| explained_variance | 0.555 |
| learning_rate | 0.000245 |
| loss | -0.0884 |
| n_updates | 1048 |
| policy_gradient_loss | -0.0525 |
| value_loss | 0.000711 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.353 |
| time/ | |
| fps | 1111 |
| iterations | 264 |
| time_elapsed | 1945 |
| total_timesteps | 2162688 |
| train/ | |
| approx_kl | 0.11898437 |
| clip_fraction | 0.523 |
| clip_range | 0.147 |
| entropy_loss | -6.63 |
| explained_variance | 0.544 |
| learning_rate | 0.000245 |
| loss | -0.0863 |
| n_updates | 1052 |
| policy_gradient_loss | -0.0543 |
| value_loss | 0.000796 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.361 |
| time/ | |
| fps | 1111 |
| iterations | 265 |
| time_elapsed | 1952 |
| total_timesteps | 2170880 |
| train/ | |
| approx_kl | 0.1116631 |
| clip_fraction | 0.52 |
| clip_range | 0.147 |
| entropy_loss | -6.64 |
| explained_variance | 0.528 |
| learning_rate | 0.000245 |
| loss | -0.0835 |
| n_updates | 1056 |
| policy_gradient_loss | -0.0524 |
| value_loss | 0.000793 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 239 |
| ep_rew_mean | 0.347 |
| time/ | |
| fps | 1112 |
| iterations | 266 |
| time_elapsed | 1959 |
| total_timesteps | 2179072 |
| train/ | |
| approx_kl | 0.12220342 |
| clip_fraction | 0.536 |
| clip_range | 0.147 |
| entropy_loss | -6.63 |
| explained_variance | 0.542 |
| learning_rate | 0.000245 |
| loss | -0.0847 |
| n_updates | 1060 |
| policy_gradient_loss | -0.0539 |
| value_loss | 0.000742 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 236 |
| ep_rew_mean | 0.354 |
| time/ | |
| fps | 1112 |
| iterations | 267 |
| time_elapsed | 1966 |
| total_timesteps | 2187264 |
| train/ | |
| approx_kl | 0.11984712 |
| clip_fraction | 0.526 |
| clip_range | 0.147 |
| entropy_loss | -6.65 |
| explained_variance | 0.563 |
| learning_rate | 0.000245 |
| loss | -0.0796 |
| n_updates | 1064 |
| policy_gradient_loss | -0.0497 |
| value_loss | 0.000698 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 229 |
| ep_rew_mean | 0.348 |
| time/ | |
| fps | 1112 |
| iterations | 268 |
| time_elapsed | 1973 |
| total_timesteps | 2195456 |
| train/ | |
| approx_kl | 0.16792664 |
| clip_fraction | 0.522 |
| clip_range | 0.147 |
| entropy_loss | -6.64 |
| explained_variance | 0.543 |
| learning_rate | 0.000245 |
| loss | -0.0774 |
| n_updates | 1068 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.000834 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.355 |
| time/ | |
| fps | 1112 |
| iterations | 269 |
| time_elapsed | 1980 |
| total_timesteps | 2203648 |
| train/ | |
| approx_kl | 0.13075173 |
| clip_fraction | 0.543 |
| clip_range | 0.147 |
| entropy_loss | -6.57 |
| explained_variance | 0.549 |
| learning_rate | 0.000245 |
| loss | -0.0802 |
| n_updates | 1072 |
| policy_gradient_loss | -0.0535 |
| value_loss | 0.000738 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 232 |
| ep_rew_mean | 0.349 |
| time/ | |
| fps | 1112 |
| iterations | 270 |
| time_elapsed | 1987 |
| total_timesteps | 2211840 |
| train/ | |
| approx_kl | 0.13127384 |
| clip_fraction | 0.549 |
| clip_range | 0.147 |
| entropy_loss | -6.56 |
| explained_variance | 0.528 |
| learning_rate | 0.000245 |
| loss | -0.0763 |
| n_updates | 1076 |
| policy_gradient_loss | -0.052 |
| value_loss | 0.000766 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 238 |
| ep_rew_mean | 0.366 |
| time/ | |
| fps | 1112 |
| iterations | 271 |
| time_elapsed | 1994 |
| total_timesteps | 2220032 |
| train/ | |
| approx_kl | 0.118666574 |
| clip_fraction | 0.538 |
| clip_range | 0.147 |
| entropy_loss | -6.6 |
| explained_variance | 0.56 |
| learning_rate | 0.000245 |
| loss | -0.0835 |
| n_updates | 1080 |
| policy_gradient_loss | -0.0531 |
| value_loss | 0.000697 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.37 |
| time/ | |
| fps | 1112 |
| iterations | 272 |
| time_elapsed | 2002 |
| total_timesteps | 2228224 |
| train/ | |
| approx_kl | 0.12737373 |
| clip_fraction | 0.548 |
| clip_range | 0.147 |
| entropy_loss | -6.5 |
| explained_variance | 0.578 |
| learning_rate | 0.000245 |
| loss | -0.0857 |
| n_updates | 1084 |
| policy_gradient_loss | -0.0556 |
| value_loss | 0.000714 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.401 |
| time/ | |
| fps | 1112 |
| iterations | 273 |
| time_elapsed | 2009 |
| total_timesteps | 2236416 |
| train/ | |
| approx_kl | 0.13086809 |
| clip_fraction | 0.543 |
| clip_range | 0.147 |
| entropy_loss | -6.54 |
| explained_variance | 0.54 |
| learning_rate | 0.000244 |
| loss | -0.0868 |
| n_updates | 1088 |
| policy_gradient_loss | -0.0541 |
| value_loss | 0.000744 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.404 |
| time/ | |
| fps | 1113 |
| iterations | 274 |
| time_elapsed | 2016 |
| total_timesteps | 2244608 |
| train/ | |
| approx_kl | 0.13590792 |
| clip_fraction | 0.531 |
| clip_range | 0.147 |
| entropy_loss | -6.45 |
| explained_variance | 0.517 |
| learning_rate | 0.000244 |
| loss | -0.0864 |
| n_updates | 1092 |
| policy_gradient_loss | -0.0538 |
| value_loss | 0.000909 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.404 |
| time/ | |
| fps | 1113 |
| iterations | 275 |
| time_elapsed | 2023 |
| total_timesteps | 2252800 |
| train/ | |
| approx_kl | 0.119182885 |
| clip_fraction | 0.537 |
| clip_range | 0.147 |
| entropy_loss | -6.41 |
| explained_variance | 0.548 |
| learning_rate | 0.000244 |
| loss | -0.0758 |
| n_updates | 1096 |
| policy_gradient_loss | -0.053 |
| value_loss | 0.000867 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.394 |
| time/ | |
| fps | 1113 |
| iterations | 276 |
| time_elapsed | 2030 |
| total_timesteps | 2260992 |
| train/ | |
| approx_kl | 0.14524022 |
| clip_fraction | 0.549 |
| clip_range | 0.147 |
| entropy_loss | -6.52 |
| explained_variance | 0.56 |
| learning_rate | 0.000244 |
| loss | -0.0886 |
| n_updates | 1100 |
| policy_gradient_loss | -0.0541 |
| value_loss | 0.00072 |
----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.384 |
| time/ | |
| fps | 1113 |
| iterations | 277 |
| time_elapsed | 2037 |
| total_timesteps | 2269184 |
| train/ | |
| approx_kl | 0.129794 |
| clip_fraction | 0.546 |
| clip_range | 0.147 |
| entropy_loss | -6.41 |
| explained_variance | 0.522 |
| learning_rate | 0.000244 |
| loss | -0.0844 |
| n_updates | 1104 |
| policy_gradient_loss | -0.0513 |
| value_loss | 0.000923 |
--------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 223 |
| ep_rew_mean | 0.395 |
| time/ | |
| fps | 1113 |
| iterations | 278 |
| time_elapsed | 2045 |
| total_timesteps | 2277376 |
| train/ | |
| approx_kl | 0.13621642 |
| clip_fraction | 0.556 |
| clip_range | 0.147 |
| entropy_loss | -6.42 |
| explained_variance | 0.527 |
| learning_rate | 0.000244 |
| loss | -0.0912 |
| n_updates | 1108 |
| policy_gradient_loss | -0.0559 |
| value_loss | 0.000799 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 227 |
| ep_rew_mean | 0.376 |
| time/ | |
| fps | 1113 |
| iterations | 279 |
| time_elapsed | 2052 |
| total_timesteps | 2285568 |
| train/ | |
| approx_kl | 0.1455627 |
| clip_fraction | 0.55 |
| clip_range | 0.147 |
| entropy_loss | -6.44 |
| explained_variance | 0.579 |
| learning_rate | 0.000244 |
| loss | -0.0862 |
| n_updates | 1112 |
| policy_gradient_loss | -0.055 |
| value_loss | 0.000726 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 230 |
| ep_rew_mean | 0.356 |
| time/ | |
| fps | 1113 |
| iterations | 280 |
| time_elapsed | 2059 |
| total_timesteps | 2293760 |
| train/ | |
| approx_kl | 0.13505621 |
| clip_fraction | 0.54 |
| clip_range | 0.147 |
| entropy_loss | -6.39 |
| explained_variance | 0.547 |
| learning_rate | 0.000244 |
| loss | -0.082 |
| n_updates | 1116 |
| policy_gradient_loss | -0.0514 |
| value_loss | 0.000834 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.362 |
| time/ | |
| fps | 1113 |
| iterations | 281 |
| time_elapsed | 2066 |
| total_timesteps | 2301952 |
| train/ | |
| approx_kl | 0.14478296 |
| clip_fraction | 0.543 |
| clip_range | 0.147 |
| entropy_loss | -6.49 |
| explained_variance | 0.567 |
| learning_rate | 0.000244 |
| loss | -0.0916 |
| n_updates | 1120 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000716 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 233 |
| ep_rew_mean | 0.379 |
| time/ | |
| fps | 1114 |
| iterations | 282 |
| time_elapsed | 2073 |
| total_timesteps | 2310144 |
| train/ | |
| approx_kl | 0.16083223 |
| clip_fraction | 0.551 |
| clip_range | 0.147 |
| entropy_loss | -6.44 |
| explained_variance | 0.557 |
| learning_rate | 0.000244 |
| loss | -0.0827 |
| n_updates | 1124 |
| policy_gradient_loss | -0.0546 |
| value_loss | 0.000744 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.428 |
| time/ | |
| fps | 1114 |
| iterations | 283 |
| time_elapsed | 2080 |
| total_timesteps | 2318336 |
| train/ | |
| approx_kl | 0.13430959 |
| clip_fraction | 0.53 |
| clip_range | 0.147 |
| entropy_loss | -6.42 |
| explained_variance | 0.543 |
| learning_rate | 0.000244 |
| loss | -0.0831 |
| n_updates | 1128 |
| policy_gradient_loss | -0.0523 |
| value_loss | 0.00089 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 226 |
| ep_rew_mean | 0.411 |
| time/ | |
| fps | 1114 |
| iterations | 284 |
| time_elapsed | 2087 |
| total_timesteps | 2326528 |
| train/ | |
| approx_kl | 0.12128008 |
| clip_fraction | 0.536 |
| clip_range | 0.147 |
| entropy_loss | -6.42 |
| explained_variance | 0.497 |
| learning_rate | 0.000244 |
| loss | -0.0831 |
| n_updates | 1132 |
| policy_gradient_loss | -0.0543 |
| value_loss | 0.000951 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.427 |
| time/ | |
| fps | 1114 |
| iterations | 285 |
| time_elapsed | 2094 |
| total_timesteps | 2334720 |
| train/ | |
| approx_kl | 0.13199475 |
| clip_fraction | 0.55 |
| clip_range | 0.147 |
| entropy_loss | -6.39 |
| explained_variance | 0.55 |
| learning_rate | 0.000244 |
| loss | -0.0874 |
| n_updates | 1136 |
| policy_gradient_loss | -0.0549 |
| value_loss | 0.000778 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 231 |
| ep_rew_mean | 0.421 |
| time/ | |
| fps | 1114 |
| iterations | 286 |
| time_elapsed | 2101 |
| total_timesteps | 2342912 |
| train/ | |
| approx_kl | 0.17001414 |
| clip_fraction | 0.542 |
| clip_range | 0.147 |
| entropy_loss | -6.44 |
| explained_variance | 0.504 |
| learning_rate | 0.000244 |
| loss | -0.0849 |
| n_updates | 1140 |
| policy_gradient_loss | -0.0529 |
| value_loss | 0.000868 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 229 |
| ep_rew_mean | 0.447 |
| time/ | |
| fps | 1114 |
| iterations | 287 |
| time_elapsed | 2109 |
| total_timesteps | 2351104 |
| train/ | |
| approx_kl | 0.12955865 |
| clip_fraction | 0.546 |
| clip_range | 0.147 |
| entropy_loss | -6.29 |
| explained_variance | 0.57 |
| learning_rate | 0.000244 |
| loss | -0.0821 |
| n_updates | 1144 |
| policy_gradient_loss | -0.0537 |
| value_loss | 0.000795 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 225 |
| ep_rew_mean | 0.424 |
| time/ | |
| fps | 1114 |
| iterations | 288 |
| time_elapsed | 2116 |
| total_timesteps | 2359296 |
| train/ | |
| approx_kl | 0.14553112 |
| clip_fraction | 0.55 |
| clip_range | 0.147 |
| entropy_loss | -6.38 |
| explained_variance | 0.537 |
| learning_rate | 0.000244 |
| loss | -0.0831 |
| n_updates | 1148 |
| policy_gradient_loss | -0.0534 |
| value_loss | 0.000844 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 228 |
| ep_rew_mean | 0.411 |
| time/ | |
| fps | 1115 |
| iterations | 289 |
| time_elapsed | 2123 |
| total_timesteps | 2367488 |
| train/ | |
| approx_kl | 0.13292184 |
| clip_fraction | 0.546 |
| clip_range | 0.147 |
| entropy_loss | -6.3 |
| explained_variance | 0.528 |
| learning_rate | 0.000244 |
| loss | -0.0843 |
| n_updates | 1152 |
| policy_gradient_loss | -0.0516 |
| value_loss | 0.000929 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.4 |
| time/ | |
| fps | 1115 |
| iterations | 290 |
| time_elapsed | 2130 |
| total_timesteps | 2375680 |
| train/ | |
| approx_kl | 0.13757321 |
| clip_fraction | 0.546 |
| clip_range | 0.147 |
| entropy_loss | -6.28 |
| explained_variance | 0.558 |
| learning_rate | 0.000244 |
| loss | -0.0844 |
| n_updates | 1156 |
| policy_gradient_loss | -0.0545 |
| value_loss | 0.000779 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.425 |
| time/ | |
| fps | 1115 |
| iterations | 291 |
| time_elapsed | 2137 |
| total_timesteps | 2383872 |
| train/ | |
| approx_kl | 0.13122205 |
| clip_fraction | 0.545 |
| clip_range | 0.147 |
| entropy_loss | -6.33 |
| explained_variance | 0.541 |
| learning_rate | 0.000244 |
| loss | -0.0822 |
| n_updates | 1160 |
| policy_gradient_loss | -0.0535 |
| value_loss | 0.00085 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.438 |
| time/ | |
| fps | 1115 |
| iterations | 292 |
| time_elapsed | 2144 |
| total_timesteps | 2392064 |
| train/ | |
| approx_kl | 0.12804487 |
| clip_fraction | 0.528 |
| clip_range | 0.147 |
| entropy_loss | -6.23 |
| explained_variance | 0.544 |
| learning_rate | 0.000244 |
| loss | -0.0797 |
| n_updates | 1164 |
| policy_gradient_loss | -0.0499 |
| value_loss | 0.00102 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 223 |
| ep_rew_mean | 0.423 |
| time/ | |
| fps | 1115 |
| iterations | 293 |
| time_elapsed | 2152 |
| total_timesteps | 2400256 |
| train/ | |
| approx_kl | 0.121570036 |
| clip_fraction | 0.538 |
| clip_range | 0.147 |
| entropy_loss | -6.24 |
| explained_variance | 0.54 |
| learning_rate | 0.000244 |
| loss | -0.085 |
| n_updates | 1168 |
| policy_gradient_loss | -0.054 |
| value_loss | 0.000885 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 224 |
| ep_rew_mean | 0.457 |
| time/ | |
| fps | 1115 |
| iterations | 294 |
| time_elapsed | 2159 |
| total_timesteps | 2408448 |
| train/ | |
| approx_kl | 0.12496737 |
| clip_fraction | 0.532 |
| clip_range | 0.147 |
| entropy_loss | -6.24 |
| explained_variance | 0.568 |
| learning_rate | 0.000244 |
| loss | -0.0825 |
| n_updates | 1172 |
| policy_gradient_loss | -0.0523 |
| value_loss | 0.00091 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 214 |
| ep_rew_mean | 0.485 |
| time/ | |
| fps | 1115 |
| iterations | 295 |
| time_elapsed | 2166 |
| total_timesteps | 2416640 |
| train/ | |
| approx_kl | 0.14364733 |
| clip_fraction | 0.549 |
| clip_range | 0.147 |
| entropy_loss | -6.2 |
| explained_variance | 0.544 |
| learning_rate | 0.000244 |
| loss | -0.0859 |
| n_updates | 1176 |
| policy_gradient_loss | -0.0539 |
| value_loss | 0.000999 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 213 |
| ep_rew_mean | 0.48 |
| time/ | |
| fps | 1115 |
| iterations | 296 |
| time_elapsed | 2173 |
| total_timesteps | 2424832 |
| train/ | |
| approx_kl | 0.11831698 |
| clip_fraction | 0.543 |
| clip_range | 0.147 |
| entropy_loss | -6.12 |
| explained_variance | 0.553 |
| learning_rate | 0.000244 |
| loss | -0.0866 |
| n_updates | 1180 |
| policy_gradient_loss | -0.0527 |
| value_loss | 0.00106 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 206 |
| ep_rew_mean | 0.478 |
| time/ | |
| fps | 1115 |
| iterations | 297 |
| time_elapsed | 2180 |
| total_timesteps | 2433024 |
| train/ | |
| approx_kl | 0.14491293 |
| clip_fraction | 0.543 |
| clip_range | 0.147 |
| entropy_loss | -6.18 |
| explained_variance | 0.578 |
| learning_rate | 0.000244 |
| loss | -0.084 |
| n_updates | 1184 |
| policy_gradient_loss | -0.053 |
| value_loss | 0.000972 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 208 |
| ep_rew_mean | 0.465 |
| time/ | |
| fps | 1115 |
| iterations | 298 |
| time_elapsed | 2188 |
| total_timesteps | 2441216 |
| train/ | |
| approx_kl | 0.13459009 |
| clip_fraction | 0.554 |
| clip_range | 0.147 |
| entropy_loss | -6.1 |
| explained_variance | 0.505 |
| learning_rate | 0.000244 |
| loss | -0.0811 |
| n_updates | 1188 |
| policy_gradient_loss | -0.0506 |
| value_loss | 0.00119 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 204 |
| ep_rew_mean | 0.453 |
| time/ | |
| fps | 1115 |
| iterations | 299 |
| time_elapsed | 2195 |
| total_timesteps | 2449408 |
| train/ | |
| approx_kl | 0.13332029 |
| clip_fraction | 0.555 |
| clip_range | 0.147 |
| entropy_loss | -6.13 |
| explained_variance | 0.578 |
| learning_rate | 0.000244 |
| loss | -0.0761 |
| n_updates | 1192 |
| policy_gradient_loss | -0.0518 |
| value_loss | 0.000869 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 201 |
| ep_rew_mean | 0.481 |
| time/ | |
| fps | 1115 |
| iterations | 300 |
| time_elapsed | 2202 |
| total_timesteps | 2457600 |
| train/ | |
| approx_kl | 0.12881124 |
| clip_fraction | 0.549 |
| clip_range | 0.147 |
| entropy_loss | -6.12 |
| explained_variance | 0.611 |
| learning_rate | 0.000244 |
| loss | -0.074 |
| n_updates | 1196 |
| policy_gradient_loss | -0.048 |
| value_loss | 0.000997 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 200 |
| ep_rew_mean | 0.501 |
| time/ | |
| fps | 1115 |
| iterations | 301 |
| time_elapsed | 2210 |
| total_timesteps | 2465792 |
| train/ | |
| approx_kl | 0.13601755 |
| clip_fraction | 0.548 |
| clip_range | 0.147 |
| entropy_loss | -6.04 |
| explained_variance | 0.548 |
| learning_rate | 0.000244 |
| loss | -0.0755 |
| n_updates | 1200 |
| policy_gradient_loss | -0.0498 |
| value_loss | 0.00125 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 204 |
| ep_rew_mean | 0.494 |
| time/ | |
| fps | 1115 |
| iterations | 302 |
| time_elapsed | 2217 |
| total_timesteps | 2473984 |
| train/ | |
| approx_kl | 0.1639984 |
| clip_fraction | 0.541 |
| clip_range | 0.147 |
| entropy_loss | -6.06 |
| explained_variance | 0.556 |
| learning_rate | 0.000244 |
| loss | -0.0799 |
| n_updates | 1204 |
| policy_gradient_loss | -0.0491 |
| value_loss | 0.00111 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 211 |
| ep_rew_mean | 0.473 |
| time/ | |
| fps | 1115 |
| iterations | 303 |
| time_elapsed | 2224 |
| total_timesteps | 2482176 |
| train/ | |
| approx_kl | 0.15511459 |
| clip_fraction | 0.545 |
| clip_range | 0.147 |
| entropy_loss | -6.06 |
| explained_variance | 0.58 |
| learning_rate | 0.000244 |
| loss | -0.0837 |
| n_updates | 1208 |
| policy_gradient_loss | -0.052 |
| value_loss | 0.00105 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 193 |
| ep_rew_mean | 0.519 |
| time/ | |
| fps | 1115 |
| iterations | 304 |
| time_elapsed | 2232 |
| total_timesteps | 2490368 |
| train/ | |
| approx_kl | 0.13812377 |
| clip_fraction | 0.55 |
| clip_range | 0.147 |
| entropy_loss | -6.07 |
| explained_variance | 0.572 |
| learning_rate | 0.000244 |
| loss | -0.0802 |
| n_updates | 1212 |
| policy_gradient_loss | -0.0509 |
| value_loss | 0.000973 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 182 |
| ep_rew_mean | 0.547 |
| time/ | |
| fps | 1115 |
| iterations | 305 |
| time_elapsed | 2239 |
| total_timesteps | 2498560 |
| train/ | |
| approx_kl | 0.14407986 |
| clip_fraction | 0.543 |
| clip_range | 0.147 |
| entropy_loss | -5.82 |
| explained_variance | 0.548 |
| learning_rate | 0.000244 |
| loss | -0.0762 |
| n_updates | 1216 |
| policy_gradient_loss | -0.0489 |
| value_loss | 0.00158 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 195 |
| ep_rew_mean | 0.517 |
| time/ | |
| fps | 1115 |
| iterations | 306 |
| time_elapsed | 2246 |
| total_timesteps | 2506752 |
| train/ | |
| approx_kl | 0.15691206 |
| clip_fraction | 0.54 |
| clip_range | 0.147 |
| entropy_loss | -5.99 |
| explained_variance | 0.549 |
| learning_rate | 0.000244 |
| loss | -0.0731 |
| n_updates | 1220 |
| policy_gradient_loss | -0.0498 |
| value_loss | 0.00137 |
----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 204 |
| ep_rew_mean | 0.472 |
| time/ | |
| fps | 1116 |
| iterations | 307 |
| time_elapsed | 2253 |
| total_timesteps | 2514944 |
| train/ | |
| approx_kl | 0.132661 |
| clip_fraction | 0.545 |
| clip_range | 0.147 |
| entropy_loss | -6.07 |
| explained_variance | 0.604 |
| learning_rate | 0.000244 |
| loss | -0.0873 |
| n_updates | 1224 |
| policy_gradient_loss | -0.0528 |
| value_loss | 0.00101 |
--------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 209 |
| ep_rew_mean | 0.465 |
| time/ | |
| fps | 1116 |
| iterations | 308 |
| time_elapsed | 2260 |
| total_timesteps | 2523136 |
| train/ | |
| approx_kl | 0.12463517 |
| clip_fraction | 0.538 |
| clip_range | 0.147 |
| entropy_loss | -6.06 |
| explained_variance | 0.642 |
| learning_rate | 0.000244 |
| loss | -0.0617 |
| n_updates | 1228 |
| policy_gradient_loss | -0.0489 |
| value_loss | 0.000952 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 201 |
| ep_rew_mean | 0.493 |
| time/ | |
| fps | 1116 |
| iterations | 309 |
| time_elapsed | 2267 |
| total_timesteps | 2531328 |
| train/ | |
| approx_kl | 0.15407297 |
| clip_fraction | 0.534 |
| clip_range | 0.147 |
| entropy_loss | -6.08 |
| explained_variance | 0.645 |
| learning_rate | 0.000244 |
| loss | -0.0748 |
| n_updates | 1232 |
| policy_gradient_loss | -0.0512 |
| value_loss | 0.00103 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 190 |
| ep_rew_mean | 0.514 |
| time/ | |
| fps | 1116 |
| iterations | 310 |
| time_elapsed | 2274 |
| total_timesteps | 2539520 |
| train/ | |
| approx_kl | 0.12622729 |
| clip_fraction | 0.531 |
| clip_range | 0.147 |
| entropy_loss | -6.06 |
| explained_variance | 0.642 |
| learning_rate | 0.000244 |
| loss | -0.078 |
| n_updates | 1236 |
| policy_gradient_loss | -0.0512 |
| value_loss | 0.0011 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 190 |
| ep_rew_mean | 0.524 |
| time/ | |
| fps | 1116 |
| iterations | 311 |
| time_elapsed | 2281 |
| total_timesteps | 2547712 |
| train/ | |
| approx_kl | 0.15339619 |
| clip_fraction | 0.542 |
| clip_range | 0.147 |
| entropy_loss | -6.04 |
| explained_variance | 0.629 |
| learning_rate | 0.000244 |
| loss | -0.0824 |
| n_updates | 1240 |
| policy_gradient_loss | -0.0505 |
| value_loss | 0.0011 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 177 |
| ep_rew_mean | 0.566 |
| time/ | |
| fps | 1116 |
| iterations | 312 |
| time_elapsed | 2288 |
| total_timesteps | 2555904 |
| train/ | |
| approx_kl | 0.12907922 |
| clip_fraction | 0.538 |
| clip_range | 0.147 |
| entropy_loss | -5.95 |
| explained_variance | 0.6 |
| learning_rate | 0.000244 |
| loss | -0.0687 |
| n_updates | 1244 |
| policy_gradient_loss | -0.0453 |
| value_loss | 0.00137 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 177 |
| ep_rew_mean | 0.586 |
| time/ | |
| fps | 1116 |
| iterations | 313 |
| time_elapsed | 2295 |
| total_timesteps | 2564096 |
| train/ | |
| approx_kl | 0.13883483 |
| clip_fraction | 0.518 |
| clip_range | 0.147 |
| entropy_loss | -6.01 |
| explained_variance | 0.568 |
| learning_rate | 0.000244 |
| loss | -0.0734 |
| n_updates | 1248 |
| policy_gradient_loss | -0.0475 |
| value_loss | 0.00157 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 183 |
| ep_rew_mean | 0.565 |
| time/ | |
| fps | 1116 |
| iterations | 314 |
| time_elapsed | 2303 |
| total_timesteps | 2572288 |
| train/ | |
| approx_kl | 0.14125925 |
| clip_fraction | 0.521 |
| clip_range | 0.147 |
| entropy_loss | -6.04 |
| explained_variance | 0.591 |
| learning_rate | 0.000244 |
| loss | -0.0724 |
| n_updates | 1252 |
| policy_gradient_loss | -0.0472 |
| value_loss | 0.00157 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 185 |
| ep_rew_mean | 0.555 |
| time/ | |
| fps | 1116 |
| iterations | 315 |
| time_elapsed | 2310 |
| total_timesteps | 2580480 |
| train/ | |
| approx_kl | 0.13967541 |
| clip_fraction | 0.53 |
| clip_range | 0.147 |
| entropy_loss | -6.05 |
| explained_variance | 0.599 |
| learning_rate | 0.000244 |
| loss | -0.0767 |
| n_updates | 1256 |
| policy_gradient_loss | -0.0512 |
| value_loss | 0.00129 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 194 |
| ep_rew_mean | 0.527 |
| time/ | |
| fps | 1116 |
| iterations | 316 |
| time_elapsed | 2317 |
| total_timesteps | 2588672 |
| train/ | |
| approx_kl | 0.13846168 |
| clip_fraction | 0.537 |
| clip_range | 0.147 |
| entropy_loss | -6.08 |
| explained_variance | 0.598 |
| learning_rate | 0.000244 |
| loss | -0.0798 |
| n_updates | 1260 |
| policy_gradient_loss | -0.0493 |
| value_loss | 0.0012 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 187 |
| ep_rew_mean | 0.541 |
| time/ | |
| fps | 1117 |
| iterations | 317 |
| time_elapsed | 2324 |
| total_timesteps | 2596864 |
| train/ | |
| approx_kl | 0.15013278 |
| clip_fraction | 0.544 |
| clip_range | 0.147 |
| entropy_loss | -5.97 |
| explained_variance | 0.611 |
| learning_rate | 0.000244 |
| loss | -0.0754 |
| n_updates | 1264 |
| policy_gradient_loss | -0.0465 |
| value_loss | 0.00123 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 169 |
| ep_rew_mean | 0.595 |
| time/ | |
| fps | 1117 |
| iterations | 318 |
| time_elapsed | 2331 |
| total_timesteps | 2605056 |
| train/ | |
| approx_kl | 0.12882127 |
| clip_fraction | 0.539 |
| clip_range | 0.147 |
| entropy_loss | -5.98 |
| explained_variance | 0.606 |
| learning_rate | 0.000244 |
| loss | -0.069 |
| n_updates | 1268 |
| policy_gradient_loss | -0.0462 |
| value_loss | 0.00148 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 156 |
| ep_rew_mean | 0.616 |
| time/ | |
| fps | 1117 |
| iterations | 319 |
| time_elapsed | 2338 |
| total_timesteps | 2613248 |
| train/ | |
| approx_kl | 0.14171463 |
| clip_fraction | 0.527 |
| clip_range | 0.147 |
| entropy_loss | -5.91 |
| explained_variance | 0.582 |
| learning_rate | 0.000244 |
| loss | -0.0795 |
| n_updates | 1272 |
| policy_gradient_loss | -0.0471 |
| value_loss | 0.00171 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 150 |
| ep_rew_mean | 0.618 |
| time/ | |
| fps | 1117 |
| iterations | 320 |
| time_elapsed | 2345 |
| total_timesteps | 2621440 |
| train/ | |
| approx_kl | 0.11437479 |
| clip_fraction | 0.538 |
| clip_range | 0.147 |
| entropy_loss | -5.9 |
| explained_variance | 0.595 |
| learning_rate | 0.000244 |
| loss | -0.0667 |
| n_updates | 1276 |
| policy_gradient_loss | -0.0441 |
| value_loss | 0.00173 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 151 |
| ep_rew_mean | 0.631 |
| time/ | |
| fps | 1117 |
| iterations | 321 |
| time_elapsed | 2353 |
| total_timesteps | 2629632 |
| train/ | |
| approx_kl | 0.13215554 |
| clip_fraction | 0.54 |
| clip_range | 0.147 |
| entropy_loss | -5.9 |
| explained_variance | 0.552 |
| learning_rate | 0.000244 |
| loss | -0.0677 |
| n_updates | 1280 |
| policy_gradient_loss | -0.045 |
| value_loss | 0.00213 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 137 |
| ep_rew_mean | 0.653 |
| time/ | |
| fps | 1117 |
| iterations | 322 |
| time_elapsed | 2360 |
| total_timesteps | 2637824 |
| train/ | |
| approx_kl | 0.10379107 |
| clip_fraction | 0.523 |
| clip_range | 0.147 |
| entropy_loss | -5.84 |
| explained_variance | 0.646 |
| learning_rate | 0.000243 |
| loss | -0.0531 |
| n_updates | 1284 |
| policy_gradient_loss | -0.0399 |
| value_loss | 0.00189 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 126 |
| ep_rew_mean | 0.688 |
| time/ | |
| fps | 1117 |
| iterations | 323 |
| time_elapsed | 2367 |
| total_timesteps | 2646016 |
| train/ | |
| approx_kl | 0.1383547 |
| clip_fraction | 0.527 |
| clip_range | 0.147 |
| entropy_loss | -5.73 |
| explained_variance | 0.623 |
| learning_rate | 0.000243 |
| loss | -0.0453 |
| n_updates | 1288 |
| policy_gradient_loss | -0.0356 |
| value_loss | 0.00245 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 118 |
| ep_rew_mean | 0.699 |
| time/ | |
| fps | 1117 |
| iterations | 324 |
| time_elapsed | 2375 |
| total_timesteps | 2654208 |
| train/ | |
| approx_kl | 0.10181295 |
| clip_fraction | 0.523 |
| clip_range | 0.147 |
| entropy_loss | -5.66 |
| explained_variance | 0.574 |
| learning_rate | 0.000243 |
| loss | -0.0586 |
| n_updates | 1292 |
| policy_gradient_loss | -0.0383 |
| value_loss | 0.00286 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 109 |
| ep_rew_mean | 0.715 |
| time/ | |
| fps | 1117 |
| iterations | 325 |
| time_elapsed | 2382 |
| total_timesteps | 2662400 |
| train/ | |
| approx_kl | 0.10532946 |
| clip_fraction | 0.509 |
| clip_range | 0.147 |
| entropy_loss | -5.69 |
| explained_variance | 0.692 |
| learning_rate | 0.000243 |
| loss | -0.0506 |
| n_updates | 1296 |
| policy_gradient_loss | -0.0378 |
| value_loss | 0.00236 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 100 |
| ep_rew_mean | 0.739 |
| time/ | |
| fps | 1117 |
| iterations | 326 |
| time_elapsed | 2389 |
| total_timesteps | 2670592 |
| train/ | |
| approx_kl | 0.098842666 |
| clip_fraction | 0.492 |
| clip_range | 0.147 |
| entropy_loss | -5.52 |
| explained_variance | 0.747 |
| learning_rate | 0.000243 |
| loss | -0.0455 |
| n_updates | 1300 |
| policy_gradient_loss | -0.0305 |
| value_loss | 0.00256 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 104 |
| ep_rew_mean | 0.724 |
| time/ | |
| fps | 1117 |
| iterations | 327 |
| time_elapsed | 2397 |
| total_timesteps | 2678784 |
| train/ | |
| approx_kl | 0.10003296 |
| clip_fraction | 0.491 |
| clip_range | 0.147 |
| entropy_loss | -5.44 |
| explained_variance | 0.734 |
| learning_rate | 0.000243 |
| loss | -0.0553 |
| n_updates | 1304 |
| policy_gradient_loss | -0.0315 |
| value_loss | 0.00293 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 83 |
| ep_rew_mean | 0.772 |
| time/ | |
| fps | 1117 |
| iterations | 328 |
| time_elapsed | 2404 |
| total_timesteps | 2686976 |
| train/ | |
| approx_kl | 0.088681825 |
| clip_fraction | 0.493 |
| clip_range | 0.147 |
| entropy_loss | -5.4 |
| explained_variance | 0.778 |
| learning_rate | 0.000243 |
| loss | -0.0434 |
| n_updates | 1308 |
| policy_gradient_loss | -0.0337 |
| value_loss | 0.00244 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 75.8 |
| ep_rew_mean | 0.791 |
| time/ | |
| fps | 1117 |
| iterations | 329 |
| time_elapsed | 2412 |
| total_timesteps | 2695168 |
| train/ | |
| approx_kl | 0.08816405 |
| clip_fraction | 0.453 |
| clip_range | 0.147 |
| entropy_loss | -5.04 |
| explained_variance | 0.839 |
| learning_rate | 0.000243 |
| loss | -0.0451 |
| n_updates | 1312 |
| policy_gradient_loss | -0.0281 |
| value_loss | 0.00208 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 77.8 |
| ep_rew_mean | 0.785 |
| time/ | |
| fps | 1117 |
| iterations | 330 |
| time_elapsed | 2419 |
| total_timesteps | 2703360 |
| train/ | |
| approx_kl | 0.12182632 |
| clip_fraction | 0.477 |
| clip_range | 0.147 |
| entropy_loss | -4.78 |
| explained_variance | 0.865 |
| learning_rate | 0.000243 |
| loss | -0.0432 |
| n_updates | 1316 |
| policy_gradient_loss | -0.0287 |
| value_loss | 0.00185 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 75.7 |
| ep_rew_mean | 0.78 |
| time/ | |
| fps | 1117 |
| iterations | 331 |
| time_elapsed | 2426 |
| total_timesteps | 2711552 |
| train/ | |
| approx_kl | 0.0959728 |
| clip_fraction | 0.456 |
| clip_range | 0.147 |
| entropy_loss | -5.03 |
| explained_variance | 0.847 |
| learning_rate | 0.000243 |
| loss | -0.0328 |
| n_updates | 1320 |
| policy_gradient_loss | -0.0275 |
| value_loss | 0.00218 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 77.2 |
| ep_rew_mean | 0.787 |
| time/ | |
| fps | 1117 |
| iterations | 332 |
| time_elapsed | 2434 |
| total_timesteps | 2719744 |
| train/ | |
| approx_kl | 0.10346219 |
| clip_fraction | 0.442 |
| clip_range | 0.147 |
| entropy_loss | -4.9 |
| explained_variance | 0.832 |
| learning_rate | 0.000243 |
| loss | -0.0366 |
| n_updates | 1324 |
| policy_gradient_loss | -0.0284 |
| value_loss | 0.00238 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 64.3 |
| ep_rew_mean | 0.814 |
| time/ | |
| fps | 1117 |
| iterations | 333 |
| time_elapsed | 2441 |
| total_timesteps | 2727936 |
| train/ | |
| approx_kl | 0.10698733 |
| clip_fraction | 0.441 |
| clip_range | 0.147 |
| entropy_loss | -4.84 |
| explained_variance | 0.845 |
| learning_rate | 0.000243 |
| loss | -0.0349 |
| n_updates | 1328 |
| policy_gradient_loss | -0.0262 |
| value_loss | 0.00222 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 66.3 |
| ep_rew_mean | 0.812 |
| time/ | |
| fps | 1117 |
| iterations | 334 |
| time_elapsed | 2448 |
| total_timesteps | 2736128 |
| train/ | |
| approx_kl | 0.10190974 |
| clip_fraction | 0.428 |
| clip_range | 0.147 |
| entropy_loss | -4.51 |
| explained_variance | 0.86 |
| learning_rate | 0.000243 |
| loss | -0.0352 |
| n_updates | 1332 |
| policy_gradient_loss | -0.0259 |
| value_loss | 0.00195 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 73 |
| ep_rew_mean | 0.793 |
| time/ | |
| fps | 1117 |
| iterations | 335 |
| time_elapsed | 2456 |
| total_timesteps | 2744320 |
| train/ | |
| approx_kl | 0.12077798 |
| clip_fraction | 0.442 |
| clip_range | 0.147 |
| entropy_loss | -4.67 |
| explained_variance | 0.893 |
| learning_rate | 0.000243 |
| loss | -0.039 |
| n_updates | 1336 |
| policy_gradient_loss | -0.0255 |
| value_loss | 0.00159 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.8 |
| ep_rew_mean | 0.827 |
| time/ | |
| fps | 1117 |
| iterations | 336 |
| time_elapsed | 2463 |
| total_timesteps | 2752512 |
| train/ | |
| approx_kl | 0.11206142 |
| clip_fraction | 0.474 |
| clip_range | 0.147 |
| entropy_loss | -4.72 |
| explained_variance | 0.859 |
| learning_rate | 0.000243 |
| loss | -0.0371 |
| n_updates | 1340 |
| policy_gradient_loss | -0.0279 |
| value_loss | 0.00209 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 69 |
| ep_rew_mean | 0.804 |
| time/ | |
| fps | 1117 |
| iterations | 337 |
| time_elapsed | 2471 |
| total_timesteps | 2760704 |
| train/ | |
| approx_kl | 0.121503904 |
| clip_fraction | 0.416 |
| clip_range | 0.147 |
| entropy_loss | -4.27 |
| explained_variance | 0.867 |
| learning_rate | 0.000243 |
| loss | -0.0233 |
| n_updates | 1344 |
| policy_gradient_loss | -0.0209 |
| value_loss | 0.00172 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 75.4 |
| ep_rew_mean | 0.79 |
| time/ | |
| fps | 1117 |
| iterations | 338 |
| time_elapsed | 2478 |
| total_timesteps | 2768896 |
| train/ | |
| approx_kl | 0.090770155 |
| clip_fraction | 0.44 |
| clip_range | 0.147 |
| entropy_loss | -4.68 |
| explained_variance | 0.885 |
| learning_rate | 0.000243 |
| loss | -0.0503 |
| n_updates | 1348 |
| policy_gradient_loss | -0.0325 |
| value_loss | 0.00158 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 59.7 |
| ep_rew_mean | 0.826 |
| time/ | |
| fps | 1117 |
| iterations | 339 |
| time_elapsed | 2486 |
| total_timesteps | 2777088 |
| train/ | |
| approx_kl | 0.09936334 |
| clip_fraction | 0.473 |
| clip_range | 0.147 |
| entropy_loss | -4.83 |
| explained_variance | 0.868 |
| learning_rate | 0.000243 |
| loss | -0.0476 |
| n_updates | 1352 |
| policy_gradient_loss | -0.034 |
| value_loss | 0.0019 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.3 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1117 |
| iterations | 340 |
| time_elapsed | 2493 |
| total_timesteps | 2785280 |
| train/ | |
| approx_kl | 0.09695612 |
| clip_fraction | 0.444 |
| clip_range | 0.147 |
| entropy_loss | -4.37 |
| explained_variance | 0.894 |
| learning_rate | 0.000243 |
| loss | -0.0267 |
| n_updates | 1356 |
| policy_gradient_loss | -0.0245 |
| value_loss | 0.00148 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 69 |
| ep_rew_mean | 0.803 |
| time/ | |
| fps | 1116 |
| iterations | 341 |
| time_elapsed | 2500 |
| total_timesteps | 2793472 |
| train/ | |
| approx_kl | 0.10034038 |
| clip_fraction | 0.423 |
| clip_range | 0.147 |
| entropy_loss | -4.35 |
| explained_variance | 0.876 |
| learning_rate | 0.000243 |
| loss | -0.0401 |
| n_updates | 1360 |
| policy_gradient_loss | -0.0258 |
| value_loss | 0.00157 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 68 |
| ep_rew_mean | 0.8 |
| time/ | |
| fps | 1116 |
| iterations | 342 |
| time_elapsed | 2508 |
| total_timesteps | 2801664 |
| train/ | |
| approx_kl | 0.0823106 |
| clip_fraction | 0.432 |
| clip_range | 0.147 |
| entropy_loss | -4.85 |
| explained_variance | 0.889 |
| learning_rate | 0.000243 |
| loss | -0.048 |
| n_updates | 1364 |
| policy_gradient_loss | -0.0287 |
| value_loss | 0.00158 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 76.9 |
| ep_rew_mean | 0.787 |
| time/ | |
| fps | 1116 |
| iterations | 343 |
| time_elapsed | 2515 |
| total_timesteps | 2809856 |
| train/ | |
| approx_kl | 0.100632004 |
| clip_fraction | 0.435 |
| clip_range | 0.146 |
| entropy_loss | -4.86 |
| explained_variance | 0.863 |
| learning_rate | 0.000243 |
| loss | -0.0509 |
| n_updates | 1368 |
| policy_gradient_loss | -0.0309 |
| value_loss | 0.00197 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 79 |
| ep_rew_mean | 0.784 |
| time/ | |
| fps | 1116 |
| iterations | 344 |
| time_elapsed | 2522 |
| total_timesteps | 2818048 |
| train/ | |
| approx_kl | 0.08695326 |
| clip_fraction | 0.47 |
| clip_range | 0.146 |
| entropy_loss | -5.06 |
| explained_variance | 0.892 |
| learning_rate | 0.000243 |
| loss | -0.0418 |
| n_updates | 1372 |
| policy_gradient_loss | -0.0325 |
| value_loss | 0.00159 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 82 |
| ep_rew_mean | 0.773 |
| time/ | |
| fps | 1117 |
| iterations | 345 |
| time_elapsed | 2530 |
| total_timesteps | 2826240 |
| train/ | |
| approx_kl | 0.09384805 |
| clip_fraction | 0.451 |
| clip_range | 0.146 |
| entropy_loss | -5.2 |
| explained_variance | 0.867 |
| learning_rate | 0.000243 |
| loss | -0.0388 |
| n_updates | 1376 |
| policy_gradient_loss | -0.0304 |
| value_loss | 0.00197 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 74.9 |
| ep_rew_mean | 0.786 |
| time/ | |
| fps | 1117 |
| iterations | 346 |
| time_elapsed | 2537 |
| total_timesteps | 2834432 |
| train/ | |
| approx_kl | 0.09023023 |
| clip_fraction | 0.466 |
| clip_range | 0.146 |
| entropy_loss | -5.33 |
| explained_variance | 0.886 |
| learning_rate | 0.000243 |
| loss | -0.0572 |
| n_updates | 1380 |
| policy_gradient_loss | -0.0352 |
| value_loss | 0.00167 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 68.4 |
| ep_rew_mean | 0.804 |
| time/ | |
| fps | 1117 |
| iterations | 347 |
| time_elapsed | 2544 |
| total_timesteps | 2842624 |
| train/ | |
| approx_kl | 0.09198037 |
| clip_fraction | 0.453 |
| clip_range | 0.146 |
| entropy_loss | -5.1 |
| explained_variance | 0.859 |
| learning_rate | 0.000243 |
| loss | -0.0378 |
| n_updates | 1384 |
| policy_gradient_loss | -0.0284 |
| value_loss | 0.00218 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 69.1 |
| ep_rew_mean | 0.802 |
| time/ | |
| fps | 1117 |
| iterations | 348 |
| time_elapsed | 2551 |
| total_timesteps | 2850816 |
| train/ | |
| approx_kl | 0.10016458 |
| clip_fraction | 0.431 |
| clip_range | 0.146 |
| entropy_loss | -4.87 |
| explained_variance | 0.867 |
| learning_rate | 0.000243 |
| loss | -0.0328 |
| n_updates | 1388 |
| policy_gradient_loss | -0.0252 |
| value_loss | 0.00199 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 66.5 |
| ep_rew_mean | 0.797 |
| time/ | |
| fps | 1117 |
| iterations | 349 |
| time_elapsed | 2558 |
| total_timesteps | 2859008 |
| train/ | |
| approx_kl | 0.079433545 |
| clip_fraction | 0.438 |
| clip_range | 0.146 |
| entropy_loss | -4.99 |
| explained_variance | 0.908 |
| learning_rate | 0.000243 |
| loss | -0.0466 |
| n_updates | 1392 |
| policy_gradient_loss | -0.0303 |
| value_loss | 0.00135 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 65.7 |
| ep_rew_mean | 0.806 |
| time/ | |
| fps | 1117 |
| iterations | 350 |
| time_elapsed | 2565 |
| total_timesteps | 2867200 |
| train/ | |
| approx_kl | 0.09186341 |
| clip_fraction | 0.459 |
| clip_range | 0.146 |
| entropy_loss | -4.94 |
| explained_variance | 0.884 |
| learning_rate | 0.000243 |
| loss | -0.0388 |
| n_updates | 1396 |
| policy_gradient_loss | -0.029 |
| value_loss | 0.00176 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 75.8 |
| ep_rew_mean | 0.781 |
| time/ | |
| fps | 1117 |
| iterations | 351 |
| time_elapsed | 2572 |
| total_timesteps | 2875392 |
| train/ | |
| approx_kl | 0.10064159 |
| clip_fraction | 0.43 |
| clip_range | 0.146 |
| entropy_loss | -5.03 |
| explained_variance | 0.9 |
| learning_rate | 0.000243 |
| loss | -0.0438 |
| n_updates | 1400 |
| policy_gradient_loss | -0.0293 |
| value_loss | 0.00156 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 65.8 |
| ep_rew_mean | 0.809 |
| time/ | |
| fps | 1117 |
| iterations | 352 |
| time_elapsed | 2579 |
| total_timesteps | 2883584 |
| train/ | |
| approx_kl | 0.08071382 |
| clip_fraction | 0.457 |
| clip_range | 0.146 |
| entropy_loss | -5.23 |
| explained_variance | 0.883 |
| learning_rate | 0.000243 |
| loss | -0.0489 |
| n_updates | 1404 |
| policy_gradient_loss | -0.0321 |
| value_loss | 0.00179 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 67.1 |
| ep_rew_mean | 0.813 |
| time/ | |
| fps | 1117 |
| iterations | 353 |
| time_elapsed | 2586 |
| total_timesteps | 2891776 |
| train/ | |
| approx_kl | 0.09713361 |
| clip_fraction | 0.449 |
| clip_range | 0.146 |
| entropy_loss | -4.93 |
| explained_variance | 0.882 |
| learning_rate | 0.000243 |
| loss | -0.0425 |
| n_updates | 1408 |
| policy_gradient_loss | -0.0295 |
| value_loss | 0.00173 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 66.1 |
| ep_rew_mean | 0.816 |
| time/ | |
| fps | 1117 |
| iterations | 354 |
| time_elapsed | 2593 |
| total_timesteps | 2899968 |
| train/ | |
| approx_kl | 0.117174566 |
| clip_fraction | 0.445 |
| clip_range | 0.146 |
| entropy_loss | -5.09 |
| explained_variance | 0.892 |
| learning_rate | 0.000243 |
| loss | -0.0478 |
| n_updates | 1412 |
| policy_gradient_loss | -0.031 |
| value_loss | 0.00159 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 67.5 |
| ep_rew_mean | 0.804 |
| time/ | |
| fps | 1118 |
| iterations | 355 |
| time_elapsed | 2601 |
| total_timesteps | 2908160 |
| train/ | |
| approx_kl | 0.07256302 |
| clip_fraction | 0.428 |
| clip_range | 0.146 |
| entropy_loss | -5.08 |
| explained_variance | 0.875 |
| learning_rate | 0.000243 |
| loss | -0.047 |
| n_updates | 1416 |
| policy_gradient_loss | -0.0265 |
| value_loss | 0.00187 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 67.1 |
| ep_rew_mean | 0.805 |
| time/ | |
| fps | 1118 |
| iterations | 356 |
| time_elapsed | 2608 |
| total_timesteps | 2916352 |
| train/ | |
| approx_kl | 0.08238462 |
| clip_fraction | 0.458 |
| clip_range | 0.146 |
| entropy_loss | -5.17 |
| explained_variance | 0.896 |
| learning_rate | 0.000243 |
| loss | -0.0415 |
| n_updates | 1420 |
| policy_gradient_loss | -0.0318 |
| value_loss | 0.00158 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 64.7 |
| ep_rew_mean | 0.813 |
| time/ | |
| fps | 1118 |
| iterations | 357 |
| time_elapsed | 2615 |
| total_timesteps | 2924544 |
| train/ | |
| approx_kl | 0.093546055 |
| clip_fraction | 0.452 |
| clip_range | 0.146 |
| entropy_loss | -5.22 |
| explained_variance | 0.891 |
| learning_rate | 0.000243 |
| loss | -0.0378 |
| n_updates | 1424 |
| policy_gradient_loss | -0.0313 |
| value_loss | 0.00162 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 65 |
| ep_rew_mean | 0.81 |
| time/ | |
| fps | 1118 |
| iterations | 358 |
| time_elapsed | 2621 |
| total_timesteps | 2932736 |
| train/ | |
| approx_kl | 0.105299726 |
| clip_fraction | 0.421 |
| clip_range | 0.146 |
| entropy_loss | -4.94 |
| explained_variance | 0.907 |
| learning_rate | 0.000243 |
| loss | -0.0326 |
| n_updates | 1428 |
| policy_gradient_loss | -0.0275 |
| value_loss | 0.00138 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 61 |
| ep_rew_mean | 0.816 |
| time/ | |
| fps | 1118 |
| iterations | 359 |
| time_elapsed | 2629 |
| total_timesteps | 2940928 |
| train/ | |
| approx_kl | 0.090708524 |
| clip_fraction | 0.432 |
| clip_range | 0.146 |
| entropy_loss | -4.81 |
| explained_variance | 0.906 |
| learning_rate | 0.000243 |
| loss | -0.0294 |
| n_updates | 1432 |
| policy_gradient_loss | -0.0281 |
| value_loss | 0.00133 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 65.6 |
| ep_rew_mean | 0.808 |
| time/ | |
| fps | 1118 |
| iterations | 360 |
| time_elapsed | 2636 |
| total_timesteps | 2949120 |
| train/ | |
| approx_kl | 0.08802066 |
| clip_fraction | 0.454 |
| clip_range | 0.146 |
| entropy_loss | -4.77 |
| explained_variance | 0.924 |
| learning_rate | 0.000243 |
| loss | -0.0476 |
| n_updates | 1436 |
| policy_gradient_loss | -0.0275 |
| value_loss | 0.00111 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 63.4 |
| ep_rew_mean | 0.817 |
| time/ | |
| fps | 1118 |
| iterations | 361 |
| time_elapsed | 2643 |
| total_timesteps | 2957312 |
| train/ | |
| approx_kl | 0.08810686 |
| clip_fraction | 0.452 |
| clip_range | 0.146 |
| entropy_loss | -5 |
| explained_variance | 0.903 |
| learning_rate | 0.000243 |
| loss | -0.0462 |
| n_updates | 1440 |
| policy_gradient_loss | -0.0289 |
| value_loss | 0.00144 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 64.1 |
| ep_rew_mean | 0.807 |
| time/ | |
| fps | 1119 |
| iterations | 362 |
| time_elapsed | 2650 |
| total_timesteps | 2965504 |
| train/ | |
| approx_kl | 0.092682995 |
| clip_fraction | 0.432 |
| clip_range | 0.146 |
| entropy_loss | -4.91 |
| explained_variance | 0.902 |
| learning_rate | 0.000243 |
| loss | -0.0343 |
| n_updates | 1444 |
| policy_gradient_loss | -0.0268 |
| value_loss | 0.00141 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 75.2 |
| ep_rew_mean | 0.792 |
| time/ | |
| fps | 1119 |
| iterations | 363 |
| time_elapsed | 2657 |
| total_timesteps | 2973696 |
| train/ | |
| approx_kl | 0.083926834 |
| clip_fraction | 0.454 |
| clip_range | 0.146 |
| entropy_loss | -5 |
| explained_variance | 0.903 |
| learning_rate | 0.000243 |
| loss | -0.0395 |
| n_updates | 1448 |
| policy_gradient_loss | -0.0291 |
| value_loss | 0.00144 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 71.9 |
| ep_rew_mean | 0.783 |
| time/ | |
| fps | 1119 |
| iterations | 364 |
| time_elapsed | 2663 |
| total_timesteps | 2981888 |
| train/ | |
| approx_kl | 0.07594952 |
| clip_fraction | 0.459 |
| clip_range | 0.146 |
| entropy_loss | -5.34 |
| explained_variance | 0.876 |
| learning_rate | 0.000243 |
| loss | -0.0485 |
| n_updates | 1452 |
| policy_gradient_loss | -0.0332 |
| value_loss | 0.00185 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 65 |
| ep_rew_mean | 0.8 |
| time/ | |
| fps | 1119 |
| iterations | 365 |
| time_elapsed | 2671 |
| total_timesteps | 2990080 |
| train/ | |
| approx_kl | 0.084617056 |
| clip_fraction | 0.433 |
| clip_range | 0.146 |
| entropy_loss | -5.23 |
| explained_variance | 0.902 |
| learning_rate | 0.000243 |
| loss | -0.0449 |
| n_updates | 1456 |
| policy_gradient_loss | -0.0324 |
| value_loss | 0.00145 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 69.2 |
| ep_rew_mean | 0.796 |
| time/ | |
| fps | 1119 |
| iterations | 366 |
| time_elapsed | 2678 |
| total_timesteps | 2998272 |
| train/ | |
| approx_kl | 0.091500655 |
| clip_fraction | 0.46 |
| clip_range | 0.146 |
| entropy_loss | -5.06 |
| explained_variance | 0.893 |
| learning_rate | 0.000243 |
| loss | -0.0367 |
| n_updates | 1460 |
| policy_gradient_loss | -0.0301 |
| value_loss | 0.00155 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 59.9 |
| ep_rew_mean | 0.826 |
| time/ | |
| fps | 1119 |
| iterations | 367 |
| time_elapsed | 2685 |
| total_timesteps | 3006464 |
| train/ | |
| approx_kl | 0.08061509 |
| clip_fraction | 0.437 |
| clip_range | 0.146 |
| entropy_loss | -5.22 |
| explained_variance | 0.897 |
| learning_rate | 0.000243 |
| loss | -0.04 |
| n_updates | 1464 |
| policy_gradient_loss | -0.0293 |
| value_loss | 0.00156 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 64.3 |
| ep_rew_mean | 0.815 |
| time/ | |
| fps | 1119 |
| iterations | 368 |
| time_elapsed | 2692 |
| total_timesteps | 3014656 |
| train/ | |
| approx_kl | 0.0826277 |
| clip_fraction | 0.383 |
| clip_range | 0.146 |
| entropy_loss | -4.84 |
| explained_variance | 0.92 |
| learning_rate | 0.000243 |
| loss | -0.0258 |
| n_updates | 1468 |
| policy_gradient_loss | -0.0231 |
| value_loss | 0.00101 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.8 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1119 |
| iterations | 369 |
| time_elapsed | 2699 |
| total_timesteps | 3022848 |
| train/ | |
| approx_kl | 0.06985395 |
| clip_fraction | 0.403 |
| clip_range | 0.146 |
| entropy_loss | -5.11 |
| explained_variance | 0.874 |
| learning_rate | 0.000243 |
| loss | -0.0361 |
| n_updates | 1472 |
| policy_gradient_loss | -0.0253 |
| value_loss | 0.00168 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 59 |
| ep_rew_mean | 0.822 |
| time/ | |
| fps | 1119 |
| iterations | 370 |
| time_elapsed | 2706 |
| total_timesteps | 3031040 |
| train/ | |
| approx_kl | 0.09784728 |
| clip_fraction | 0.416 |
| clip_range | 0.146 |
| entropy_loss | -4.77 |
| explained_variance | 0.907 |
| learning_rate | 0.000243 |
| loss | -0.0345 |
| n_updates | 1476 |
| policy_gradient_loss | -0.0218 |
| value_loss | 0.00106 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 56.8 |
| ep_rew_mean | 0.819 |
| time/ | |
| fps | 1119 |
| iterations | 371 |
| time_elapsed | 2713 |
| total_timesteps | 3039232 |
| train/ | |
| approx_kl | 0.10295618 |
| clip_fraction | 0.402 |
| clip_range | 0.146 |
| entropy_loss | -5.03 |
| explained_variance | 0.91 |
| learning_rate | 0.000242 |
| loss | -0.0366 |
| n_updates | 1480 |
| policy_gradient_loss | -0.0295 |
| value_loss | 0.00118 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 62.9 |
| ep_rew_mean | 0.816 |
| time/ | |
| fps | 1119 |
| iterations | 372 |
| time_elapsed | 2720 |
| total_timesteps | 3047424 |
| train/ | |
| approx_kl | 0.07214656 |
| clip_fraction | 0.419 |
| clip_range | 0.146 |
| entropy_loss | -4.86 |
| explained_variance | 0.91 |
| learning_rate | 0.000242 |
| loss | -0.0369 |
| n_updates | 1484 |
| policy_gradient_loss | -0.0227 |
| value_loss | 0.0011 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 77 |
| ep_rew_mean | 0.778 |
| time/ | |
| fps | 1120 |
| iterations | 373 |
| time_elapsed | 2728 |
| total_timesteps | 3055616 |
| train/ | |
| approx_kl | 0.08703825 |
| clip_fraction | 0.449 |
| clip_range | 0.146 |
| entropy_loss | -5.14 |
| explained_variance | 0.928 |
| learning_rate | 0.000242 |
| loss | -0.0393 |
| n_updates | 1488 |
| policy_gradient_loss | -0.0268 |
| value_loss | 0.00114 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 79.3 |
| ep_rew_mean | 0.78 |
| time/ | |
| fps | 1120 |
| iterations | 374 |
| time_elapsed | 2735 |
| total_timesteps | 3063808 |
| train/ | |
| approx_kl | 0.09813295 |
| clip_fraction | 0.477 |
| clip_range | 0.146 |
| entropy_loss | -5.44 |
| explained_variance | 0.911 |
| learning_rate | 0.000242 |
| loss | -0.0523 |
| n_updates | 1492 |
| policy_gradient_loss | -0.0349 |
| value_loss | 0.00144 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 62 |
| ep_rew_mean | 0.815 |
| time/ | |
| fps | 1120 |
| iterations | 375 |
| time_elapsed | 2742 |
| total_timesteps | 3072000 |
| train/ | |
| approx_kl | 0.101370454 |
| clip_fraction | 0.451 |
| clip_range | 0.146 |
| entropy_loss | -5.49 |
| explained_variance | 0.914 |
| learning_rate | 0.000242 |
| loss | -0.0362 |
| n_updates | 1496 |
| policy_gradient_loss | -0.0316 |
| value_loss | 0.0014 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 65.5 |
| ep_rew_mean | 0.794 |
| time/ | |
| fps | 1120 |
| iterations | 376 |
| time_elapsed | 2749 |
| total_timesteps | 3080192 |
| train/ | |
| approx_kl | 0.09665693 |
| clip_fraction | 0.431 |
| clip_range | 0.146 |
| entropy_loss | -5.17 |
| explained_variance | 0.899 |
| learning_rate | 0.000242 |
| loss | -0.037 |
| n_updates | 1500 |
| policy_gradient_loss | -0.0263 |
| value_loss | 0.00149 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57 |
| ep_rew_mean | 0.832 |
| time/ | |
| fps | 1120 |
| iterations | 377 |
| time_elapsed | 2756 |
| total_timesteps | 3088384 |
| train/ | |
| approx_kl | 0.07535775 |
| clip_fraction | 0.444 |
| clip_range | 0.146 |
| entropy_loss | -5.29 |
| explained_variance | 0.915 |
| learning_rate | 0.000242 |
| loss | -0.0549 |
| n_updates | 1504 |
| policy_gradient_loss | -0.0311 |
| value_loss | 0.00128 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.6 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1120 |
| iterations | 378 |
| time_elapsed | 2763 |
| total_timesteps | 3096576 |
| train/ | |
| approx_kl | 0.09817378 |
| clip_fraction | 0.409 |
| clip_range | 0.146 |
| entropy_loss | -4.9 |
| explained_variance | 0.933 |
| learning_rate | 0.000242 |
| loss | -0.0391 |
| n_updates | 1508 |
| policy_gradient_loss | -0.026 |
| value_loss | 0.000875 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 59.8 |
| ep_rew_mean | 0.823 |
| time/ | |
| fps | 1120 |
| iterations | 379 |
| time_elapsed | 2771 |
| total_timesteps | 3104768 |
| train/ | |
| approx_kl | 0.10071172 |
| clip_fraction | 0.4 |
| clip_range | 0.146 |
| entropy_loss | -4.8 |
| explained_variance | 0.897 |
| learning_rate | 0.000242 |
| loss | -0.0247 |
| n_updates | 1512 |
| policy_gradient_loss | -0.0193 |
| value_loss | 0.00125 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1120 |
| iterations | 380 |
| time_elapsed | 2777 |
| total_timesteps | 3112960 |
| train/ | |
| approx_kl | 0.07438055 |
| clip_fraction | 0.37 |
| clip_range | 0.146 |
| entropy_loss | -4.74 |
| explained_variance | 0.933 |
| learning_rate | 0.000242 |
| loss | -0.0314 |
| n_updates | 1516 |
| policy_gradient_loss | -0.0222 |
| value_loss | 0.000765 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.3 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1120 |
| iterations | 381 |
| time_elapsed | 2784 |
| total_timesteps | 3121152 |
| train/ | |
| approx_kl | 0.070820585 |
| clip_fraction | 0.419 |
| clip_range | 0.146 |
| entropy_loss | -4.58 |
| explained_variance | 0.948 |
| learning_rate | 0.000242 |
| loss | -0.0274 |
| n_updates | 1520 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000562 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.1 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1120 |
| iterations | 382 |
| time_elapsed | 2792 |
| total_timesteps | 3129344 |
| train/ | |
| approx_kl | 0.08813757 |
| clip_fraction | 0.392 |
| clip_range | 0.146 |
| entropy_loss | -4.66 |
| explained_variance | 0.934 |
| learning_rate | 0.000242 |
| loss | -0.0248 |
| n_updates | 1524 |
| policy_gradient_loss | -0.0208 |
| value_loss | 0.000786 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.8 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1120 |
| iterations | 383 |
| time_elapsed | 2799 |
| total_timesteps | 3137536 |
| train/ | |
| approx_kl | 0.09866084 |
| clip_fraction | 0.387 |
| clip_range | 0.146 |
| entropy_loss | -4.8 |
| explained_variance | 0.904 |
| learning_rate | 0.000242 |
| loss | -0.0304 |
| n_updates | 1528 |
| policy_gradient_loss | -0.0227 |
| value_loss | 0.00117 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.5 |
| ep_rew_mean | 0.832 |
| time/ | |
| fps | 1121 |
| iterations | 384 |
| time_elapsed | 2806 |
| total_timesteps | 3145728 |
| train/ | |
| approx_kl | 0.08429769 |
| clip_fraction | 0.352 |
| clip_range | 0.146 |
| entropy_loss | -4.63 |
| explained_variance | 0.942 |
| learning_rate | 0.000242 |
| loss | -0.0229 |
| n_updates | 1532 |
| policy_gradient_loss | -0.022 |
| value_loss | 0.00057 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.7 |
| ep_rew_mean | 0.828 |
| time/ | |
| fps | 1121 |
| iterations | 385 |
| time_elapsed | 2813 |
| total_timesteps | 3153920 |
| train/ | |
| approx_kl | 0.08888651 |
| clip_fraction | 0.402 |
| clip_range | 0.146 |
| entropy_loss | -4.86 |
| explained_variance | 0.928 |
| learning_rate | 0.000242 |
| loss | -0.0331 |
| n_updates | 1536 |
| policy_gradient_loss | -0.0246 |
| value_loss | 0.000919 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.6 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1121 |
| iterations | 386 |
| time_elapsed | 2820 |
| total_timesteps | 3162112 |
| train/ | |
| approx_kl | 0.08318235 |
| clip_fraction | 0.431 |
| clip_range | 0.146 |
| entropy_loss | -4.84 |
| explained_variance | 0.902 |
| learning_rate | 0.000242 |
| loss | -0.0369 |
| n_updates | 1540 |
| policy_gradient_loss | -0.0245 |
| value_loss | 0.0012 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.6 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1121 |
| iterations | 387 |
| time_elapsed | 2827 |
| total_timesteps | 3170304 |
| train/ | |
| approx_kl | 0.07106483 |
| clip_fraction | 0.371 |
| clip_range | 0.146 |
| entropy_loss | -4.74 |
| explained_variance | 0.912 |
| learning_rate | 0.000242 |
| loss | -0.0266 |
| n_updates | 1544 |
| policy_gradient_loss | -0.0212 |
| value_loss | 0.00099 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 60.7 |
| ep_rew_mean | 0.818 |
| time/ | |
| fps | 1121 |
| iterations | 388 |
| time_elapsed | 2834 |
| total_timesteps | 3178496 |
| train/ | |
| approx_kl | 0.07996462 |
| clip_fraction | 0.365 |
| clip_range | 0.146 |
| entropy_loss | -4.88 |
| explained_variance | 0.902 |
| learning_rate | 0.000242 |
| loss | -0.0355 |
| n_updates | 1548 |
| policy_gradient_loss | -0.0228 |
| value_loss | 0.00111 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.5 |
| ep_rew_mean | 0.823 |
| time/ | |
| fps | 1121 |
| iterations | 389 |
| time_elapsed | 2841 |
| total_timesteps | 3186688 |
| train/ | |
| approx_kl | 0.08551867 |
| clip_fraction | 0.403 |
| clip_range | 0.146 |
| entropy_loss | -5.05 |
| explained_variance | 0.884 |
| learning_rate | 0.000242 |
| loss | -0.0382 |
| n_updates | 1552 |
| policy_gradient_loss | -0.0293 |
| value_loss | 0.00154 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 61.3 |
| ep_rew_mean | 0.821 |
| time/ | |
| fps | 1121 |
| iterations | 390 |
| time_elapsed | 2848 |
| total_timesteps | 3194880 |
| train/ | |
| approx_kl | 0.059828844 |
| clip_fraction | 0.397 |
| clip_range | 0.146 |
| entropy_loss | -5.15 |
| explained_variance | 0.909 |
| learning_rate | 0.000242 |
| loss | -0.0329 |
| n_updates | 1556 |
| policy_gradient_loss | -0.0224 |
| value_loss | 0.00127 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 57.3 |
| ep_rew_mean | 0.825 |
| time/ | |
| fps | 1121 |
| iterations | 391 |
| time_elapsed | 2855 |
| total_timesteps | 3203072 |
| train/ | |
| approx_kl | 0.115995586 |
| clip_fraction | 0.42 |
| clip_range | 0.146 |
| entropy_loss | -5.24 |
| explained_variance | 0.923 |
| learning_rate | 0.000242 |
| loss | -0.0417 |
| n_updates | 1560 |
| policy_gradient_loss | -0.0309 |
| value_loss | 0.00115 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.5 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1121 |
| iterations | 392 |
| time_elapsed | 2862 |
| total_timesteps | 3211264 |
| train/ | |
| approx_kl | 0.06558256 |
| clip_fraction | 0.381 |
| clip_range | 0.146 |
| entropy_loss | -5.02 |
| explained_variance | 0.934 |
| learning_rate | 0.000242 |
| loss | -0.0424 |
| n_updates | 1564 |
| policy_gradient_loss | -0.0248 |
| value_loss | 0.000854 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 56.5 |
| ep_rew_mean | 0.824 |
| time/ | |
| fps | 1121 |
| iterations | 393 |
| time_elapsed | 2870 |
| total_timesteps | 3219456 |
| train/ | |
| approx_kl | 0.0746405 |
| clip_fraction | 0.359 |
| clip_range | 0.146 |
| entropy_loss | -4.98 |
| explained_variance | 0.889 |
| learning_rate | 0.000242 |
| loss | -0.0354 |
| n_updates | 1568 |
| policy_gradient_loss | -0.0203 |
| value_loss | 0.00122 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.9 |
| ep_rew_mean | 0.828 |
| time/ | |
| fps | 1121 |
| iterations | 394 |
| time_elapsed | 2877 |
| total_timesteps | 3227648 |
| train/ | |
| approx_kl | 0.070231065 |
| clip_fraction | 0.395 |
| clip_range | 0.146 |
| entropy_loss | -5.06 |
| explained_variance | 0.894 |
| learning_rate | 0.000242 |
| loss | -0.0112 |
| n_updates | 1572 |
| policy_gradient_loss | -0.0238 |
| value_loss | 0.00132 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 63.2 |
| ep_rew_mean | 0.821 |
| time/ | |
| fps | 1121 |
| iterations | 395 |
| time_elapsed | 2884 |
| total_timesteps | 3235840 |
| train/ | |
| approx_kl | 0.097267956 |
| clip_fraction | 0.367 |
| clip_range | 0.146 |
| entropy_loss | -5.11 |
| explained_variance | 0.905 |
| learning_rate | 0.000242 |
| loss | -0.0358 |
| n_updates | 1576 |
| policy_gradient_loss | -0.0265 |
| value_loss | 0.00123 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 56.5 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1121 |
| iterations | 396 |
| time_elapsed | 2891 |
| total_timesteps | 3244032 |
| train/ | |
| approx_kl | 0.09271029 |
| clip_fraction | 0.405 |
| clip_range | 0.146 |
| entropy_loss | -5.3 |
| explained_variance | 0.914 |
| learning_rate | 0.000242 |
| loss | -0.0377 |
| n_updates | 1580 |
| policy_gradient_loss | -0.0314 |
| value_loss | 0.00126 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.2 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1121 |
| iterations | 397 |
| time_elapsed | 2898 |
| total_timesteps | 3252224 |
| train/ | |
| approx_kl | 0.08296621 |
| clip_fraction | 0.391 |
| clip_range | 0.146 |
| entropy_loss | -5.08 |
| explained_variance | 0.927 |
| learning_rate | 0.000242 |
| loss | -0.0338 |
| n_updates | 1584 |
| policy_gradient_loss | -0.0251 |
| value_loss | 0.000938 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.3 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1122 |
| iterations | 398 |
| time_elapsed | 2905 |
| total_timesteps | 3260416 |
| train/ | |
| approx_kl | 0.076973185 |
| clip_fraction | 0.381 |
| clip_range | 0.146 |
| entropy_loss | -4.97 |
| explained_variance | 0.932 |
| learning_rate | 0.000242 |
| loss | -0.0327 |
| n_updates | 1588 |
| policy_gradient_loss | -0.0214 |
| value_loss | 0.000685 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.6 |
| ep_rew_mean | 0.827 |
| time/ | |
| fps | 1122 |
| iterations | 399 |
| time_elapsed | 2912 |
| total_timesteps | 3268608 |
| train/ | |
| approx_kl | 0.08231124 |
| clip_fraction | 0.367 |
| clip_range | 0.146 |
| entropy_loss | -5.08 |
| explained_variance | 0.911 |
| learning_rate | 0.000242 |
| loss | -0.028 |
| n_updates | 1592 |
| policy_gradient_loss | -0.0209 |
| value_loss | 0.00105 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.7 |
| ep_rew_mean | 0.815 |
| time/ | |
| fps | 1122 |
| iterations | 400 |
| time_elapsed | 2920 |
| total_timesteps | 3276800 |
| train/ | |
| approx_kl | 0.08599094 |
| clip_fraction | 0.416 |
| clip_range | 0.146 |
| entropy_loss | -5.22 |
| explained_variance | 0.935 |
| learning_rate | 0.000242 |
| loss | -0.0477 |
| n_updates | 1596 |
| policy_gradient_loss | -0.0295 |
| value_loss | 0.000957 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 56.9 |
| ep_rew_mean | 0.829 |
| time/ | |
| fps | 1122 |
| iterations | 401 |
| time_elapsed | 2927 |
| total_timesteps | 3284992 |
| train/ | |
| approx_kl | 0.076907575 |
| clip_fraction | 0.377 |
| clip_range | 0.146 |
| entropy_loss | -5.02 |
| explained_variance | 0.952 |
| learning_rate | 0.000242 |
| loss | -0.0246 |
| n_updates | 1600 |
| policy_gradient_loss | -0.0254 |
| value_loss | 0.000677 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.2 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1122 |
| iterations | 402 |
| time_elapsed | 2934 |
| total_timesteps | 3293184 |
| train/ | |
| approx_kl | 0.07774804 |
| clip_fraction | 0.428 |
| clip_range | 0.146 |
| entropy_loss | -5.04 |
| explained_variance | 0.922 |
| learning_rate | 0.000242 |
| loss | -0.0321 |
| n_updates | 1604 |
| policy_gradient_loss | -0.0223 |
| value_loss | 0.00104 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 55.5 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1122 |
| iterations | 403 |
| time_elapsed | 2941 |
| total_timesteps | 3301376 |
| train/ | |
| approx_kl | 0.074767835 |
| clip_fraction | 0.376 |
| clip_range | 0.146 |
| entropy_loss | -4.89 |
| explained_variance | 0.919 |
| learning_rate | 0.000242 |
| loss | -0.0194 |
| n_updates | 1608 |
| policy_gradient_loss | -0.02 |
| value_loss | 0.000954 |
-----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 60 |
| ep_rew_mean | 0.828 |
| time/ | |
| fps | 1122 |
| iterations | 404 |
| time_elapsed | 2948 |
| total_timesteps | 3309568 |
| train/ | |
| approx_kl | 0.091023 |
| clip_fraction | 0.358 |
| clip_range | 0.146 |
| entropy_loss | -4.97 |
| explained_variance | 0.934 |
| learning_rate | 0.000242 |
| loss | -0.0291 |
| n_updates | 1612 |
| policy_gradient_loss | -0.0209 |
| value_loss | 0.000821 |
--------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1122 |
| iterations | 405 |
| time_elapsed | 2955 |
| total_timesteps | 3317760 |
| train/ | |
| approx_kl | 0.08699921 |
| clip_fraction | 0.379 |
| clip_range | 0.146 |
| entropy_loss | -5.06 |
| explained_variance | 0.916 |
| learning_rate | 0.000242 |
| loss | -0.0402 |
| n_updates | 1616 |
| policy_gradient_loss | -0.0236 |
| value_loss | 0.0011 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.8 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1122 |
| iterations | 406 |
| time_elapsed | 2962 |
| total_timesteps | 3325952 |
| train/ | |
| approx_kl | 0.07301657 |
| clip_fraction | 0.363 |
| clip_range | 0.146 |
| entropy_loss | -5.01 |
| explained_variance | 0.908 |
| learning_rate | 0.000242 |
| loss | -0.0235 |
| n_updates | 1620 |
| policy_gradient_loss | -0.0207 |
| value_loss | 0.00097 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 65.9 |
| ep_rew_mean | 0.807 |
| time/ | |
| fps | 1122 |
| iterations | 407 |
| time_elapsed | 2969 |
| total_timesteps | 3334144 |
| train/ | |
| approx_kl | 0.086166784 |
| clip_fraction | 0.367 |
| clip_range | 0.146 |
| entropy_loss | -5.04 |
| explained_variance | 0.913 |
| learning_rate | 0.000242 |
| loss | -0.0187 |
| n_updates | 1624 |
| policy_gradient_loss | -0.0231 |
| value_loss | 0.00104 |
-----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 63.7 |
| ep_rew_mean | 0.807 |
| time/ | |
| fps | 1122 |
| iterations | 408 |
| time_elapsed | 2976 |
| total_timesteps | 3342336 |
| train/ | |
| approx_kl | 0.092338 |
| clip_fraction | 0.427 |
| clip_range | 0.146 |
| entropy_loss | -5.31 |
| explained_variance | 0.939 |
| learning_rate | 0.000242 |
| loss | -0.0464 |
| n_updates | 1628 |
| policy_gradient_loss | -0.0323 |
| value_loss | 0.000928 |
--------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.3 |
| ep_rew_mean | 0.82 |
| time/ | |
| fps | 1122 |
| iterations | 409 |
| time_elapsed | 2983 |
| total_timesteps | 3350528 |
| train/ | |
| approx_kl | 0.07773994 |
| clip_fraction | 0.386 |
| clip_range | 0.146 |
| entropy_loss | -5.2 |
| explained_variance | 0.9 |
| learning_rate | 0.000242 |
| loss | -0.0304 |
| n_updates | 1632 |
| policy_gradient_loss | -0.023 |
| value_loss | 0.00145 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 58.6 |
| ep_rew_mean | 0.823 |
| time/ | |
| fps | 1123 |
| iterations | 410 |
| time_elapsed | 2990 |
| total_timesteps | 3358720 |
| train/ | |
| approx_kl | 0.10200008 |
| clip_fraction | 0.41 |
| clip_range | 0.146 |
| entropy_loss | -5.03 |
| explained_variance | 0.898 |
| learning_rate | 0.000242 |
| loss | -0.0194 |
| n_updates | 1636 |
| policy_gradient_loss | -0.0224 |
| value_loss | 0.00133 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.2 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1123 |
| iterations | 411 |
| time_elapsed | 2997 |
| total_timesteps | 3366912 |
| train/ | |
| approx_kl | 0.083237424 |
| clip_fraction | 0.379 |
| clip_range | 0.146 |
| entropy_loss | -5.08 |
| explained_variance | 0.937 |
| learning_rate | 0.000242 |
| loss | -0.0403 |
| n_updates | 1640 |
| policy_gradient_loss | -0.0265 |
| value_loss | 0.000767 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.8 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1123 |
| iterations | 412 |
| time_elapsed | 3004 |
| total_timesteps | 3375104 |
| train/ | |
| approx_kl | 0.06891382 |
| clip_fraction | 0.363 |
| clip_range | 0.146 |
| entropy_loss | -4.76 |
| explained_variance | 0.928 |
| learning_rate | 0.000242 |
| loss | -0.0269 |
| n_updates | 1644 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000699 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1123 |
| iterations | 413 |
| time_elapsed | 3011 |
| total_timesteps | 3383296 |
| train/ | |
| approx_kl | 0.09043713 |
| clip_fraction | 0.338 |
| clip_range | 0.146 |
| entropy_loss | -4.7 |
| explained_variance | 0.939 |
| learning_rate | 0.000242 |
| loss | -0.0119 |
| n_updates | 1648 |
| policy_gradient_loss | -0.0137 |
| value_loss | 0.000504 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 56.2 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1123 |
| iterations | 414 |
| time_elapsed | 3018 |
| total_timesteps | 3391488 |
| train/ | |
| approx_kl | 0.08183843 |
| clip_fraction | 0.383 |
| clip_range | 0.146 |
| entropy_loss | -4.8 |
| explained_variance | 0.917 |
| learning_rate | 0.000242 |
| loss | -0.0363 |
| n_updates | 1652 |
| policy_gradient_loss | -0.0211 |
| value_loss | 0.000826 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 60.5 |
| ep_rew_mean | 0.817 |
| time/ | |
| fps | 1123 |
| iterations | 415 |
| time_elapsed | 3026 |
| total_timesteps | 3399680 |
| train/ | |
| approx_kl | 0.065963894 |
| clip_fraction | 0.374 |
| clip_range | 0.146 |
| entropy_loss | -4.87 |
| explained_variance | 0.914 |
| learning_rate | 0.000242 |
| loss | -0.0267 |
| n_updates | 1656 |
| policy_gradient_loss | -0.0191 |
| value_loss | 0.000986 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.1 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1123 |
| iterations | 416 |
| time_elapsed | 3033 |
| total_timesteps | 3407872 |
| train/ | |
| approx_kl | 0.07462531 |
| clip_fraction | 0.394 |
| clip_range | 0.146 |
| entropy_loss | -5.01 |
| explained_variance | 0.923 |
| learning_rate | 0.000242 |
| loss | -0.0342 |
| n_updates | 1660 |
| policy_gradient_loss | -0.0271 |
| value_loss | 0.000912 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.3 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1123 |
| iterations | 417 |
| time_elapsed | 3040 |
| total_timesteps | 3416064 |
| train/ | |
| approx_kl | 0.071058095 |
| clip_fraction | 0.362 |
| clip_range | 0.146 |
| entropy_loss | -4.75 |
| explained_variance | 0.912 |
| learning_rate | 0.000242 |
| loss | -0.0244 |
| n_updates | 1664 |
| policy_gradient_loss | -0.0166 |
| value_loss | 0.000865 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.2 |
| ep_rew_mean | 0.827 |
| time/ | |
| fps | 1123 |
| iterations | 418 |
| time_elapsed | 3047 |
| total_timesteps | 3424256 |
| train/ | |
| approx_kl | 0.04773946 |
| clip_fraction | 0.303 |
| clip_range | 0.146 |
| entropy_loss | -4.65 |
| explained_variance | 0.958 |
| learning_rate | 0.000242 |
| loss | -0.00931 |
| n_updates | 1668 |
| policy_gradient_loss | -0.0124 |
| value_loss | 0.000327 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.4 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1123 |
| iterations | 419 |
| time_elapsed | 3054 |
| total_timesteps | 3432448 |
| train/ | |
| approx_kl | 0.11068389 |
| clip_fraction | 0.358 |
| clip_range | 0.146 |
| entropy_loss | -4.83 |
| explained_variance | 0.913 |
| learning_rate | 0.000242 |
| loss | -0.0271 |
| n_updates | 1672 |
| policy_gradient_loss | -0.0214 |
| value_loss | 0.000953 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1123 |
| iterations | 420 |
| time_elapsed | 3061 |
| total_timesteps | 3440640 |
| train/ | |
| approx_kl | 0.09036707 |
| clip_fraction | 0.334 |
| clip_range | 0.146 |
| entropy_loss | -4.7 |
| explained_variance | 0.892 |
| learning_rate | 0.000242 |
| loss | -0.0213 |
| n_updates | 1676 |
| policy_gradient_loss | -0.0177 |
| value_loss | 0.000996 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.5 |
| ep_rew_mean | 0.829 |
| time/ | |
| fps | 1123 |
| iterations | 421 |
| time_elapsed | 3068 |
| total_timesteps | 3448832 |
| train/ | |
| approx_kl | 0.05051452 |
| clip_fraction | 0.272 |
| clip_range | 0.146 |
| entropy_loss | -4.63 |
| explained_variance | 0.937 |
| learning_rate | 0.000241 |
| loss | -0.0135 |
| n_updates | 1680 |
| policy_gradient_loss | -0.0113 |
| value_loss | 0.000395 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1123 |
| iterations | 422 |
| time_elapsed | 3075 |
| total_timesteps | 3457024 |
| train/ | |
| approx_kl | 0.07125251 |
| clip_fraction | 0.374 |
| clip_range | 0.146 |
| entropy_loss | -4.76 |
| explained_variance | 0.923 |
| learning_rate | 0.000241 |
| loss | -0.0259 |
| n_updates | 1684 |
| policy_gradient_loss | -0.021 |
| value_loss | 0.000789 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1123 |
| iterations | 423 |
| time_elapsed | 3083 |
| total_timesteps | 3465216 |
| train/ | |
| approx_kl | 0.07593008 |
| clip_fraction | 0.341 |
| clip_range | 0.146 |
| entropy_loss | -4.67 |
| explained_variance | 0.955 |
| learning_rate | 0.000241 |
| loss | -0.0219 |
| n_updates | 1688 |
| policy_gradient_loss | -0.0157 |
| value_loss | 0.000404 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.5 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1124 |
| iterations | 424 |
| time_elapsed | 3090 |
| total_timesteps | 3473408 |
| train/ | |
| approx_kl | 0.07231134 |
| clip_fraction | 0.329 |
| clip_range | 0.146 |
| entropy_loss | -4.7 |
| explained_variance | 0.954 |
| learning_rate | 0.000241 |
| loss | -0.0128 |
| n_updates | 1692 |
| policy_gradient_loss | -0.0154 |
| value_loss | 0.000417 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1124 |
| iterations | 425 |
| time_elapsed | 3097 |
| total_timesteps | 3481600 |
| train/ | |
| approx_kl | 0.08497012 |
| clip_fraction | 0.352 |
| clip_range | 0.146 |
| entropy_loss | -4.81 |
| explained_variance | 0.937 |
| learning_rate | 0.000241 |
| loss | -0.0271 |
| n_updates | 1696 |
| policy_gradient_loss | -0.0215 |
| value_loss | 0.000643 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 57.1 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1124 |
| iterations | 426 |
| time_elapsed | 3104 |
| total_timesteps | 3489792 |
| train/ | |
| approx_kl | 0.056607023 |
| clip_fraction | 0.378 |
| clip_range | 0.146 |
| entropy_loss | -4.81 |
| explained_variance | 0.941 |
| learning_rate | 0.000241 |
| loss | -0.0276 |
| n_updates | 1700 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000594 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.8 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1124 |
| iterations | 427 |
| time_elapsed | 3111 |
| total_timesteps | 3497984 |
| train/ | |
| approx_kl | 0.08374736 |
| clip_fraction | 0.366 |
| clip_range | 0.146 |
| entropy_loss | -4.96 |
| explained_variance | 0.929 |
| learning_rate | 0.000241 |
| loss | -0.035 |
| n_updates | 1704 |
| policy_gradient_loss | -0.0248 |
| value_loss | 0.000807 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.5 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1124 |
| iterations | 428 |
| time_elapsed | 3118 |
| total_timesteps | 3506176 |
| train/ | |
| approx_kl | 0.09215112 |
| clip_fraction | 0.365 |
| clip_range | 0.146 |
| entropy_loss | -4.92 |
| explained_variance | 0.91 |
| learning_rate | 0.000241 |
| loss | -0.0343 |
| n_updates | 1708 |
| policy_gradient_loss | -0.0218 |
| value_loss | 0.00106 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.6 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1124 |
| iterations | 429 |
| time_elapsed | 3125 |
| total_timesteps | 3514368 |
| train/ | |
| approx_kl | 0.06682532 |
| clip_fraction | 0.324 |
| clip_range | 0.146 |
| entropy_loss | -4.85 |
| explained_variance | 0.904 |
| learning_rate | 0.000241 |
| loss | -0.026 |
| n_updates | 1712 |
| policy_gradient_loss | -0.0202 |
| value_loss | 0.000973 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.2 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1124 |
| iterations | 430 |
| time_elapsed | 3133 |
| total_timesteps | 3522560 |
| train/ | |
| approx_kl | 0.072802305 |
| clip_fraction | 0.355 |
| clip_range | 0.146 |
| entropy_loss | -4.8 |
| explained_variance | 0.962 |
| learning_rate | 0.000241 |
| loss | -0.0343 |
| n_updates | 1716 |
| policy_gradient_loss | -0.0235 |
| value_loss | 0.00041 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1124 |
| iterations | 431 |
| time_elapsed | 3139 |
| total_timesteps | 3530752 |
| train/ | |
| approx_kl | 0.10327864 |
| clip_fraction | 0.334 |
| clip_range | 0.146 |
| entropy_loss | -4.79 |
| explained_variance | 0.951 |
| learning_rate | 0.000241 |
| loss | -0.0368 |
| n_updates | 1720 |
| policy_gradient_loss | -0.0205 |
| value_loss | 0.00052 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1124 |
| iterations | 432 |
| time_elapsed | 3146 |
| total_timesteps | 3538944 |
| train/ | |
| approx_kl | 0.07062249 |
| clip_fraction | 0.341 |
| clip_range | 0.146 |
| entropy_loss | -4.71 |
| explained_variance | 0.968 |
| learning_rate | 0.000241 |
| loss | -0.0199 |
| n_updates | 1724 |
| policy_gradient_loss | -0.0188 |
| value_loss | 0.000334 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54.1 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1124 |
| iterations | 433 |
| time_elapsed | 3154 |
| total_timesteps | 3547136 |
| train/ | |
| approx_kl | 0.058395542 |
| clip_fraction | 0.348 |
| clip_range | 0.146 |
| entropy_loss | -4.7 |
| explained_variance | 0.928 |
| learning_rate | 0.000241 |
| loss | -0.0186 |
| n_updates | 1728 |
| policy_gradient_loss | -0.0136 |
| value_loss | 0.000704 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1124 |
| iterations | 434 |
| time_elapsed | 3161 |
| total_timesteps | 3555328 |
| train/ | |
| approx_kl | 0.0730995 |
| clip_fraction | 0.374 |
| clip_range | 0.146 |
| entropy_loss | -4.79 |
| explained_variance | 0.893 |
| learning_rate | 0.000241 |
| loss | -0.0381 |
| n_updates | 1732 |
| policy_gradient_loss | -0.0203 |
| value_loss | 0.00119 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.1 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1124 |
| iterations | 435 |
| time_elapsed | 3168 |
| total_timesteps | 3563520 |
| train/ | |
| approx_kl | 0.07831407 |
| clip_fraction | 0.317 |
| clip_range | 0.146 |
| entropy_loss | -4.6 |
| explained_variance | 0.932 |
| learning_rate | 0.000241 |
| loss | -0.026 |
| n_updates | 1736 |
| policy_gradient_loss | -0.0169 |
| value_loss | 0.000522 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.3 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 436 |
| time_elapsed | 3175 |
| total_timesteps | 3571712 |
| train/ | |
| approx_kl | 0.09369155 |
| clip_fraction | 0.359 |
| clip_range | 0.146 |
| entropy_loss | -4.7 |
| explained_variance | 0.945 |
| learning_rate | 0.000241 |
| loss | -0.0339 |
| n_updates | 1740 |
| policy_gradient_loss | -0.0236 |
| value_loss | 0.000592 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1124 |
| iterations | 437 |
| time_elapsed | 3182 |
| total_timesteps | 3579904 |
| train/ | |
| approx_kl | 0.0758425 |
| clip_fraction | 0.31 |
| clip_range | 0.146 |
| entropy_loss | -4.48 |
| explained_variance | 0.957 |
| learning_rate | 0.000241 |
| loss | -0.0106 |
| n_updates | 1744 |
| policy_gradient_loss | -0.00774 |
| value_loss | 0.000277 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1124 |
| iterations | 438 |
| time_elapsed | 3189 |
| total_timesteps | 3588096 |
| train/ | |
| approx_kl | 0.061206106 |
| clip_fraction | 0.33 |
| clip_range | 0.146 |
| entropy_loss | -4.57 |
| explained_variance | 0.94 |
| learning_rate | 0.000241 |
| loss | -0.0195 |
| n_updates | 1748 |
| policy_gradient_loss | -0.0141 |
| value_loss | 0.000463 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.6 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1125 |
| iterations | 439 |
| time_elapsed | 3196 |
| total_timesteps | 3596288 |
| train/ | |
| approx_kl | 0.08174087 |
| clip_fraction | 0.332 |
| clip_range | 0.146 |
| entropy_loss | -4.66 |
| explained_variance | 0.949 |
| learning_rate | 0.000241 |
| loss | -0.0251 |
| n_updates | 1752 |
| policy_gradient_loss | -0.0175 |
| value_loss | 0.000426 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1125 |
| iterations | 440 |
| time_elapsed | 3203 |
| total_timesteps | 3604480 |
| train/ | |
| approx_kl | 0.06932084 |
| clip_fraction | 0.383 |
| clip_range | 0.146 |
| entropy_loss | -4.72 |
| explained_variance | 0.948 |
| learning_rate | 0.000241 |
| loss | -0.0366 |
| n_updates | 1756 |
| policy_gradient_loss | -0.0229 |
| value_loss | 0.000586 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.5 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1125 |
| iterations | 441 |
| time_elapsed | 3210 |
| total_timesteps | 3612672 |
| train/ | |
| approx_kl | 0.054611113 |
| clip_fraction | 0.285 |
| clip_range | 0.145 |
| entropy_loss | -4.65 |
| explained_variance | 0.952 |
| learning_rate | 0.000241 |
| loss | -0.025 |
| n_updates | 1760 |
| policy_gradient_loss | -0.0176 |
| value_loss | 0.000384 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 56.1 |
| ep_rew_mean | 0.827 |
| time/ | |
| fps | 1125 |
| iterations | 442 |
| time_elapsed | 3217 |
| total_timesteps | 3620864 |
| train/ | |
| approx_kl | 0.044505477 |
| clip_fraction | 0.319 |
| clip_range | 0.145 |
| entropy_loss | -4.62 |
| explained_variance | 0.952 |
| learning_rate | 0.000241 |
| loss | -0.0149 |
| n_updates | 1764 |
| policy_gradient_loss | -0.0141 |
| value_loss | 0.000389 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 51.8 |
| ep_rew_mean | 0.83 |
| time/ | |
| fps | 1125 |
| iterations | 443 |
| time_elapsed | 3224 |
| total_timesteps | 3629056 |
| train/ | |
| approx_kl | 0.0603766 |
| clip_fraction | 0.358 |
| clip_range | 0.145 |
| entropy_loss | -4.96 |
| explained_variance | 0.963 |
| learning_rate | 0.000241 |
| loss | -0.0379 |
| n_updates | 1768 |
| policy_gradient_loss | -0.0251 |
| value_loss | 0.000506 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.7 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1125 |
| iterations | 444 |
| time_elapsed | 3231 |
| total_timesteps | 3637248 |
| train/ | |
| approx_kl | 0.10381849 |
| clip_fraction | 0.346 |
| clip_range | 0.145 |
| entropy_loss | -4.69 |
| explained_variance | 0.951 |
| learning_rate | 0.000241 |
| loss | -0.0195 |
| n_updates | 1772 |
| policy_gradient_loss | -0.019 |
| value_loss | 0.000497 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54.9 |
| ep_rew_mean | 0.83 |
| time/ | |
| fps | 1125 |
| iterations | 445 |
| time_elapsed | 3238 |
| total_timesteps | 3645440 |
| train/ | |
| approx_kl | 0.037427682 |
| clip_fraction | 0.27 |
| clip_range | 0.145 |
| entropy_loss | -4.46 |
| explained_variance | 0.975 |
| learning_rate | 0.000241 |
| loss | -0.00952 |
| n_updates | 1776 |
| policy_gradient_loss | -0.00871 |
| value_loss | 0.000168 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.9 |
| ep_rew_mean | 0.823 |
| time/ | |
| fps | 1125 |
| iterations | 446 |
| time_elapsed | 3245 |
| total_timesteps | 3653632 |
| train/ | |
| approx_kl | 0.07988455 |
| clip_fraction | 0.339 |
| clip_range | 0.145 |
| entropy_loss | -4.71 |
| explained_variance | 0.942 |
| learning_rate | 0.000241 |
| loss | -0.0377 |
| n_updates | 1780 |
| policy_gradient_loss | -0.021 |
| value_loss | 0.000606 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1125 |
| iterations | 447 |
| time_elapsed | 3253 |
| total_timesteps | 3661824 |
| train/ | |
| approx_kl | 0.09466633 |
| clip_fraction | 0.368 |
| clip_range | 0.145 |
| entropy_loss | -4.86 |
| explained_variance | 0.945 |
| learning_rate | 0.000241 |
| loss | -0.0314 |
| n_updates | 1784 |
| policy_gradient_loss | -0.023 |
| value_loss | 0.000706 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 54.8 |
| ep_rew_mean | 0.819 |
| time/ | |
| fps | 1125 |
| iterations | 448 |
| time_elapsed | 3260 |
| total_timesteps | 3670016 |
| train/ | |
| approx_kl | 0.0637682 |
| clip_fraction | 0.339 |
| clip_range | 0.145 |
| entropy_loss | -4.56 |
| explained_variance | 0.93 |
| learning_rate | 0.000241 |
| loss | -0.0144 |
| n_updates | 1788 |
| policy_gradient_loss | -0.0141 |
| value_loss | 0.000567 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.9 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1125 |
| iterations | 449 |
| time_elapsed | 3267 |
| total_timesteps | 3678208 |
| train/ | |
| approx_kl | 0.09321886 |
| clip_fraction | 0.373 |
| clip_range | 0.145 |
| entropy_loss | -4.9 |
| explained_variance | 0.926 |
| learning_rate | 0.000241 |
| loss | -0.0284 |
| n_updates | 1792 |
| policy_gradient_loss | -0.0225 |
| value_loss | 0.00075 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 55.3 |
| ep_rew_mean | 0.829 |
| time/ | |
| fps | 1125 |
| iterations | 450 |
| time_elapsed | 3274 |
| total_timesteps | 3686400 |
| train/ | |
| approx_kl | 0.059952352 |
| clip_fraction | 0.285 |
| clip_range | 0.145 |
| entropy_loss | -4.74 |
| explained_variance | 0.961 |
| learning_rate | 0.000241 |
| loss | -0.0196 |
| n_updates | 1796 |
| policy_gradient_loss | -0.0194 |
| value_loss | 0.000358 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 451 |
| time_elapsed | 3281 |
| total_timesteps | 3694592 |
| train/ | |
| approx_kl | 0.07412451 |
| clip_fraction | 0.346 |
| clip_range | 0.145 |
| entropy_loss | -5.05 |
| explained_variance | 0.954 |
| learning_rate | 0.000241 |
| loss | -0.0285 |
| n_updates | 1800 |
| policy_gradient_loss | -0.0251 |
| value_loss | 0.000586 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.1 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 452 |
| time_elapsed | 3288 |
| total_timesteps | 3702784 |
| train/ | |
| approx_kl | 0.07055646 |
| clip_fraction | 0.334 |
| clip_range | 0.145 |
| entropy_loss | -4.82 |
| explained_variance | 0.935 |
| learning_rate | 0.000241 |
| loss | -0.0315 |
| n_updates | 1804 |
| policy_gradient_loss | -0.018 |
| value_loss | 0.00061 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.7 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 453 |
| time_elapsed | 3295 |
| total_timesteps | 3710976 |
| train/ | |
| approx_kl | 0.08173225 |
| clip_fraction | 0.341 |
| clip_range | 0.145 |
| entropy_loss | -4.89 |
| explained_variance | 0.944 |
| learning_rate | 0.000241 |
| loss | -0.0325 |
| n_updates | 1808 |
| policy_gradient_loss | -0.0224 |
| value_loss | 0.000659 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 454 |
| time_elapsed | 3302 |
| total_timesteps | 3719168 |
| train/ | |
| approx_kl | 0.07032408 |
| clip_fraction | 0.321 |
| clip_range | 0.145 |
| entropy_loss | -4.84 |
| explained_variance | 0.953 |
| learning_rate | 0.000241 |
| loss | -0.0288 |
| n_updates | 1812 |
| policy_gradient_loss | -0.0192 |
| value_loss | 0.000501 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1126 |
| iterations | 455 |
| time_elapsed | 3309 |
| total_timesteps | 3727360 |
| train/ | |
| approx_kl | 0.07507625 |
| clip_fraction | 0.359 |
| clip_range | 0.145 |
| entropy_loss | -4.7 |
| explained_variance | 0.941 |
| learning_rate | 0.000241 |
| loss | -0.0205 |
| n_updates | 1816 |
| policy_gradient_loss | -0.0168 |
| value_loss | 0.000622 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.8 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 456 |
| time_elapsed | 3316 |
| total_timesteps | 3735552 |
| train/ | |
| approx_kl | 0.08481913 |
| clip_fraction | 0.314 |
| clip_range | 0.145 |
| entropy_loss | -4.78 |
| explained_variance | 0.947 |
| learning_rate | 0.000241 |
| loss | -0.0193 |
| n_updates | 1820 |
| policy_gradient_loss | -0.0235 |
| value_loss | 0.000559 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.8 |
| ep_rew_mean | 0.824 |
| time/ | |
| fps | 1126 |
| iterations | 457 |
| time_elapsed | 3323 |
| total_timesteps | 3743744 |
| train/ | |
| approx_kl | 0.06894081 |
| clip_fraction | 0.291 |
| clip_range | 0.145 |
| entropy_loss | -4.68 |
| explained_variance | 0.968 |
| learning_rate | 0.000241 |
| loss | -0.0329 |
| n_updates | 1824 |
| policy_gradient_loss | -0.0185 |
| value_loss | 0.000268 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.2 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 458 |
| time_elapsed | 3330 |
| total_timesteps | 3751936 |
| train/ | |
| approx_kl | 0.07439946 |
| clip_fraction | 0.366 |
| clip_range | 0.145 |
| entropy_loss | -4.88 |
| explained_variance | 0.943 |
| learning_rate | 0.000241 |
| loss | -0.0386 |
| n_updates | 1828 |
| policy_gradient_loss | -0.0238 |
| value_loss | 0.000681 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 57.7 |
| ep_rew_mean | 0.826 |
| time/ | |
| fps | 1126 |
| iterations | 459 |
| time_elapsed | 3337 |
| total_timesteps | 3760128 |
| train/ | |
| approx_kl | 0.065483175 |
| clip_fraction | 0.349 |
| clip_range | 0.145 |
| entropy_loss | -4.76 |
| explained_variance | 0.939 |
| learning_rate | 0.000241 |
| loss | -0.0253 |
| n_updates | 1832 |
| policy_gradient_loss | -0.0186 |
| value_loss | 0.000664 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.7 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 460 |
| time_elapsed | 3344 |
| total_timesteps | 3768320 |
| train/ | |
| approx_kl | 0.08090966 |
| clip_fraction | 0.345 |
| clip_range | 0.145 |
| entropy_loss | -4.97 |
| explained_variance | 0.93 |
| learning_rate | 0.000241 |
| loss | -0.0284 |
| n_updates | 1836 |
| policy_gradient_loss | -0.0233 |
| value_loss | 0.000845 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.7 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 461 |
| time_elapsed | 3352 |
| total_timesteps | 3776512 |
| train/ | |
| approx_kl | 0.04875502 |
| clip_fraction | 0.294 |
| clip_range | 0.145 |
| entropy_loss | -4.69 |
| explained_variance | 0.944 |
| learning_rate | 0.000241 |
| loss | -0.0188 |
| n_updates | 1840 |
| policy_gradient_loss | -0.0118 |
| value_loss | 0.00041 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.1 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 462 |
| time_elapsed | 3359 |
| total_timesteps | 3784704 |
| train/ | |
| approx_kl | 0.052373186 |
| clip_fraction | 0.321 |
| clip_range | 0.145 |
| entropy_loss | -4.79 |
| explained_variance | 0.944 |
| learning_rate | 0.000241 |
| loss | -0.0235 |
| n_updates | 1844 |
| policy_gradient_loss | -0.0157 |
| value_loss | 0.000497 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.2 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1126 |
| iterations | 463 |
| time_elapsed | 3366 |
| total_timesteps | 3792896 |
| train/ | |
| approx_kl | 0.057323508 |
| clip_fraction | 0.331 |
| clip_range | 0.145 |
| entropy_loss | -4.94 |
| explained_variance | 0.917 |
| learning_rate | 0.000241 |
| loss | -0.0234 |
| n_updates | 1848 |
| policy_gradient_loss | -0.0187 |
| value_loss | 0.000796 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.2 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1126 |
| iterations | 464 |
| time_elapsed | 3373 |
| total_timesteps | 3801088 |
| train/ | |
| approx_kl | 0.05739809 |
| clip_fraction | 0.324 |
| clip_range | 0.145 |
| entropy_loss | -5.02 |
| explained_variance | 0.941 |
| learning_rate | 0.000241 |
| loss | -0.0263 |
| n_updates | 1852 |
| policy_gradient_loss | -0.0235 |
| value_loss | 0.000609 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 465 |
| time_elapsed | 3380 |
| total_timesteps | 3809280 |
| train/ | |
| approx_kl | 0.05994657 |
| clip_fraction | 0.37 |
| clip_range | 0.145 |
| entropy_loss | -5.07 |
| explained_variance | 0.902 |
| learning_rate | 0.000241 |
| loss | -0.0342 |
| n_updates | 1856 |
| policy_gradient_loss | -0.0229 |
| value_loss | 0.00122 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 466 |
| time_elapsed | 3387 |
| total_timesteps | 3817472 |
| train/ | |
| approx_kl | 0.055929467 |
| clip_fraction | 0.303 |
| clip_range | 0.145 |
| entropy_loss | -4.94 |
| explained_variance | 0.962 |
| learning_rate | 0.000241 |
| loss | -0.0331 |
| n_updates | 1860 |
| policy_gradient_loss | -0.0196 |
| value_loss | 0.000404 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 60.8 |
| ep_rew_mean | 0.81 |
| time/ | |
| fps | 1127 |
| iterations | 467 |
| time_elapsed | 3394 |
| total_timesteps | 3825664 |
| train/ | |
| approx_kl | 0.084799156 |
| clip_fraction | 0.367 |
| clip_range | 0.145 |
| entropy_loss | -5.03 |
| explained_variance | 0.938 |
| learning_rate | 0.000241 |
| loss | -0.0271 |
| n_updates | 1864 |
| policy_gradient_loss | -0.0214 |
| value_loss | 0.000748 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.1 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 468 |
| time_elapsed | 3401 |
| total_timesteps | 3833856 |
| train/ | |
| approx_kl | 0.064770915 |
| clip_fraction | 0.385 |
| clip_range | 0.145 |
| entropy_loss | -5.15 |
| explained_variance | 0.94 |
| learning_rate | 0.000241 |
| loss | -0.0321 |
| n_updates | 1868 |
| policy_gradient_loss | -0.0254 |
| value_loss | 0.000789 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.1 |
| ep_rew_mean | 0.826 |
| time/ | |
| fps | 1127 |
| iterations | 469 |
| time_elapsed | 3408 |
| total_timesteps | 3842048 |
| train/ | |
| approx_kl | 0.04445334 |
| clip_fraction | 0.304 |
| clip_range | 0.145 |
| entropy_loss | -4.87 |
| explained_variance | 0.944 |
| learning_rate | 0.000241 |
| loss | -0.0282 |
| n_updates | 1872 |
| policy_gradient_loss | -0.0162 |
| value_loss | 0.000471 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.1 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1127 |
| iterations | 470 |
| time_elapsed | 3415 |
| total_timesteps | 3850240 |
| train/ | |
| approx_kl | 0.07493868 |
| clip_fraction | 0.385 |
| clip_range | 0.145 |
| entropy_loss | -5.01 |
| explained_variance | 0.948 |
| learning_rate | 0.00024 |
| loss | -0.0342 |
| n_updates | 1876 |
| policy_gradient_loss | -0.0248 |
| value_loss | 0.000677 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1127 |
| iterations | 471 |
| time_elapsed | 3422 |
| total_timesteps | 3858432 |
| train/ | |
| approx_kl | 0.079786524 |
| clip_fraction | 0.387 |
| clip_range | 0.145 |
| entropy_loss | -4.96 |
| explained_variance | 0.952 |
| learning_rate | 0.00024 |
| loss | -0.0387 |
| n_updates | 1880 |
| policy_gradient_loss | -0.0232 |
| value_loss | 0.000661 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.3 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 472 |
| time_elapsed | 3429 |
| total_timesteps | 3866624 |
| train/ | |
| approx_kl | 0.057607003 |
| clip_fraction | 0.342 |
| clip_range | 0.145 |
| entropy_loss | -4.68 |
| explained_variance | 0.948 |
| learning_rate | 0.00024 |
| loss | -0.0237 |
| n_updates | 1884 |
| policy_gradient_loss | -0.0144 |
| value_loss | 0.000466 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1127 |
| iterations | 473 |
| time_elapsed | 3436 |
| total_timesteps | 3874816 |
| train/ | |
| approx_kl | 0.07106587 |
| clip_fraction | 0.323 |
| clip_range | 0.145 |
| entropy_loss | -4.8 |
| explained_variance | 0.947 |
| learning_rate | 0.00024 |
| loss | -0.0304 |
| n_updates | 1888 |
| policy_gradient_loss | -0.0188 |
| value_loss | 0.000559 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.7 |
| ep_rew_mean | 0.829 |
| time/ | |
| fps | 1127 |
| iterations | 474 |
| time_elapsed | 3443 |
| total_timesteps | 3883008 |
| train/ | |
| approx_kl | 0.060432144 |
| clip_fraction | 0.32 |
| clip_range | 0.145 |
| entropy_loss | -4.75 |
| explained_variance | 0.944 |
| learning_rate | 0.00024 |
| loss | -0.023 |
| n_updates | 1892 |
| policy_gradient_loss | -0.0149 |
| value_loss | 0.000553 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1127 |
| iterations | 475 |
| time_elapsed | 3450 |
| total_timesteps | 3891200 |
| train/ | |
| approx_kl | 0.07106549 |
| clip_fraction | 0.38 |
| clip_range | 0.145 |
| entropy_loss | -4.81 |
| explained_variance | 0.949 |
| learning_rate | 0.00024 |
| loss | -0.0219 |
| n_updates | 1896 |
| policy_gradient_loss | -0.0183 |
| value_loss | 0.000579 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 476 |
| time_elapsed | 3457 |
| total_timesteps | 3899392 |
| train/ | |
| approx_kl | 0.07195568 |
| clip_fraction | 0.293 |
| clip_range | 0.145 |
| entropy_loss | -4.78 |
| explained_variance | 0.958 |
| learning_rate | 0.00024 |
| loss | -0.0305 |
| n_updates | 1900 |
| policy_gradient_loss | -0.0186 |
| value_loss | 0.00039 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.3 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1127 |
| iterations | 477 |
| time_elapsed | 3465 |
| total_timesteps | 3907584 |
| train/ | |
| approx_kl | 0.091775574 |
| clip_fraction | 0.362 |
| clip_range | 0.145 |
| entropy_loss | -4.94 |
| explained_variance | 0.963 |
| learning_rate | 0.00024 |
| loss | -0.0264 |
| n_updates | 1904 |
| policy_gradient_loss | -0.0239 |
| value_loss | 0.000425 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 46.7 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1127 |
| iterations | 478 |
| time_elapsed | 3472 |
| total_timesteps | 3915776 |
| train/ | |
| approx_kl | 0.0892612 |
| clip_fraction | 0.362 |
| clip_range | 0.145 |
| entropy_loss | -4.85 |
| explained_variance | 0.953 |
| learning_rate | 0.00024 |
| loss | -0.0272 |
| n_updates | 1908 |
| policy_gradient_loss | -0.0191 |
| value_loss | 0.000489 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1127 |
| iterations | 479 |
| time_elapsed | 3479 |
| total_timesteps | 3923968 |
| train/ | |
| approx_kl | 0.062186938 |
| clip_fraction | 0.333 |
| clip_range | 0.145 |
| entropy_loss | -4.78 |
| explained_variance | 0.959 |
| learning_rate | 0.00024 |
| loss | -0.0251 |
| n_updates | 1912 |
| policy_gradient_loss | -0.0177 |
| value_loss | 0.000383 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 53.8 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 480 |
| time_elapsed | 3486 |
| total_timesteps | 3932160 |
| train/ | |
| approx_kl | 0.0640039 |
| clip_fraction | 0.325 |
| clip_range | 0.145 |
| entropy_loss | -4.82 |
| explained_variance | 0.965 |
| learning_rate | 0.00024 |
| loss | -0.0262 |
| n_updates | 1916 |
| policy_gradient_loss | -0.0193 |
| value_loss | 0.000369 |
---------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 51 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1127 |
| iterations | 481 |
| time_elapsed | 3493 |
| total_timesteps | 3940352 |
| train/ | |
| approx_kl | 0.0921659 |
| clip_fraction | 0.319 |
| clip_range | 0.145 |
| entropy_loss | -4.89 |
| explained_variance | 0.971 |
| learning_rate | 0.00024 |
| loss | -0.0288 |
| n_updates | 1920 |
| policy_gradient_loss | -0.0201 |
| value_loss | 0.000325 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.5 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1127 |
| iterations | 482 |
| time_elapsed | 3500 |
| total_timesteps | 3948544 |
| train/ | |
| approx_kl | 0.07869721 |
| clip_fraction | 0.314 |
| clip_range | 0.145 |
| entropy_loss | -4.74 |
| explained_variance | 0.965 |
| learning_rate | 0.00024 |
| loss | -0.0233 |
| n_updates | 1924 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000311 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 58.3 |
| ep_rew_mean | 0.826 |
| time/ | |
| fps | 1128 |
| iterations | 483 |
| time_elapsed | 3507 |
| total_timesteps | 3956736 |
| train/ | |
| approx_kl | 0.07095386 |
| clip_fraction | 0.351 |
| clip_range | 0.145 |
| entropy_loss | -4.83 |
| explained_variance | 0.943 |
| learning_rate | 0.00024 |
| loss | -0.0231 |
| n_updates | 1928 |
| policy_gradient_loss | -0.0218 |
| value_loss | 0.000599 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1128 |
| iterations | 484 |
| time_elapsed | 3514 |
| total_timesteps | 3964928 |
| train/ | |
| approx_kl | 0.06842169 |
| clip_fraction | 0.378 |
| clip_range | 0.145 |
| entropy_loss | -5.03 |
| explained_variance | 0.946 |
| learning_rate | 0.00024 |
| loss | -0.0364 |
| n_updates | 1932 |
| policy_gradient_loss | -0.0258 |
| value_loss | 0.000743 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1128 |
| iterations | 485 |
| time_elapsed | 3521 |
| total_timesteps | 3973120 |
| train/ | |
| approx_kl | 0.0649405 |
| clip_fraction | 0.322 |
| clip_range | 0.145 |
| entropy_loss | -4.87 |
| explained_variance | 0.958 |
| learning_rate | 0.00024 |
| loss | -0.0158 |
| n_updates | 1936 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.000449 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1128 |
| iterations | 486 |
| time_elapsed | 3528 |
| total_timesteps | 3981312 |
| train/ | |
| approx_kl | 0.06282572 |
| clip_fraction | 0.323 |
| clip_range | 0.145 |
| entropy_loss | -4.71 |
| explained_variance | 0.967 |
| learning_rate | 0.00024 |
| loss | -0.0195 |
| n_updates | 1940 |
| policy_gradient_loss | -0.0141 |
| value_loss | 0.000281 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.4 |
| ep_rew_mean | 0.825 |
| time/ | |
| fps | 1128 |
| iterations | 487 |
| time_elapsed | 3535 |
| total_timesteps | 3989504 |
| train/ | |
| approx_kl | 0.044741083 |
| clip_fraction | 0.24 |
| clip_range | 0.145 |
| entropy_loss | -4.66 |
| explained_variance | 0.975 |
| learning_rate | 0.00024 |
| loss | -0.0046 |
| n_updates | 1944 |
| policy_gradient_loss | -0.00936 |
| value_loss | 0.000165 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.3 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1128 |
| iterations | 488 |
| time_elapsed | 3542 |
| total_timesteps | 3997696 |
| train/ | |
| approx_kl | 0.05923363 |
| clip_fraction | 0.325 |
| clip_range | 0.145 |
| entropy_loss | -4.85 |
| explained_variance | 0.966 |
| learning_rate | 0.00024 |
| loss | -0.0225 |
| n_updates | 1948 |
| policy_gradient_loss | -0.0188 |
| value_loss | 0.000367 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54.2 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1128 |
| iterations | 489 |
| time_elapsed | 3550 |
| total_timesteps | 4005888 |
| train/ | |
| approx_kl | 0.061747868 |
| clip_fraction | 0.372 |
| clip_range | 0.145 |
| entropy_loss | -4.86 |
| explained_variance | 0.948 |
| learning_rate | 0.00024 |
| loss | -0.0191 |
| n_updates | 1952 |
| policy_gradient_loss | -0.0161 |
| value_loss | 0.00053 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1128 |
| iterations | 490 |
| time_elapsed | 3557 |
| total_timesteps | 4014080 |
| train/ | |
| approx_kl | 0.07030307 |
| clip_fraction | 0.339 |
| clip_range | 0.145 |
| entropy_loss | -5.03 |
| explained_variance | 0.952 |
| learning_rate | 0.00024 |
| loss | -0.0367 |
| n_updates | 1956 |
| policy_gradient_loss | -0.0244 |
| value_loss | 0.000581 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.8 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1128 |
| iterations | 491 |
| time_elapsed | 3564 |
| total_timesteps | 4022272 |
| train/ | |
| approx_kl | 0.073139966 |
| clip_fraction | 0.289 |
| clip_range | 0.145 |
| entropy_loss | -4.83 |
| explained_variance | 0.934 |
| learning_rate | 0.00024 |
| loss | -0.0222 |
| n_updates | 1960 |
| policy_gradient_loss | -0.0153 |
| value_loss | 0.000522 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.4 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1128 |
| iterations | 492 |
| time_elapsed | 3572 |
| total_timesteps | 4030464 |
| train/ | |
| approx_kl | 0.060530405 |
| clip_fraction | 0.289 |
| clip_range | 0.145 |
| entropy_loss | -4.8 |
| explained_variance | 0.941 |
| learning_rate | 0.00024 |
| loss | -0.0179 |
| n_updates | 1964 |
| policy_gradient_loss | -0.0137 |
| value_loss | 0.000439 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1128 |
| iterations | 493 |
| time_elapsed | 3579 |
| total_timesteps | 4038656 |
| train/ | |
| approx_kl | 0.05481425 |
| clip_fraction | 0.332 |
| clip_range | 0.145 |
| entropy_loss | -4.93 |
| explained_variance | 0.948 |
| learning_rate | 0.00024 |
| loss | -0.0315 |
| n_updates | 1968 |
| policy_gradient_loss | -0.0185 |
| value_loss | 0.000513 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.8 |
| ep_rew_mean | 0.83 |
| time/ | |
| fps | 1128 |
| iterations | 494 |
| time_elapsed | 3586 |
| total_timesteps | 4046848 |
| train/ | |
| approx_kl | 0.06432268 |
| clip_fraction | 0.283 |
| clip_range | 0.145 |
| entropy_loss | -4.94 |
| explained_variance | 0.949 |
| learning_rate | 0.00024 |
| loss | -0.0193 |
| n_updates | 1972 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000409 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.7 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1128 |
| iterations | 495 |
| time_elapsed | 3594 |
| total_timesteps | 4055040 |
| train/ | |
| approx_kl | 0.068503655 |
| clip_fraction | 0.34 |
| clip_range | 0.145 |
| entropy_loss | -5.18 |
| explained_variance | 0.896 |
| learning_rate | 0.00024 |
| loss | -0.0287 |
| n_updates | 1976 |
| policy_gradient_loss | -0.0233 |
| value_loss | 0.00123 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1128 |
| iterations | 496 |
| time_elapsed | 3601 |
| total_timesteps | 4063232 |
| train/ | |
| approx_kl | 0.05970429 |
| clip_fraction | 0.333 |
| clip_range | 0.145 |
| entropy_loss | -4.96 |
| explained_variance | 0.952 |
| learning_rate | 0.00024 |
| loss | -0.0324 |
| n_updates | 1980 |
| policy_gradient_loss | -0.0197 |
| value_loss | 0.000424 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.5 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1128 |
| iterations | 497 |
| time_elapsed | 3608 |
| total_timesteps | 4071424 |
| train/ | |
| approx_kl | 0.04966297 |
| clip_fraction | 0.226 |
| clip_range | 0.145 |
| entropy_loss | -4.83 |
| explained_variance | 0.987 |
| learning_rate | 0.00024 |
| loss | -0.00716 |
| n_updates | 1984 |
| policy_gradient_loss | -0.0101 |
| value_loss | 9.61e-05 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 56.8 |
| ep_rew_mean | 0.832 |
| time/ | |
| fps | 1128 |
| iterations | 498 |
| time_elapsed | 3615 |
| total_timesteps | 4079616 |
| train/ | |
| approx_kl | 0.06246019 |
| clip_fraction | 0.329 |
| clip_range | 0.145 |
| entropy_loss | -5.15 |
| explained_variance | 0.918 |
| learning_rate | 0.00024 |
| loss | -0.0242 |
| n_updates | 1988 |
| policy_gradient_loss | -0.0206 |
| value_loss | 0.000912 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.9 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1128 |
| iterations | 499 |
| time_elapsed | 3623 |
| total_timesteps | 4087808 |
| train/ | |
| approx_kl | 0.056641333 |
| clip_fraction | 0.298 |
| clip_range | 0.145 |
| entropy_loss | -5.21 |
| explained_variance | 0.909 |
| learning_rate | 0.00024 |
| loss | -0.0199 |
| n_updates | 1992 |
| policy_gradient_loss | -0.0189 |
| value_loss | 0.00105 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.1 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1128 |
| iterations | 500 |
| time_elapsed | 3630 |
| total_timesteps | 4096000 |
| train/ | |
| approx_kl | 0.08830541 |
| clip_fraction | 0.301 |
| clip_range | 0.145 |
| entropy_loss | -5.03 |
| explained_variance | 0.899 |
| learning_rate | 0.00024 |
| loss | -0.0141 |
| n_updates | 1996 |
| policy_gradient_loss | -0.0149 |
| value_loss | 0.000865 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 56.4 |
| ep_rew_mean | 0.828 |
| time/ | |
| fps | 1128 |
| iterations | 501 |
| time_elapsed | 3638 |
| total_timesteps | 4104192 |
| train/ | |
| approx_kl | 0.062667474 |
| clip_fraction | 0.335 |
| clip_range | 0.145 |
| entropy_loss | -5.23 |
| explained_variance | 0.924 |
| learning_rate | 0.00024 |
| loss | -0.0272 |
| n_updates | 2000 |
| policy_gradient_loss | -0.0226 |
| value_loss | 0.000793 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 60.3 |
| ep_rew_mean | 0.824 |
| time/ | |
| fps | 1128 |
| iterations | 502 |
| time_elapsed | 3645 |
| total_timesteps | 4112384 |
| train/ | |
| approx_kl | 0.0732182 |
| clip_fraction | 0.366 |
| clip_range | 0.145 |
| entropy_loss | -5.4 |
| explained_variance | 0.938 |
| learning_rate | 0.00024 |
| loss | -0.0311 |
| n_updates | 2004 |
| policy_gradient_loss | -0.0268 |
| value_loss | 0.000823 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1128 |
| iterations | 503 |
| time_elapsed | 3652 |
| total_timesteps | 4120576 |
| train/ | |
| approx_kl | 0.06136915 |
| clip_fraction | 0.367 |
| clip_range | 0.145 |
| entropy_loss | -5.43 |
| explained_variance | 0.935 |
| learning_rate | 0.00024 |
| loss | -0.0337 |
| n_updates | 2008 |
| policy_gradient_loss | -0.0272 |
| value_loss | 0.000903 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 55 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1128 |
| iterations | 504 |
| time_elapsed | 3659 |
| total_timesteps | 4128768 |
| train/ | |
| approx_kl | 0.059064634 |
| clip_fraction | 0.328 |
| clip_range | 0.145 |
| entropy_loss | -5.21 |
| explained_variance | 0.949 |
| learning_rate | 0.00024 |
| loss | -0.0228 |
| n_updates | 2012 |
| policy_gradient_loss | -0.0209 |
| value_loss | 0.000578 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.3 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1128 |
| iterations | 505 |
| time_elapsed | 3666 |
| total_timesteps | 4136960 |
| train/ | |
| approx_kl | 0.055064663 |
| clip_fraction | 0.364 |
| clip_range | 0.145 |
| entropy_loss | -5.44 |
| explained_variance | 0.932 |
| learning_rate | 0.00024 |
| loss | -0.0399 |
| n_updates | 2016 |
| policy_gradient_loss | -0.0264 |
| value_loss | 0.0009 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 56.2 |
| ep_rew_mean | 0.819 |
| time/ | |
| fps | 1128 |
| iterations | 506 |
| time_elapsed | 3673 |
| total_timesteps | 4145152 |
| train/ | |
| approx_kl | 0.04104404 |
| clip_fraction | 0.268 |
| clip_range | 0.145 |
| entropy_loss | -5.24 |
| explained_variance | 0.937 |
| learning_rate | 0.00024 |
| loss | -0.029 |
| n_updates | 2020 |
| policy_gradient_loss | -0.0197 |
| value_loss | 0.000598 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 55.6 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1128 |
| iterations | 507 |
| time_elapsed | 3681 |
| total_timesteps | 4153344 |
| train/ | |
| approx_kl | 0.04690075 |
| clip_fraction | 0.307 |
| clip_range | 0.145 |
| entropy_loss | -5.49 |
| explained_variance | 0.947 |
| learning_rate | 0.00024 |
| loss | -0.0305 |
| n_updates | 2024 |
| policy_gradient_loss | -0.0251 |
| value_loss | 0.000696 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.4 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1128 |
| iterations | 508 |
| time_elapsed | 3688 |
| total_timesteps | 4161536 |
| train/ | |
| approx_kl | 0.06569204 |
| clip_fraction | 0.36 |
| clip_range | 0.145 |
| entropy_loss | -5.52 |
| explained_variance | 0.915 |
| learning_rate | 0.00024 |
| loss | -0.0262 |
| n_updates | 2028 |
| policy_gradient_loss | -0.0226 |
| value_loss | 0.00115 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 57.5 |
| ep_rew_mean | 0.827 |
| time/ | |
| fps | 1128 |
| iterations | 509 |
| time_elapsed | 3695 |
| total_timesteps | 4169728 |
| train/ | |
| approx_kl | 0.03677687 |
| clip_fraction | 0.303 |
| clip_range | 0.145 |
| entropy_loss | -5.37 |
| explained_variance | 0.916 |
| learning_rate | 0.00024 |
| loss | -0.0311 |
| n_updates | 2032 |
| policy_gradient_loss | -0.0179 |
| value_loss | 0.000819 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.4 |
| ep_rew_mean | 0.828 |
| time/ | |
| fps | 1128 |
| iterations | 510 |
| time_elapsed | 3703 |
| total_timesteps | 4177920 |
| train/ | |
| approx_kl | 0.055058636 |
| clip_fraction | 0.334 |
| clip_range | 0.145 |
| entropy_loss | -5.61 |
| explained_variance | 0.931 |
| learning_rate | 0.00024 |
| loss | -0.039 |
| n_updates | 2036 |
| policy_gradient_loss | -0.026 |
| value_loss | 0.000987 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.2 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1128 |
| iterations | 511 |
| time_elapsed | 3710 |
| total_timesteps | 4186112 |
| train/ | |
| approx_kl | 0.049495522 |
| clip_fraction | 0.308 |
| clip_range | 0.145 |
| entropy_loss | -5.37 |
| explained_variance | 0.948 |
| learning_rate | 0.00024 |
| loss | -0.0311 |
| n_updates | 2040 |
| policy_gradient_loss | -0.0225 |
| value_loss | 0.000542 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 57.3 |
| ep_rew_mean | 0.815 |
| time/ | |
| fps | 1128 |
| iterations | 512 |
| time_elapsed | 3717 |
| total_timesteps | 4194304 |
| train/ | |
| approx_kl | 0.054122627 |
| clip_fraction | 0.359 |
| clip_range | 0.145 |
| entropy_loss | -5.4 |
| explained_variance | 0.948 |
| learning_rate | 0.00024 |
| loss | -0.0356 |
| n_updates | 2044 |
| policy_gradient_loss | -0.0219 |
| value_loss | 0.000608 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 56.2 |
| ep_rew_mean | 0.825 |
| time/ | |
| fps | 1128 |
| iterations | 513 |
| time_elapsed | 3724 |
| total_timesteps | 4202496 |
| train/ | |
| approx_kl | 0.057738528 |
| clip_fraction | 0.347 |
| clip_range | 0.145 |
| entropy_loss | -5.6 |
| explained_variance | 0.936 |
| learning_rate | 0.00024 |
| loss | -0.034 |
| n_updates | 2048 |
| policy_gradient_loss | -0.0248 |
| value_loss | 0.000883 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.2 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1128 |
| iterations | 514 |
| time_elapsed | 3732 |
| total_timesteps | 4210688 |
| train/ | |
| approx_kl | 0.059093148 |
| clip_fraction | 0.314 |
| clip_range | 0.145 |
| entropy_loss | -5.62 |
| explained_variance | 0.934 |
| learning_rate | 0.00024 |
| loss | -0.0384 |
| n_updates | 2052 |
| policy_gradient_loss | -0.0254 |
| value_loss | 0.000913 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1128 |
| iterations | 515 |
| time_elapsed | 3739 |
| total_timesteps | 4218880 |
| train/ | |
| approx_kl | 0.051317383 |
| clip_fraction | 0.334 |
| clip_range | 0.145 |
| entropy_loss | -5.44 |
| explained_variance | 0.929 |
| learning_rate | 0.00024 |
| loss | -0.0318 |
| n_updates | 2056 |
| policy_gradient_loss | -0.0223 |
| value_loss | 0.000761 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.9 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1128 |
| iterations | 516 |
| time_elapsed | 3746 |
| total_timesteps | 4227072 |
| train/ | |
| approx_kl | 0.05705727 |
| clip_fraction | 0.363 |
| clip_range | 0.145 |
| entropy_loss | -5.47 |
| explained_variance | 0.927 |
| learning_rate | 0.00024 |
| loss | -0.0221 |
| n_updates | 2060 |
| policy_gradient_loss | -0.0235 |
| value_loss | 0.000911 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.8 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1128 |
| iterations | 517 |
| time_elapsed | 3753 |
| total_timesteps | 4235264 |
| train/ | |
| approx_kl | 0.05086074 |
| clip_fraction | 0.326 |
| clip_range | 0.145 |
| entropy_loss | -5.51 |
| explained_variance | 0.947 |
| learning_rate | 0.00024 |
| loss | -0.0361 |
| n_updates | 2064 |
| policy_gradient_loss | -0.0243 |
| value_loss | 0.000655 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 64.7 |
| ep_rew_mean | 0.799 |
| time/ | |
| fps | 1128 |
| iterations | 518 |
| time_elapsed | 3761 |
| total_timesteps | 4243456 |
| train/ | |
| approx_kl | 0.04305125 |
| clip_fraction | 0.365 |
| clip_range | 0.145 |
| entropy_loss | -5.63 |
| explained_variance | 0.95 |
| learning_rate | 0.00024 |
| loss | -0.0426 |
| n_updates | 2068 |
| policy_gradient_loss | -0.0278 |
| value_loss | 0.000684 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 62.4 |
| ep_rew_mean | 0.805 |
| time/ | |
| fps | 1128 |
| iterations | 519 |
| time_elapsed | 3768 |
| total_timesteps | 4251648 |
| train/ | |
| approx_kl | 0.054932684 |
| clip_fraction | 0.369 |
| clip_range | 0.145 |
| entropy_loss | -5.87 |
| explained_variance | 0.93 |
| learning_rate | 0.000239 |
| loss | -0.0409 |
| n_updates | 2072 |
| policy_gradient_loss | -0.0294 |
| value_loss | 0.00116 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1128 |
| iterations | 520 |
| time_elapsed | 3775 |
| total_timesteps | 4259840 |
| train/ | |
| approx_kl | 0.060865033 |
| clip_fraction | 0.368 |
| clip_range | 0.145 |
| entropy_loss | -5.82 |
| explained_variance | 0.941 |
| learning_rate | 0.000239 |
| loss | -0.0482 |
| n_updates | 2076 |
| policy_gradient_loss | -0.0306 |
| value_loss | 0.000939 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.4 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1128 |
| iterations | 521 |
| time_elapsed | 3782 |
| total_timesteps | 4268032 |
| train/ | |
| approx_kl | 0.056890756 |
| clip_fraction | 0.378 |
| clip_range | 0.145 |
| entropy_loss | -5.68 |
| explained_variance | 0.946 |
| learning_rate | 0.000239 |
| loss | -0.0412 |
| n_updates | 2080 |
| policy_gradient_loss | -0.0255 |
| value_loss | 0.000799 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 61.3 |
| ep_rew_mean | 0.808 |
| time/ | |
| fps | 1128 |
| iterations | 522 |
| time_elapsed | 3790 |
| total_timesteps | 4276224 |
| train/ | |
| approx_kl | 0.048369084 |
| clip_fraction | 0.345 |
| clip_range | 0.145 |
| entropy_loss | -5.66 |
| explained_variance | 0.943 |
| learning_rate | 0.000239 |
| loss | -0.0382 |
| n_updates | 2084 |
| policy_gradient_loss | -0.0252 |
| value_loss | 0.000792 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 58.9 |
| ep_rew_mean | 0.817 |
| time/ | |
| fps | 1128 |
| iterations | 523 |
| time_elapsed | 3797 |
| total_timesteps | 4284416 |
| train/ | |
| approx_kl | 0.06315075 |
| clip_fraction | 0.38 |
| clip_range | 0.145 |
| entropy_loss | -5.67 |
| explained_variance | 0.955 |
| learning_rate | 0.000239 |
| loss | -0.041 |
| n_updates | 2088 |
| policy_gradient_loss | -0.0296 |
| value_loss | 0.000681 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.7 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1128 |
| iterations | 524 |
| time_elapsed | 3804 |
| total_timesteps | 4292608 |
| train/ | |
| approx_kl | 0.04851605 |
| clip_fraction | 0.354 |
| clip_range | 0.145 |
| entropy_loss | -5.57 |
| explained_variance | 0.928 |
| learning_rate | 0.000239 |
| loss | -0.0381 |
| n_updates | 2092 |
| policy_gradient_loss | -0.0246 |
| value_loss | 0.000958 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.5 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1128 |
| iterations | 525 |
| time_elapsed | 3812 |
| total_timesteps | 4300800 |
| train/ | |
| approx_kl | 0.052156776 |
| clip_fraction | 0.309 |
| clip_range | 0.145 |
| entropy_loss | -5.44 |
| explained_variance | 0.964 |
| learning_rate | 0.000239 |
| loss | -0.0265 |
| n_updates | 2096 |
| policy_gradient_loss | -0.0204 |
| value_loss | 0.000407 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 56.6 |
| ep_rew_mean | 0.82 |
| time/ | |
| fps | 1128 |
| iterations | 526 |
| time_elapsed | 3819 |
| total_timesteps | 4308992 |
| train/ | |
| approx_kl | 0.050538268 |
| clip_fraction | 0.317 |
| clip_range | 0.145 |
| entropy_loss | -5.45 |
| explained_variance | 0.947 |
| learning_rate | 0.000239 |
| loss | -0.0394 |
| n_updates | 2100 |
| policy_gradient_loss | -0.0218 |
| value_loss | 0.000639 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1128 |
| iterations | 527 |
| time_elapsed | 3826 |
| total_timesteps | 4317184 |
| train/ | |
| approx_kl | 0.053843647 |
| clip_fraction | 0.372 |
| clip_range | 0.145 |
| entropy_loss | -5.57 |
| explained_variance | 0.934 |
| learning_rate | 0.000239 |
| loss | -0.032 |
| n_updates | 2104 |
| policy_gradient_loss | -0.0229 |
| value_loss | 0.000952 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1128 |
| iterations | 528 |
| time_elapsed | 3834 |
| total_timesteps | 4325376 |
| train/ | |
| approx_kl | 0.04266857 |
| clip_fraction | 0.285 |
| clip_range | 0.145 |
| entropy_loss | -5.16 |
| explained_variance | 0.9 |
| learning_rate | 0.000239 |
| loss | -0.0193 |
| n_updates | 2108 |
| policy_gradient_loss | -0.0141 |
| value_loss | 0.00068 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.5 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1128 |
| iterations | 529 |
| time_elapsed | 3841 |
| total_timesteps | 4333568 |
| train/ | |
| approx_kl | 0.036809586 |
| clip_fraction | 0.284 |
| clip_range | 0.145 |
| entropy_loss | -5.19 |
| explained_variance | 0.925 |
| learning_rate | 0.000239 |
| loss | -0.024 |
| n_updates | 2112 |
| policy_gradient_loss | -0.0173 |
| value_loss | 0.000565 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.2 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1128 |
| iterations | 530 |
| time_elapsed | 3848 |
| total_timesteps | 4341760 |
| train/ | |
| approx_kl | 0.045482874 |
| clip_fraction | 0.272 |
| clip_range | 0.145 |
| entropy_loss | -5.21 |
| explained_variance | 0.956 |
| learning_rate | 0.000239 |
| loss | -0.0243 |
| n_updates | 2116 |
| policy_gradient_loss | -0.0171 |
| value_loss | 0.000378 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 54.1 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1128 |
| iterations | 531 |
| time_elapsed | 3855 |
| total_timesteps | 4349952 |
| train/ | |
| approx_kl | 0.04621696 |
| clip_fraction | 0.269 |
| clip_range | 0.145 |
| entropy_loss | -5.36 |
| explained_variance | 0.921 |
| learning_rate | 0.000239 |
| loss | -0.0243 |
| n_updates | 2120 |
| policy_gradient_loss | -0.0176 |
| value_loss | 0.000705 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.5 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1128 |
| iterations | 532 |
| time_elapsed | 3863 |
| total_timesteps | 4358144 |
| train/ | |
| approx_kl | 0.048687138 |
| clip_fraction | 0.344 |
| clip_range | 0.145 |
| entropy_loss | -5.44 |
| explained_variance | 0.911 |
| learning_rate | 0.000239 |
| loss | -0.035 |
| n_updates | 2124 |
| policy_gradient_loss | -0.0225 |
| value_loss | 0.00107 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.5 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 533 |
| time_elapsed | 3871 |
| total_timesteps | 4366336 |
| train/ | |
| approx_kl | 0.056407236 |
| clip_fraction | 0.314 |
| clip_range | 0.145 |
| entropy_loss | -5.45 |
| explained_variance | 0.965 |
| learning_rate | 0.000239 |
| loss | -0.0312 |
| n_updates | 2128 |
| policy_gradient_loss | -0.0217 |
| value_loss | 0.000401 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.8 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 534 |
| time_elapsed | 3878 |
| total_timesteps | 4374528 |
| train/ | |
| approx_kl | 0.045233697 |
| clip_fraction | 0.318 |
| clip_range | 0.145 |
| entropy_loss | -5.31 |
| explained_variance | 0.963 |
| learning_rate | 0.000239 |
| loss | -0.0216 |
| n_updates | 2132 |
| policy_gradient_loss | -0.0189 |
| value_loss | 0.000412 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.9 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 535 |
| time_elapsed | 3885 |
| total_timesteps | 4382720 |
| train/ | |
| approx_kl | 0.044545967 |
| clip_fraction | 0.295 |
| clip_range | 0.145 |
| entropy_loss | -5.36 |
| explained_variance | 0.952 |
| learning_rate | 0.000239 |
| loss | -0.0367 |
| n_updates | 2136 |
| policy_gradient_loss | -0.0205 |
| value_loss | 0.000591 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1127 |
| iterations | 536 |
| time_elapsed | 3893 |
| total_timesteps | 4390912 |
| train/ | |
| approx_kl | 0.048472296 |
| clip_fraction | 0.315 |
| clip_range | 0.145 |
| entropy_loss | -5.31 |
| explained_variance | 0.939 |
| learning_rate | 0.000239 |
| loss | -0.0253 |
| n_updates | 2140 |
| policy_gradient_loss | -0.0207 |
| value_loss | 0.000708 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.6 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1127 |
| iterations | 537 |
| time_elapsed | 3900 |
| total_timesteps | 4399104 |
| train/ | |
| approx_kl | 0.029288147 |
| clip_fraction | 0.272 |
| clip_range | 0.145 |
| entropy_loss | -5.11 |
| explained_variance | 0.967 |
| learning_rate | 0.000239 |
| loss | -0.0203 |
| n_updates | 2144 |
| policy_gradient_loss | -0.0117 |
| value_loss | 0.000244 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1127 |
| iterations | 538 |
| time_elapsed | 3907 |
| total_timesteps | 4407296 |
| train/ | |
| approx_kl | 0.05622423 |
| clip_fraction | 0.341 |
| clip_range | 0.145 |
| entropy_loss | -5.28 |
| explained_variance | 0.956 |
| learning_rate | 0.000239 |
| loss | -0.0254 |
| n_updates | 2148 |
| policy_gradient_loss | -0.0174 |
| value_loss | 0.000445 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.6 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1127 |
| iterations | 539 |
| time_elapsed | 3914 |
| total_timesteps | 4415488 |
| train/ | |
| approx_kl | 0.057715148 |
| clip_fraction | 0.288 |
| clip_range | 0.144 |
| entropy_loss | -5.28 |
| explained_variance | 0.963 |
| learning_rate | 0.000239 |
| loss | -0.026 |
| n_updates | 2152 |
| policy_gradient_loss | -0.0178 |
| value_loss | 0.000341 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.2 |
| ep_rew_mean | 0.826 |
| time/ | |
| fps | 1127 |
| iterations | 540 |
| time_elapsed | 3922 |
| total_timesteps | 4423680 |
| train/ | |
| approx_kl | 0.056498893 |
| clip_fraction | 0.328 |
| clip_range | 0.144 |
| entropy_loss | -5.32 |
| explained_variance | 0.951 |
| learning_rate | 0.000239 |
| loss | -0.0306 |
| n_updates | 2156 |
| policy_gradient_loss | -0.0207 |
| value_loss | 0.000491 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.7 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1127 |
| iterations | 541 |
| time_elapsed | 3929 |
| total_timesteps | 4431872 |
| train/ | |
| approx_kl | 0.099204816 |
| clip_fraction | 0.329 |
| clip_range | 0.144 |
| entropy_loss | -5.37 |
| explained_variance | 0.957 |
| learning_rate | 0.000239 |
| loss | -0.0271 |
| n_updates | 2160 |
| policy_gradient_loss | -0.0224 |
| value_loss | 0.000486 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.3 |
| ep_rew_mean | 0.832 |
| time/ | |
| fps | 1127 |
| iterations | 542 |
| time_elapsed | 3936 |
| total_timesteps | 4440064 |
| train/ | |
| approx_kl | 0.05608494 |
| clip_fraction | 0.32 |
| clip_range | 0.144 |
| entropy_loss | -5.44 |
| explained_variance | 0.944 |
| learning_rate | 0.000239 |
| loss | -0.0224 |
| n_updates | 2164 |
| policy_gradient_loss | -0.0215 |
| value_loss | 0.000704 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.7 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 543 |
| time_elapsed | 3943 |
| total_timesteps | 4448256 |
| train/ | |
| approx_kl | 0.060483634 |
| clip_fraction | 0.305 |
| clip_range | 0.144 |
| entropy_loss | -5.33 |
| explained_variance | 0.946 |
| learning_rate | 0.000239 |
| loss | -0.0199 |
| n_updates | 2168 |
| policy_gradient_loss | -0.0159 |
| value_loss | 0.000516 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.7 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 544 |
| time_elapsed | 3950 |
| total_timesteps | 4456448 |
| train/ | |
| approx_kl | 0.054039173 |
| clip_fraction | 0.34 |
| clip_range | 0.144 |
| entropy_loss | -5.53 |
| explained_variance | 0.943 |
| learning_rate | 0.000239 |
| loss | -0.0368 |
| n_updates | 2172 |
| policy_gradient_loss | -0.0242 |
| value_loss | 0.000641 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1127 |
| iterations | 545 |
| time_elapsed | 3958 |
| total_timesteps | 4464640 |
| train/ | |
| approx_kl | 0.040369354 |
| clip_fraction | 0.347 |
| clip_range | 0.144 |
| entropy_loss | -5.54 |
| explained_variance | 0.944 |
| learning_rate | 0.000239 |
| loss | -0.0289 |
| n_updates | 2176 |
| policy_gradient_loss | -0.0221 |
| value_loss | 0.000656 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.7 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 546 |
| time_elapsed | 3965 |
| total_timesteps | 4472832 |
| train/ | |
| approx_kl | 0.045313485 |
| clip_fraction | 0.316 |
| clip_range | 0.144 |
| entropy_loss | -5.5 |
| explained_variance | 0.924 |
| learning_rate | 0.000239 |
| loss | -0.0236 |
| n_updates | 2180 |
| policy_gradient_loss | -0.0206 |
| value_loss | 0.000853 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 55.1 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1127 |
| iterations | 547 |
| time_elapsed | 3972 |
| total_timesteps | 4481024 |
| train/ | |
| approx_kl | 0.046372186 |
| clip_fraction | 0.324 |
| clip_range | 0.144 |
| entropy_loss | -5.56 |
| explained_variance | 0.921 |
| learning_rate | 0.000239 |
| loss | -0.0331 |
| n_updates | 2184 |
| policy_gradient_loss | -0.0193 |
| value_loss | 0.000983 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.6 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1127 |
| iterations | 548 |
| time_elapsed | 3980 |
| total_timesteps | 4489216 |
| train/ | |
| approx_kl | 0.04603003 |
| clip_fraction | 0.309 |
| clip_range | 0.144 |
| entropy_loss | -5.72 |
| explained_variance | 0.936 |
| learning_rate | 0.000239 |
| loss | -0.0305 |
| n_updates | 2188 |
| policy_gradient_loss | -0.0249 |
| value_loss | 0.000799 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 55.3 |
| ep_rew_mean | 0.825 |
| time/ | |
| fps | 1127 |
| iterations | 549 |
| time_elapsed | 3987 |
| total_timesteps | 4497408 |
| train/ | |
| approx_kl | 0.058056153 |
| clip_fraction | 0.373 |
| clip_range | 0.144 |
| entropy_loss | -5.68 |
| explained_variance | 0.929 |
| learning_rate | 0.000239 |
| loss | -0.0413 |
| n_updates | 2192 |
| policy_gradient_loss | -0.0235 |
| value_loss | 0.000888 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.3 |
| ep_rew_mean | 0.83 |
| time/ | |
| fps | 1127 |
| iterations | 550 |
| time_elapsed | 3995 |
| total_timesteps | 4505600 |
| train/ | |
| approx_kl | 0.043329276 |
| clip_fraction | 0.31 |
| clip_range | 0.144 |
| entropy_loss | -5.65 |
| explained_variance | 0.939 |
| learning_rate | 0.000239 |
| loss | -0.0357 |
| n_updates | 2196 |
| policy_gradient_loss | -0.0251 |
| value_loss | 0.000719 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 57.3 |
| ep_rew_mean | 0.82 |
| time/ | |
| fps | 1127 |
| iterations | 551 |
| time_elapsed | 4002 |
| total_timesteps | 4513792 |
| train/ | |
| approx_kl | 0.0553881 |
| clip_fraction | 0.338 |
| clip_range | 0.144 |
| entropy_loss | -5.52 |
| explained_variance | 0.925 |
| learning_rate | 0.000239 |
| loss | -0.0327 |
| n_updates | 2200 |
| policy_gradient_loss | -0.02 |
| value_loss | 0.000878 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.8 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 552 |
| time_elapsed | 4010 |
| total_timesteps | 4521984 |
| train/ | |
| approx_kl | 0.05924145 |
| clip_fraction | 0.334 |
| clip_range | 0.144 |
| entropy_loss | -5.57 |
| explained_variance | 0.948 |
| learning_rate | 0.000239 |
| loss | -0.0355 |
| n_updates | 2204 |
| policy_gradient_loss | -0.0247 |
| value_loss | 0.000671 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 55.9 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1127 |
| iterations | 553 |
| time_elapsed | 4017 |
| total_timesteps | 4530176 |
| train/ | |
| approx_kl | 0.045635074 |
| clip_fraction | 0.326 |
| clip_range | 0.144 |
| entropy_loss | -5.44 |
| explained_variance | 0.937 |
| learning_rate | 0.000239 |
| loss | -0.0317 |
| n_updates | 2208 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.000695 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1127 |
| iterations | 554 |
| time_elapsed | 4024 |
| total_timesteps | 4538368 |
| train/ | |
| approx_kl | 0.050881866 |
| clip_fraction | 0.308 |
| clip_range | 0.144 |
| entropy_loss | -5.49 |
| explained_variance | 0.95 |
| learning_rate | 0.000239 |
| loss | -0.0351 |
| n_updates | 2212 |
| policy_gradient_loss | -0.0213 |
| value_loss | 0.000575 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 555 |
| time_elapsed | 4032 |
| total_timesteps | 4546560 |
| train/ | |
| approx_kl | 0.044513717 |
| clip_fraction | 0.292 |
| clip_range | 0.144 |
| entropy_loss | -5.29 |
| explained_variance | 0.956 |
| learning_rate | 0.000239 |
| loss | -0.0221 |
| n_updates | 2216 |
| policy_gradient_loss | -0.0163 |
| value_loss | 0.000371 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1127 |
| iterations | 556 |
| time_elapsed | 4039 |
| total_timesteps | 4554752 |
| train/ | |
| approx_kl | 0.038221274 |
| clip_fraction | 0.318 |
| clip_range | 0.144 |
| entropy_loss | -5.25 |
| explained_variance | 0.964 |
| learning_rate | 0.000239 |
| loss | -0.0272 |
| n_updates | 2220 |
| policy_gradient_loss | -0.0183 |
| value_loss | 0.000332 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.6 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1127 |
| iterations | 557 |
| time_elapsed | 4046 |
| total_timesteps | 4562944 |
| train/ | |
| approx_kl | 0.05330053 |
| clip_fraction | 0.222 |
| clip_range | 0.144 |
| entropy_loss | -5.25 |
| explained_variance | 0.987 |
| learning_rate | 0.000239 |
| loss | -0.027 |
| n_updates | 2224 |
| policy_gradient_loss | -0.0192 |
| value_loss | 0.000112 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1127 |
| iterations | 558 |
| time_elapsed | 4054 |
| total_timesteps | 4571136 |
| train/ | |
| approx_kl | 0.031342708 |
| clip_fraction | 0.273 |
| clip_range | 0.144 |
| entropy_loss | -5.12 |
| explained_variance | 0.954 |
| learning_rate | 0.000239 |
| loss | -0.0092 |
| n_updates | 2228 |
| policy_gradient_loss | -0.00933 |
| value_loss | 0.000303 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.5 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1127 |
| iterations | 559 |
| time_elapsed | 4061 |
| total_timesteps | 4579328 |
| train/ | |
| approx_kl | 0.042512417 |
| clip_fraction | 0.285 |
| clip_range | 0.144 |
| entropy_loss | -5.22 |
| explained_variance | 0.961 |
| learning_rate | 0.000239 |
| loss | -0.0322 |
| n_updates | 2232 |
| policy_gradient_loss | -0.0216 |
| value_loss | 0.0003 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1127 |
| iterations | 560 |
| time_elapsed | 4068 |
| total_timesteps | 4587520 |
| train/ | |
| approx_kl | 0.051497437 |
| clip_fraction | 0.324 |
| clip_range | 0.144 |
| entropy_loss | -5.28 |
| explained_variance | 0.939 |
| learning_rate | 0.000239 |
| loss | -0.02 |
| n_updates | 2236 |
| policy_gradient_loss | -0.0192 |
| value_loss | 0.000622 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1127 |
| iterations | 561 |
| time_elapsed | 4075 |
| total_timesteps | 4595712 |
| train/ | |
| approx_kl | 0.040752567 |
| clip_fraction | 0.291 |
| clip_range | 0.144 |
| entropy_loss | -5.18 |
| explained_variance | 0.965 |
| learning_rate | 0.000239 |
| loss | -0.0173 |
| n_updates | 2240 |
| policy_gradient_loss | -0.0153 |
| value_loss | 0.000251 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1127 |
| iterations | 562 |
| time_elapsed | 4082 |
| total_timesteps | 4603904 |
| train/ | |
| approx_kl | 0.05736787 |
| clip_fraction | 0.284 |
| clip_range | 0.144 |
| entropy_loss | -5.14 |
| explained_variance | 0.937 |
| learning_rate | 0.000239 |
| loss | -0.0194 |
| n_updates | 2244 |
| policy_gradient_loss | -0.0148 |
| value_loss | 0.000487 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 563 |
| time_elapsed | 4090 |
| total_timesteps | 4612096 |
| train/ | |
| approx_kl | 0.06195868 |
| clip_fraction | 0.264 |
| clip_range | 0.144 |
| entropy_loss | -5.07 |
| explained_variance | 0.962 |
| learning_rate | 0.000239 |
| loss | -0.0137 |
| n_updates | 2248 |
| policy_gradient_loss | -0.014 |
| value_loss | 0.000254 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.4 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 564 |
| time_elapsed | 4097 |
| total_timesteps | 4620288 |
| train/ | |
| approx_kl | 0.012728315 |
| clip_fraction | 0.187 |
| clip_range | 0.144 |
| entropy_loss | -4.98 |
| explained_variance | 0.99 |
| learning_rate | 0.000239 |
| loss | -0.00338 |
| n_updates | 2252 |
| policy_gradient_loss | -0.00427 |
| value_loss | 4.72e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1127 |
| iterations | 565 |
| time_elapsed | 4105 |
| total_timesteps | 4628480 |
| train/ | |
| approx_kl | 0.040523097 |
| clip_fraction | 0.273 |
| clip_range | 0.144 |
| entropy_loss | -5.06 |
| explained_variance | 0.971 |
| learning_rate | 0.000239 |
| loss | -0.0208 |
| n_updates | 2256 |
| policy_gradient_loss | -0.0156 |
| value_loss | 0.000235 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 566 |
| time_elapsed | 4112 |
| total_timesteps | 4636672 |
| train/ | |
| approx_kl | 0.041711353 |
| clip_fraction | 0.261 |
| clip_range | 0.144 |
| entropy_loss | -4.96 |
| explained_variance | 0.98 |
| learning_rate | 0.000239 |
| loss | -0.0171 |
| n_updates | 2260 |
| policy_gradient_loss | -0.013 |
| value_loss | 0.000143 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1127 |
| iterations | 567 |
| time_elapsed | 4119 |
| total_timesteps | 4644864 |
| train/ | |
| approx_kl | 0.012162924 |
| clip_fraction | 0.238 |
| clip_range | 0.144 |
| entropy_loss | -4.93 |
| explained_variance | 0.978 |
| learning_rate | 0.000239 |
| loss | -0.00674 |
| n_updates | 2264 |
| policy_gradient_loss | -0.00447 |
| value_loss | 0.000113 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 568 |
| time_elapsed | 4126 |
| total_timesteps | 4653056 |
| train/ | |
| approx_kl | 0.0406085 |
| clip_fraction | 0.314 |
| clip_range | 0.144 |
| entropy_loss | -5.02 |
| explained_variance | 0.952 |
| learning_rate | 0.000239 |
| loss | -0.027 |
| n_updates | 2268 |
| policy_gradient_loss | -0.0153 |
| value_loss | 0.000354 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1127 |
| iterations | 569 |
| time_elapsed | 4134 |
| total_timesteps | 4661248 |
| train/ | |
| approx_kl | 0.05196093 |
| clip_fraction | 0.27 |
| clip_range | 0.144 |
| entropy_loss | -4.93 |
| explained_variance | 0.932 |
| learning_rate | 0.000238 |
| loss | -0.0135 |
| n_updates | 2272 |
| policy_gradient_loss | -0.0121 |
| value_loss | 0.000424 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1127 |
| iterations | 570 |
| time_elapsed | 4141 |
| total_timesteps | 4669440 |
| train/ | |
| approx_kl | 0.04596716 |
| clip_fraction | 0.254 |
| clip_range | 0.144 |
| entropy_loss | -4.98 |
| explained_variance | 0.961 |
| learning_rate | 0.000238 |
| loss | -0.0198 |
| n_updates | 2276 |
| policy_gradient_loss | -0.0167 |
| value_loss | 0.00028 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1127 |
| iterations | 571 |
| time_elapsed | 4148 |
| total_timesteps | 4677632 |
| train/ | |
| approx_kl | 0.023760594 |
| clip_fraction | 0.237 |
| clip_range | 0.144 |
| entropy_loss | -4.86 |
| explained_variance | 0.969 |
| learning_rate | 0.000238 |
| loss | -0.00121 |
| n_updates | 2280 |
| policy_gradient_loss | -0.00792 |
| value_loss | 0.000183 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.3 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1127 |
| iterations | 572 |
| time_elapsed | 4156 |
| total_timesteps | 4685824 |
| train/ | |
| approx_kl | 0.04906841 |
| clip_fraction | 0.284 |
| clip_range | 0.144 |
| entropy_loss | -4.95 |
| explained_variance | 0.963 |
| learning_rate | 0.000238 |
| loss | -0.0207 |
| n_updates | 2284 |
| policy_gradient_loss | -0.0133 |
| value_loss | 0.000272 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 573 |
| time_elapsed | 4163 |
| total_timesteps | 4694016 |
| train/ | |
| approx_kl | 0.029961895 |
| clip_fraction | 0.262 |
| clip_range | 0.144 |
| entropy_loss | -4.99 |
| explained_variance | 0.947 |
| learning_rate | 0.000238 |
| loss | -0.0223 |
| n_updates | 2288 |
| policy_gradient_loss | -0.0112 |
| value_loss | 0.000373 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1127 |
| iterations | 574 |
| time_elapsed | 4171 |
| total_timesteps | 4702208 |
| train/ | |
| approx_kl | 0.071192876 |
| clip_fraction | 0.19 |
| clip_range | 0.144 |
| entropy_loss | -5 |
| explained_variance | 0.985 |
| learning_rate | 0.000238 |
| loss | -0.0133 |
| n_updates | 2292 |
| policy_gradient_loss | -0.0121 |
| value_loss | 8.15e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 575 |
| time_elapsed | 4178 |
| total_timesteps | 4710400 |
| train/ | |
| approx_kl | 0.059241414 |
| clip_fraction | 0.291 |
| clip_range | 0.144 |
| entropy_loss | -5.05 |
| explained_variance | 0.967 |
| learning_rate | 0.000238 |
| loss | -0.0201 |
| n_updates | 2296 |
| policy_gradient_loss | -0.0169 |
| value_loss | 0.000278 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 576 |
| time_elapsed | 4185 |
| total_timesteps | 4718592 |
| train/ | |
| approx_kl | 0.04245595 |
| clip_fraction | 0.258 |
| clip_range | 0.144 |
| entropy_loss | -5.11 |
| explained_variance | 0.957 |
| learning_rate | 0.000238 |
| loss | -0.0205 |
| n_updates | 2300 |
| policy_gradient_loss | -0.0169 |
| value_loss | 0.000339 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1127 |
| iterations | 577 |
| time_elapsed | 4193 |
| total_timesteps | 4726784 |
| train/ | |
| approx_kl | 0.05366593 |
| clip_fraction | 0.322 |
| clip_range | 0.144 |
| entropy_loss | -5.11 |
| explained_variance | 0.948 |
| learning_rate | 0.000238 |
| loss | -0.0249 |
| n_updates | 2304 |
| policy_gradient_loss | -0.0192 |
| value_loss | 0.000503 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 578 |
| time_elapsed | 4200 |
| total_timesteps | 4734976 |
| train/ | |
| approx_kl | 0.031565104 |
| clip_fraction | 0.219 |
| clip_range | 0.144 |
| entropy_loss | -5.03 |
| explained_variance | 0.968 |
| learning_rate | 0.000238 |
| loss | -0.0143 |
| n_updates | 2308 |
| policy_gradient_loss | -0.0117 |
| value_loss | 0.000195 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1127 |
| iterations | 579 |
| time_elapsed | 4207 |
| total_timesteps | 4743168 |
| train/ | |
| approx_kl | 0.02470883 |
| clip_fraction | 0.227 |
| clip_range | 0.144 |
| entropy_loss | -5.02 |
| explained_variance | 0.988 |
| learning_rate | 0.000238 |
| loss | -0.0161 |
| n_updates | 2312 |
| policy_gradient_loss | -0.00843 |
| value_loss | 8.33e-05 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1127 |
| iterations | 580 |
| time_elapsed | 4215 |
| total_timesteps | 4751360 |
| train/ | |
| approx_kl | 0.032272242 |
| clip_fraction | 0.263 |
| clip_range | 0.144 |
| entropy_loss | -5.11 |
| explained_variance | 0.966 |
| learning_rate | 0.000238 |
| loss | -0.0185 |
| n_updates | 2316 |
| policy_gradient_loss | -0.0137 |
| value_loss | 0.000273 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1127 |
| iterations | 581 |
| time_elapsed | 4222 |
| total_timesteps | 4759552 |
| train/ | |
| approx_kl | 0.043851785 |
| clip_fraction | 0.27 |
| clip_range | 0.144 |
| entropy_loss | -5.18 |
| explained_variance | 0.966 |
| learning_rate | 0.000238 |
| loss | -0.0229 |
| n_updates | 2320 |
| policy_gradient_loss | -0.0172 |
| value_loss | 0.000309 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 582 |
| time_elapsed | 4229 |
| total_timesteps | 4767744 |
| train/ | |
| approx_kl | 0.042000175 |
| clip_fraction | 0.211 |
| clip_range | 0.144 |
| entropy_loss | -5.07 |
| explained_variance | 0.946 |
| learning_rate | 0.000238 |
| loss | -0.0173 |
| n_updates | 2324 |
| policy_gradient_loss | -0.0103 |
| value_loss | 0.000322 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.9 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1127 |
| iterations | 583 |
| time_elapsed | 4237 |
| total_timesteps | 4775936 |
| train/ | |
| approx_kl | 0.04437423 |
| clip_fraction | 0.302 |
| clip_range | 0.144 |
| entropy_loss | -5.21 |
| explained_variance | 0.953 |
| learning_rate | 0.000238 |
| loss | -0.028 |
| n_updates | 2328 |
| policy_gradient_loss | -0.021 |
| value_loss | 0.000431 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.4 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 584 |
| time_elapsed | 4244 |
| total_timesteps | 4784128 |
| train/ | |
| approx_kl | 0.06473155 |
| clip_fraction | 0.2 |
| clip_range | 0.144 |
| entropy_loss | -5.19 |
| explained_variance | 0.988 |
| learning_rate | 0.000238 |
| loss | -0.0214 |
| n_updates | 2332 |
| policy_gradient_loss | -0.0176 |
| value_loss | 9.54e-05 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.8 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1127 |
| iterations | 585 |
| time_elapsed | 4251 |
| total_timesteps | 4792320 |
| train/ | |
| approx_kl | 0.028169803 |
| clip_fraction | 0.211 |
| clip_range | 0.144 |
| entropy_loss | -5.05 |
| explained_variance | 0.959 |
| learning_rate | 0.000238 |
| loss | -0.0098 |
| n_updates | 2336 |
| policy_gradient_loss | -0.00858 |
| value_loss | 0.000206 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.5 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 586 |
| time_elapsed | 4258 |
| total_timesteps | 4800512 |
| train/ | |
| approx_kl | 0.04271345 |
| clip_fraction | 0.257 |
| clip_range | 0.144 |
| entropy_loss | -5.2 |
| explained_variance | 0.949 |
| learning_rate | 0.000238 |
| loss | -0.0275 |
| n_updates | 2340 |
| policy_gradient_loss | -0.0198 |
| value_loss | 0.000402 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.4 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1127 |
| iterations | 587 |
| time_elapsed | 4265 |
| total_timesteps | 4808704 |
| train/ | |
| approx_kl | 0.060102172 |
| clip_fraction | 0.286 |
| clip_range | 0.144 |
| entropy_loss | -5.29 |
| explained_variance | 0.942 |
| learning_rate | 0.000238 |
| loss | -0.0263 |
| n_updates | 2344 |
| policy_gradient_loss | -0.0195 |
| value_loss | 0.000552 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1127 |
| iterations | 588 |
| time_elapsed | 4273 |
| total_timesteps | 4816896 |
| train/ | |
| approx_kl | 0.04491703 |
| clip_fraction | 0.305 |
| clip_range | 0.144 |
| entropy_loss | -5.26 |
| explained_variance | 0.927 |
| learning_rate | 0.000238 |
| loss | -0.0324 |
| n_updates | 2348 |
| policy_gradient_loss | -0.0189 |
| value_loss | 0.000773 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 589 |
| time_elapsed | 4280 |
| total_timesteps | 4825088 |
| train/ | |
| approx_kl | 0.041739043 |
| clip_fraction | 0.282 |
| clip_range | 0.144 |
| entropy_loss | -5.1 |
| explained_variance | 0.943 |
| learning_rate | 0.000238 |
| loss | -0.0149 |
| n_updates | 2352 |
| policy_gradient_loss | -0.0146 |
| value_loss | 0.000447 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.1 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1127 |
| iterations | 590 |
| time_elapsed | 4287 |
| total_timesteps | 4833280 |
| train/ | |
| approx_kl | 0.034513783 |
| clip_fraction | 0.253 |
| clip_range | 0.144 |
| entropy_loss | -5.08 |
| explained_variance | 0.961 |
| learning_rate | 0.000238 |
| loss | -0.0197 |
| n_updates | 2356 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000268 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 56 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1127 |
| iterations | 591 |
| time_elapsed | 4294 |
| total_timesteps | 4841472 |
| train/ | |
| approx_kl | 0.049036443 |
| clip_fraction | 0.302 |
| clip_range | 0.144 |
| entropy_loss | -5.14 |
| explained_variance | 0.933 |
| learning_rate | 0.000238 |
| loss | -0.0181 |
| n_updates | 2360 |
| policy_gradient_loss | -0.0154 |
| value_loss | 0.000599 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.5 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1127 |
| iterations | 592 |
| time_elapsed | 4301 |
| total_timesteps | 4849664 |
| train/ | |
| approx_kl | 0.04551503 |
| clip_fraction | 0.277 |
| clip_range | 0.144 |
| entropy_loss | -5.39 |
| explained_variance | 0.943 |
| learning_rate | 0.000238 |
| loss | -0.0296 |
| n_updates | 2364 |
| policy_gradient_loss | -0.0225 |
| value_loss | 0.000593 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1127 |
| iterations | 593 |
| time_elapsed | 4309 |
| total_timesteps | 4857856 |
| train/ | |
| approx_kl | 0.036793385 |
| clip_fraction | 0.264 |
| clip_range | 0.144 |
| entropy_loss | -5.28 |
| explained_variance | 0.922 |
| learning_rate | 0.000238 |
| loss | -0.0238 |
| n_updates | 2368 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000752 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54.6 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1127 |
| iterations | 594 |
| time_elapsed | 4316 |
| total_timesteps | 4866048 |
| train/ | |
| approx_kl | 0.038997218 |
| clip_fraction | 0.278 |
| clip_range | 0.144 |
| entropy_loss | -5.3 |
| explained_variance | 0.939 |
| learning_rate | 0.000238 |
| loss | -0.0298 |
| n_updates | 2372 |
| policy_gradient_loss | -0.0202 |
| value_loss | 0.000543 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 595 |
| time_elapsed | 4324 |
| total_timesteps | 4874240 |
| train/ | |
| approx_kl | 0.04145226 |
| clip_fraction | 0.266 |
| clip_range | 0.144 |
| entropy_loss | -5.39 |
| explained_variance | 0.938 |
| learning_rate | 0.000238 |
| loss | -0.0356 |
| n_updates | 2376 |
| policy_gradient_loss | -0.0226 |
| value_loss | 0.000628 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1127 |
| iterations | 596 |
| time_elapsed | 4331 |
| total_timesteps | 4882432 |
| train/ | |
| approx_kl | 0.03622244 |
| clip_fraction | 0.259 |
| clip_range | 0.144 |
| entropy_loss | -5.42 |
| explained_variance | 0.927 |
| learning_rate | 0.000238 |
| loss | -0.0194 |
| n_updates | 2380 |
| policy_gradient_loss | -0.0217 |
| value_loss | 0.000716 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1127 |
| iterations | 597 |
| time_elapsed | 4338 |
| total_timesteps | 4890624 |
| train/ | |
| approx_kl | 0.046796452 |
| clip_fraction | 0.298 |
| clip_range | 0.144 |
| entropy_loss | -5.48 |
| explained_variance | 0.915 |
| learning_rate | 0.000238 |
| loss | -0.026 |
| n_updates | 2384 |
| policy_gradient_loss | -0.0208 |
| value_loss | 0.000958 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.4 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1127 |
| iterations | 598 |
| time_elapsed | 4346 |
| total_timesteps | 4898816 |
| train/ | |
| approx_kl | 0.043412667 |
| clip_fraction | 0.283 |
| clip_range | 0.144 |
| entropy_loss | -5.38 |
| explained_variance | 0.922 |
| learning_rate | 0.000238 |
| loss | -0.0255 |
| n_updates | 2388 |
| policy_gradient_loss | -0.0183 |
| value_loss | 0.000754 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1127 |
| iterations | 599 |
| time_elapsed | 4353 |
| total_timesteps | 4907008 |
| train/ | |
| approx_kl | 0.0567594 |
| clip_fraction | 0.33 |
| clip_range | 0.144 |
| entropy_loss | -5.44 |
| explained_variance | 0.928 |
| learning_rate | 0.000238 |
| loss | -0.0359 |
| n_updates | 2392 |
| policy_gradient_loss | -0.0242 |
| value_loss | 0.000839 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.9 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1127 |
| iterations | 600 |
| time_elapsed | 4360 |
| total_timesteps | 4915200 |
| train/ | |
| approx_kl | 0.03798549 |
| clip_fraction | 0.276 |
| clip_range | 0.144 |
| entropy_loss | -5.35 |
| explained_variance | 0.955 |
| learning_rate | 0.000238 |
| loss | -0.0296 |
| n_updates | 2396 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.00045 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.1 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1127 |
| iterations | 601 |
| time_elapsed | 4368 |
| total_timesteps | 4923392 |
| train/ | |
| approx_kl | 0.04307291 |
| clip_fraction | 0.294 |
| clip_range | 0.144 |
| entropy_loss | -5.24 |
| explained_variance | 0.914 |
| learning_rate | 0.000238 |
| loss | -0.023 |
| n_updates | 2400 |
| policy_gradient_loss | -0.0154 |
| value_loss | 0.000658 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.6 |
| ep_rew_mean | 0.821 |
| time/ | |
| fps | 1126 |
| iterations | 602 |
| time_elapsed | 4376 |
| total_timesteps | 4931584 |
| train/ | |
| approx_kl | 0.041731633 |
| clip_fraction | 0.241 |
| clip_range | 0.144 |
| entropy_loss | -5.23 |
| explained_variance | 0.967 |
| learning_rate | 0.000238 |
| loss | -0.0262 |
| n_updates | 2404 |
| policy_gradient_loss | -0.0165 |
| value_loss | 0.000263 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.9 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 603 |
| time_elapsed | 4383 |
| total_timesteps | 4939776 |
| train/ | |
| approx_kl | 0.047130298 |
| clip_fraction | 0.293 |
| clip_range | 0.144 |
| entropy_loss | -5.28 |
| explained_variance | 0.96 |
| learning_rate | 0.000238 |
| loss | -0.0275 |
| n_updates | 2408 |
| policy_gradient_loss | -0.0216 |
| value_loss | 0.000422 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.6 |
| ep_rew_mean | 0.855 |
| time/ | |
| fps | 1126 |
| iterations | 604 |
| time_elapsed | 4390 |
| total_timesteps | 4947968 |
| train/ | |
| approx_kl | 0.046567023 |
| clip_fraction | 0.3 |
| clip_range | 0.144 |
| entropy_loss | -5.23 |
| explained_variance | 0.972 |
| learning_rate | 0.000238 |
| loss | -0.0281 |
| n_updates | 2412 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000268 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1126 |
| iterations | 605 |
| time_elapsed | 4398 |
| total_timesteps | 4956160 |
| train/ | |
| approx_kl | 0.05410557 |
| clip_fraction | 0.29 |
| clip_range | 0.144 |
| entropy_loss | -5.19 |
| explained_variance | 0.935 |
| learning_rate | 0.000238 |
| loss | -0.0216 |
| n_updates | 2416 |
| policy_gradient_loss | -0.0166 |
| value_loss | 0.000467 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 606 |
| time_elapsed | 4405 |
| total_timesteps | 4964352 |
| train/ | |
| approx_kl | 0.03432851 |
| clip_fraction | 0.27 |
| clip_range | 0.144 |
| entropy_loss | -5.27 |
| explained_variance | 0.961 |
| learning_rate | 0.000238 |
| loss | -0.027 |
| n_updates | 2420 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.00034 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 607 |
| time_elapsed | 4412 |
| total_timesteps | 4972544 |
| train/ | |
| approx_kl | 0.030450588 |
| clip_fraction | 0.233 |
| clip_range | 0.144 |
| entropy_loss | -5.18 |
| explained_variance | 0.98 |
| learning_rate | 0.000238 |
| loss | -0.0157 |
| n_updates | 2424 |
| policy_gradient_loss | -0.0135 |
| value_loss | 0.000146 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 608 |
| time_elapsed | 4419 |
| total_timesteps | 4980736 |
| train/ | |
| approx_kl | 0.11981427 |
| clip_fraction | 0.282 |
| clip_range | 0.144 |
| entropy_loss | -5.21 |
| explained_variance | 0.954 |
| learning_rate | 0.000238 |
| loss | -0.0237 |
| n_updates | 2428 |
| policy_gradient_loss | -0.0177 |
| value_loss | 0.000402 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 609 |
| time_elapsed | 4427 |
| total_timesteps | 4988928 |
| train/ | |
| approx_kl | 0.06815045 |
| clip_fraction | 0.236 |
| clip_range | 0.144 |
| entropy_loss | -5.2 |
| explained_variance | 0.982 |
| learning_rate | 0.000238 |
| loss | -0.027 |
| n_updates | 2432 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.000185 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 610 |
| time_elapsed | 4434 |
| total_timesteps | 4997120 |
| train/ | |
| approx_kl | 0.054123774 |
| clip_fraction | 0.294 |
| clip_range | 0.144 |
| entropy_loss | -5.17 |
| explained_variance | 0.962 |
| learning_rate | 0.000238 |
| loss | -0.0266 |
| n_updates | 2436 |
| policy_gradient_loss | -0.0171 |
| value_loss | 0.00031 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 611 |
| time_elapsed | 4441 |
| total_timesteps | 5005312 |
| train/ | |
| approx_kl | 0.051901914 |
| clip_fraction | 0.299 |
| clip_range | 0.144 |
| entropy_loss | -5.27 |
| explained_variance | 0.95 |
| learning_rate | 0.000238 |
| loss | -0.0218 |
| n_updates | 2440 |
| policy_gradient_loss | -0.023 |
| value_loss | 0.000555 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.4 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 612 |
| time_elapsed | 4448 |
| total_timesteps | 5013504 |
| train/ | |
| approx_kl | 0.032188684 |
| clip_fraction | 0.262 |
| clip_range | 0.144 |
| entropy_loss | -5.07 |
| explained_variance | 0.973 |
| learning_rate | 0.000238 |
| loss | -0.0202 |
| n_updates | 2444 |
| policy_gradient_loss | -0.0151 |
| value_loss | 0.000219 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.8 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 613 |
| time_elapsed | 4456 |
| total_timesteps | 5021696 |
| train/ | |
| approx_kl | 0.030742245 |
| clip_fraction | 0.28 |
| clip_range | 0.144 |
| entropy_loss | -4.98 |
| explained_variance | 0.936 |
| learning_rate | 0.000238 |
| loss | -0.0166 |
| n_updates | 2448 |
| policy_gradient_loss | -0.0107 |
| value_loss | 0.000463 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.8 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 614 |
| time_elapsed | 4463 |
| total_timesteps | 5029888 |
| train/ | |
| approx_kl | 0.026955975 |
| clip_fraction | 0.235 |
| clip_range | 0.144 |
| entropy_loss | -4.96 |
| explained_variance | 0.979 |
| learning_rate | 0.000238 |
| loss | -0.0163 |
| n_updates | 2452 |
| policy_gradient_loss | -0.00907 |
| value_loss | 0.000129 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 50.1 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 615 |
| time_elapsed | 4470 |
| total_timesteps | 5038080 |
| train/ | |
| approx_kl | 0.0319663 |
| clip_fraction | 0.257 |
| clip_range | 0.144 |
| entropy_loss | -4.99 |
| explained_variance | 0.964 |
| learning_rate | 0.000238 |
| loss | -0.0193 |
| n_updates | 2456 |
| policy_gradient_loss | -0.0116 |
| value_loss | 0.000231 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 616 |
| time_elapsed | 4478 |
| total_timesteps | 5046272 |
| train/ | |
| approx_kl | 0.042172626 |
| clip_fraction | 0.267 |
| clip_range | 0.144 |
| entropy_loss | -5.12 |
| explained_variance | 0.935 |
| learning_rate | 0.000238 |
| loss | -0.0227 |
| n_updates | 2460 |
| policy_gradient_loss | -0.0169 |
| value_loss | 0.000548 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.8 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 617 |
| time_elapsed | 4485 |
| total_timesteps | 5054464 |
| train/ | |
| approx_kl | 0.031552512 |
| clip_fraction | 0.257 |
| clip_range | 0.144 |
| entropy_loss | -5.08 |
| explained_variance | 0.948 |
| learning_rate | 0.000238 |
| loss | -0.013 |
| n_updates | 2464 |
| policy_gradient_loss | -0.0135 |
| value_loss | 0.000374 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 618 |
| time_elapsed | 4492 |
| total_timesteps | 5062656 |
| train/ | |
| approx_kl | 0.039125167 |
| clip_fraction | 0.23 |
| clip_range | 0.144 |
| entropy_loss | -5.12 |
| explained_variance | 0.956 |
| learning_rate | 0.000237 |
| loss | -0.0163 |
| n_updates | 2468 |
| policy_gradient_loss | -0.0162 |
| value_loss | 0.000389 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 619 |
| time_elapsed | 4500 |
| total_timesteps | 5070848 |
| train/ | |
| approx_kl | 0.041809745 |
| clip_fraction | 0.256 |
| clip_range | 0.144 |
| entropy_loss | -5.05 |
| explained_variance | 0.957 |
| learning_rate | 0.000237 |
| loss | -0.0208 |
| n_updates | 2472 |
| policy_gradient_loss | -0.0144 |
| value_loss | 0.000287 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.5 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 620 |
| time_elapsed | 4507 |
| total_timesteps | 5079040 |
| train/ | |
| approx_kl | 0.027817583 |
| clip_fraction | 0.224 |
| clip_range | 0.144 |
| entropy_loss | -4.99 |
| explained_variance | 0.967 |
| learning_rate | 0.000237 |
| loss | -0.00911 |
| n_updates | 2476 |
| policy_gradient_loss | -0.00608 |
| value_loss | 0.000198 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.9 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 621 |
| time_elapsed | 4514 |
| total_timesteps | 5087232 |
| train/ | |
| approx_kl | 0.04878187 |
| clip_fraction | 0.266 |
| clip_range | 0.144 |
| entropy_loss | -5.19 |
| explained_variance | 0.95 |
| learning_rate | 0.000237 |
| loss | -0.0333 |
| n_updates | 2480 |
| policy_gradient_loss | -0.02 |
| value_loss | 0.000452 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 622 |
| time_elapsed | 4521 |
| total_timesteps | 5095424 |
| train/ | |
| approx_kl | 0.046289247 |
| clip_fraction | 0.267 |
| clip_range | 0.144 |
| entropy_loss | -5.13 |
| explained_variance | 0.964 |
| learning_rate | 0.000237 |
| loss | -0.0208 |
| n_updates | 2484 |
| policy_gradient_loss | -0.0147 |
| value_loss | 0.000279 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 623 |
| time_elapsed | 4529 |
| total_timesteps | 5103616 |
| train/ | |
| approx_kl | 0.036489025 |
| clip_fraction | 0.253 |
| clip_range | 0.144 |
| entropy_loss | -5.11 |
| explained_variance | 0.979 |
| learning_rate | 0.000237 |
| loss | -0.0207 |
| n_updates | 2488 |
| policy_gradient_loss | -0.0172 |
| value_loss | 0.000185 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 624 |
| time_elapsed | 4536 |
| total_timesteps | 5111808 |
| train/ | |
| approx_kl | 0.0396738 |
| clip_fraction | 0.273 |
| clip_range | 0.144 |
| entropy_loss | -4.99 |
| explained_variance | 0.983 |
| learning_rate | 0.000237 |
| loss | -0.0138 |
| n_updates | 2492 |
| policy_gradient_loss | -0.0115 |
| value_loss | 0.000132 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.3 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 625 |
| time_elapsed | 4543 |
| total_timesteps | 5120000 |
| train/ | |
| approx_kl | 0.039055005 |
| clip_fraction | 0.291 |
| clip_range | 0.144 |
| entropy_loss | -5.1 |
| explained_variance | 0.961 |
| learning_rate | 0.000237 |
| loss | -0.0195 |
| n_updates | 2496 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000308 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 626 |
| time_elapsed | 4551 |
| total_timesteps | 5128192 |
| train/ | |
| approx_kl | 0.022153018 |
| clip_fraction | 0.232 |
| clip_range | 0.144 |
| entropy_loss | -5.05 |
| explained_variance | 0.961 |
| learning_rate | 0.000237 |
| loss | -0.0146 |
| n_updates | 2500 |
| policy_gradient_loss | -0.00889 |
| value_loss | 0.000243 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 627 |
| time_elapsed | 4558 |
| total_timesteps | 5136384 |
| train/ | |
| approx_kl | 0.040569253 |
| clip_fraction | 0.249 |
| clip_range | 0.144 |
| entropy_loss | -5.12 |
| explained_variance | 0.951 |
| learning_rate | 0.000237 |
| loss | -0.021 |
| n_updates | 2504 |
| policy_gradient_loss | -0.0163 |
| value_loss | 0.000386 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 628 |
| time_elapsed | 4565 |
| total_timesteps | 5144576 |
| train/ | |
| approx_kl | 0.034480445 |
| clip_fraction | 0.2 |
| clip_range | 0.144 |
| entropy_loss | -5.08 |
| explained_variance | 0.963 |
| learning_rate | 0.000237 |
| loss | -0.0242 |
| n_updates | 2508 |
| policy_gradient_loss | -0.0128 |
| value_loss | 0.000233 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.1 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 629 |
| time_elapsed | 4573 |
| total_timesteps | 5152768 |
| train/ | |
| approx_kl | 0.028778546 |
| clip_fraction | 0.237 |
| clip_range | 0.144 |
| entropy_loss | -5.08 |
| explained_variance | 0.97 |
| learning_rate | 0.000237 |
| loss | -0.0204 |
| n_updates | 2512 |
| policy_gradient_loss | -0.0103 |
| value_loss | 0.00022 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.5 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1126 |
| iterations | 630 |
| time_elapsed | 4580 |
| total_timesteps | 5160960 |
| train/ | |
| approx_kl | 0.037687283 |
| clip_fraction | 0.257 |
| clip_range | 0.144 |
| entropy_loss | -5.15 |
| explained_variance | 0.959 |
| learning_rate | 0.000237 |
| loss | -0.0272 |
| n_updates | 2516 |
| policy_gradient_loss | -0.0168 |
| value_loss | 0.000318 |
-----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 48.9 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 631 |
| time_elapsed | 4587 |
| total_timesteps | 5169152 |
| train/ | |
| approx_kl | 0.048883 |
| clip_fraction | 0.304 |
| clip_range | 0.144 |
| entropy_loss | -5.19 |
| explained_variance | 0.948 |
| learning_rate | 0.000237 |
| loss | -0.0232 |
| n_updates | 2520 |
| policy_gradient_loss | -0.0178 |
| value_loss | 0.00049 |
--------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 632 |
| time_elapsed | 4594 |
| total_timesteps | 5177344 |
| train/ | |
| approx_kl | 0.09981434 |
| clip_fraction | 0.235 |
| clip_range | 0.144 |
| entropy_loss | -5.17 |
| explained_variance | 0.957 |
| learning_rate | 0.000237 |
| loss | -0.0219 |
| n_updates | 2524 |
| policy_gradient_loss | -0.014 |
| value_loss | 0.000315 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 633 |
| time_elapsed | 4602 |
| total_timesteps | 5185536 |
| train/ | |
| approx_kl | 0.043999217 |
| clip_fraction | 0.269 |
| clip_range | 0.144 |
| entropy_loss | -5.15 |
| explained_variance | 0.957 |
| learning_rate | 0.000237 |
| loss | -0.0212 |
| n_updates | 2528 |
| policy_gradient_loss | -0.0177 |
| value_loss | 0.000324 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54.9 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1126 |
| iterations | 634 |
| time_elapsed | 4609 |
| total_timesteps | 5193728 |
| train/ | |
| approx_kl | 0.032066435 |
| clip_fraction | 0.252 |
| clip_range | 0.144 |
| entropy_loss | -5.15 |
| explained_variance | 0.963 |
| learning_rate | 0.000237 |
| loss | -0.023 |
| n_updates | 2532 |
| policy_gradient_loss | -0.0158 |
| value_loss | 0.000279 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.6 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 635 |
| time_elapsed | 4616 |
| total_timesteps | 5201920 |
| train/ | |
| approx_kl | 0.053254317 |
| clip_fraction | 0.29 |
| clip_range | 0.144 |
| entropy_loss | -5.36 |
| explained_variance | 0.952 |
| learning_rate | 0.000237 |
| loss | -0.0275 |
| n_updates | 2536 |
| policy_gradient_loss | -0.0207 |
| value_loss | 0.000535 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 636 |
| time_elapsed | 4624 |
| total_timesteps | 5210112 |
| train/ | |
| approx_kl | 0.041626655 |
| clip_fraction | 0.236 |
| clip_range | 0.143 |
| entropy_loss | -5.26 |
| explained_variance | 0.938 |
| learning_rate | 0.000237 |
| loss | -0.0182 |
| n_updates | 2540 |
| policy_gradient_loss | -0.0176 |
| value_loss | 0.000477 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 637 |
| time_elapsed | 4631 |
| total_timesteps | 5218304 |
| train/ | |
| approx_kl | 0.046436526 |
| clip_fraction | 0.292 |
| clip_range | 0.143 |
| entropy_loss | -5.29 |
| explained_variance | 0.94 |
| learning_rate | 0.000237 |
| loss | -0.0264 |
| n_updates | 2544 |
| policy_gradient_loss | -0.0203 |
| value_loss | 0.000573 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 638 |
| time_elapsed | 4639 |
| total_timesteps | 5226496 |
| train/ | |
| approx_kl | 0.04340884 |
| clip_fraction | 0.258 |
| clip_range | 0.143 |
| entropy_loss | -5.23 |
| explained_variance | 0.954 |
| learning_rate | 0.000237 |
| loss | -0.024 |
| n_updates | 2548 |
| policy_gradient_loss | -0.0176 |
| value_loss | 0.000389 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.1 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 639 |
| time_elapsed | 4646 |
| total_timesteps | 5234688 |
| train/ | |
| approx_kl | 0.06817353 |
| clip_fraction | 0.261 |
| clip_range | 0.143 |
| entropy_loss | -5.22 |
| explained_variance | 0.971 |
| learning_rate | 0.000237 |
| loss | -0.0248 |
| n_updates | 2552 |
| policy_gradient_loss | -0.016 |
| value_loss | 0.000242 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 640 |
| time_elapsed | 4653 |
| total_timesteps | 5242880 |
| train/ | |
| approx_kl | 0.04421519 |
| clip_fraction | 0.268 |
| clip_range | 0.143 |
| entropy_loss | -5.2 |
| explained_variance | 0.947 |
| learning_rate | 0.000237 |
| loss | -0.0175 |
| n_updates | 2556 |
| policy_gradient_loss | -0.0172 |
| value_loss | 0.000411 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 641 |
| time_elapsed | 4660 |
| total_timesteps | 5251072 |
| train/ | |
| approx_kl | 0.04762256 |
| clip_fraction | 0.26 |
| clip_range | 0.143 |
| entropy_loss | -5.1 |
| explained_variance | 0.972 |
| learning_rate | 0.000237 |
| loss | -0.0187 |
| n_updates | 2560 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000225 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.4 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 642 |
| time_elapsed | 4668 |
| total_timesteps | 5259264 |
| train/ | |
| approx_kl | 0.049721286 |
| clip_fraction | 0.264 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.906 |
| learning_rate | 0.000237 |
| loss | -0.0249 |
| n_updates | 2564 |
| policy_gradient_loss | -0.0144 |
| value_loss | 0.000677 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.5 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1126 |
| iterations | 643 |
| time_elapsed | 4675 |
| total_timesteps | 5267456 |
| train/ | |
| approx_kl | 0.034132294 |
| clip_fraction | 0.276 |
| clip_range | 0.143 |
| entropy_loss | -5.09 |
| explained_variance | 0.957 |
| learning_rate | 0.000237 |
| loss | -0.0148 |
| n_updates | 2568 |
| policy_gradient_loss | -0.0144 |
| value_loss | 0.000363 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 644 |
| time_elapsed | 4682 |
| total_timesteps | 5275648 |
| train/ | |
| approx_kl | 0.053728428 |
| clip_fraction | 0.287 |
| clip_range | 0.143 |
| entropy_loss | -5.09 |
| explained_variance | 0.964 |
| learning_rate | 0.000237 |
| loss | -0.0148 |
| n_updates | 2572 |
| policy_gradient_loss | -0.0174 |
| value_loss | 0.000358 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.5 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 645 |
| time_elapsed | 4690 |
| total_timesteps | 5283840 |
| train/ | |
| approx_kl | 0.058327414 |
| clip_fraction | 0.288 |
| clip_range | 0.143 |
| entropy_loss | -5.08 |
| explained_variance | 0.966 |
| learning_rate | 0.000237 |
| loss | -0.0228 |
| n_updates | 2576 |
| policy_gradient_loss | -0.0194 |
| value_loss | 0.000318 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 646 |
| time_elapsed | 4697 |
| total_timesteps | 5292032 |
| train/ | |
| approx_kl | 0.03609147 |
| clip_fraction | 0.263 |
| clip_range | 0.143 |
| entropy_loss | -4.93 |
| explained_variance | 0.955 |
| learning_rate | 0.000237 |
| loss | -0.0156 |
| n_updates | 2580 |
| policy_gradient_loss | -0.0118 |
| value_loss | 0.000303 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 647 |
| time_elapsed | 4704 |
| total_timesteps | 5300224 |
| train/ | |
| approx_kl | 0.03956795 |
| clip_fraction | 0.27 |
| clip_range | 0.143 |
| entropy_loss | -4.95 |
| explained_variance | 0.96 |
| learning_rate | 0.000237 |
| loss | -0.0267 |
| n_updates | 2584 |
| policy_gradient_loss | -0.0125 |
| value_loss | 0.00032 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 648 |
| time_elapsed | 4711 |
| total_timesteps | 5308416 |
| train/ | |
| approx_kl | 0.040171698 |
| clip_fraction | 0.23 |
| clip_range | 0.143 |
| entropy_loss | -4.94 |
| explained_variance | 0.972 |
| learning_rate | 0.000237 |
| loss | -0.0236 |
| n_updates | 2588 |
| policy_gradient_loss | -0.0122 |
| value_loss | 0.000181 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 649 |
| time_elapsed | 4719 |
| total_timesteps | 5316608 |
| train/ | |
| approx_kl | 0.042866707 |
| clip_fraction | 0.291 |
| clip_range | 0.143 |
| entropy_loss | -4.99 |
| explained_variance | 0.956 |
| learning_rate | 0.000237 |
| loss | -0.0196 |
| n_updates | 2592 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000375 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.5 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 650 |
| time_elapsed | 4726 |
| total_timesteps | 5324800 |
| train/ | |
| approx_kl | 0.04987514 |
| clip_fraction | 0.256 |
| clip_range | 0.143 |
| entropy_loss | -5.01 |
| explained_variance | 0.972 |
| learning_rate | 0.000237 |
| loss | -0.0247 |
| n_updates | 2596 |
| policy_gradient_loss | -0.0173 |
| value_loss | 0.000194 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 651 |
| time_elapsed | 4733 |
| total_timesteps | 5332992 |
| train/ | |
| approx_kl | 0.033198718 |
| clip_fraction | 0.278 |
| clip_range | 0.143 |
| entropy_loss | -4.98 |
| explained_variance | 0.956 |
| learning_rate | 0.000237 |
| loss | -0.017 |
| n_updates | 2600 |
| policy_gradient_loss | -0.013 |
| value_loss | 0.000307 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.1 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1126 |
| iterations | 652 |
| time_elapsed | 4740 |
| total_timesteps | 5341184 |
| train/ | |
| approx_kl | 0.04095178 |
| clip_fraction | 0.225 |
| clip_range | 0.143 |
| entropy_loss | -4.97 |
| explained_variance | 0.955 |
| learning_rate | 0.000237 |
| loss | -0.0154 |
| n_updates | 2604 |
| policy_gradient_loss | -0.0112 |
| value_loss | 0.000273 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.4 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1126 |
| iterations | 653 |
| time_elapsed | 4747 |
| total_timesteps | 5349376 |
| train/ | |
| approx_kl | 0.049831104 |
| clip_fraction | 0.274 |
| clip_range | 0.143 |
| entropy_loss | -5.1 |
| explained_variance | 0.968 |
| learning_rate | 0.000237 |
| loss | -0.0211 |
| n_updates | 2608 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.000303 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.7 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 654 |
| time_elapsed | 4754 |
| total_timesteps | 5357568 |
| train/ | |
| approx_kl | 0.058760896 |
| clip_fraction | 0.318 |
| clip_range | 0.143 |
| entropy_loss | -5.09 |
| explained_variance | 0.954 |
| learning_rate | 0.000237 |
| loss | -0.0282 |
| n_updates | 2612 |
| policy_gradient_loss | -0.0198 |
| value_loss | 0.000543 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.4 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 655 |
| time_elapsed | 4762 |
| total_timesteps | 5365760 |
| train/ | |
| approx_kl | 0.033480577 |
| clip_fraction | 0.278 |
| clip_range | 0.143 |
| entropy_loss | -5.06 |
| explained_variance | 0.972 |
| learning_rate | 0.000237 |
| loss | -0.0184 |
| n_updates | 2616 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000226 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 656 |
| time_elapsed | 4769 |
| total_timesteps | 5373952 |
| train/ | |
| approx_kl | 0.042696614 |
| clip_fraction | 0.27 |
| clip_range | 0.143 |
| entropy_loss | -5.11 |
| explained_variance | 0.976 |
| learning_rate | 0.000237 |
| loss | -0.0274 |
| n_updates | 2620 |
| policy_gradient_loss | -0.0191 |
| value_loss | 0.000216 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 657 |
| time_elapsed | 4776 |
| total_timesteps | 5382144 |
| train/ | |
| approx_kl | 0.04923485 |
| clip_fraction | 0.247 |
| clip_range | 0.143 |
| entropy_loss | -5.13 |
| explained_variance | 0.986 |
| learning_rate | 0.000237 |
| loss | -0.0273 |
| n_updates | 2624 |
| policy_gradient_loss | -0.018 |
| value_loss | 0.000125 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 658 |
| time_elapsed | 4784 |
| total_timesteps | 5390336 |
| train/ | |
| approx_kl | 0.04555118 |
| clip_fraction | 0.277 |
| clip_range | 0.143 |
| entropy_loss | -5.04 |
| explained_variance | 0.962 |
| learning_rate | 0.000237 |
| loss | -0.0154 |
| n_updates | 2628 |
| policy_gradient_loss | -0.0129 |
| value_loss | 0.000273 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 659 |
| time_elapsed | 4791 |
| total_timesteps | 5398528 |
| train/ | |
| approx_kl | 0.08245316 |
| clip_fraction | 0.284 |
| clip_range | 0.143 |
| entropy_loss | -5.13 |
| explained_variance | 0.968 |
| learning_rate | 0.000237 |
| loss | -0.0313 |
| n_updates | 2632 |
| policy_gradient_loss | -0.0211 |
| value_loss | 0.000336 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.1 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 660 |
| time_elapsed | 4798 |
| total_timesteps | 5406720 |
| train/ | |
| approx_kl | 0.025834586 |
| clip_fraction | 0.198 |
| clip_range | 0.143 |
| entropy_loss | -5.04 |
| explained_variance | 0.993 |
| learning_rate | 0.000237 |
| loss | -0.0229 |
| n_updates | 2636 |
| policy_gradient_loss | -0.00875 |
| value_loss | 5.84e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 661 |
| time_elapsed | 4806 |
| total_timesteps | 5414912 |
| train/ | |
| approx_kl | 0.049504377 |
| clip_fraction | 0.294 |
| clip_range | 0.143 |
| entropy_loss | -5.12 |
| explained_variance | 0.975 |
| learning_rate | 0.000237 |
| loss | -0.0285 |
| n_updates | 2640 |
| policy_gradient_loss | -0.0167 |
| value_loss | 0.000229 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 662 |
| time_elapsed | 4813 |
| total_timesteps | 5423104 |
| train/ | |
| approx_kl | 0.039111726 |
| clip_fraction | 0.223 |
| clip_range | 0.143 |
| entropy_loss | -5.02 |
| explained_variance | 0.979 |
| learning_rate | 0.000237 |
| loss | -0.0237 |
| n_updates | 2644 |
| policy_gradient_loss | -0.00971 |
| value_loss | 0.000125 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 49 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 663 |
| time_elapsed | 4820 |
| total_timesteps | 5431296 |
| train/ | |
| approx_kl | 0.0505772 |
| clip_fraction | 0.313 |
| clip_range | 0.143 |
| entropy_loss | -5.13 |
| explained_variance | 0.972 |
| learning_rate | 0.000237 |
| loss | -0.032 |
| n_updates | 2648 |
| policy_gradient_loss | -0.019 |
| value_loss | 0.000287 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.1 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 664 |
| time_elapsed | 4828 |
| total_timesteps | 5439488 |
| train/ | |
| approx_kl | 0.04492996 |
| clip_fraction | 0.265 |
| clip_range | 0.143 |
| entropy_loss | -5.04 |
| explained_variance | 0.963 |
| learning_rate | 0.000237 |
| loss | -0.0204 |
| n_updates | 2652 |
| policy_gradient_loss | -0.0139 |
| value_loss | 0.000284 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 665 |
| time_elapsed | 4835 |
| total_timesteps | 5447680 |
| train/ | |
| approx_kl | 0.06896451 |
| clip_fraction | 0.288 |
| clip_range | 0.143 |
| entropy_loss | -5.11 |
| explained_variance | 0.973 |
| learning_rate | 0.000237 |
| loss | -0.0346 |
| n_updates | 2656 |
| policy_gradient_loss | -0.0194 |
| value_loss | 0.000288 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.6 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 666 |
| time_elapsed | 4842 |
| total_timesteps | 5455872 |
| train/ | |
| approx_kl | 0.03433504 |
| clip_fraction | 0.261 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.971 |
| learning_rate | 0.000237 |
| loss | -0.022 |
| n_updates | 2660 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000239 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.8 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 667 |
| time_elapsed | 4850 |
| total_timesteps | 5464064 |
| train/ | |
| approx_kl | 0.04043471 |
| clip_fraction | 0.26 |
| clip_range | 0.143 |
| entropy_loss | -5 |
| explained_variance | 0.947 |
| learning_rate | 0.000236 |
| loss | -0.0167 |
| n_updates | 2664 |
| policy_gradient_loss | -0.0108 |
| value_loss | 0.000285 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 668 |
| time_elapsed | 4857 |
| total_timesteps | 5472256 |
| train/ | |
| approx_kl | 0.02984986 |
| clip_fraction | 0.242 |
| clip_range | 0.143 |
| entropy_loss | -4.99 |
| explained_variance | 0.952 |
| learning_rate | 0.000236 |
| loss | -0.00662 |
| n_updates | 2668 |
| policy_gradient_loss | -0.00949 |
| value_loss | 0.000294 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.3 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 669 |
| time_elapsed | 4864 |
| total_timesteps | 5480448 |
| train/ | |
| approx_kl | 0.030380346 |
| clip_fraction | 0.263 |
| clip_range | 0.143 |
| entropy_loss | -5.04 |
| explained_variance | 0.943 |
| learning_rate | 0.000236 |
| loss | -0.0198 |
| n_updates | 2672 |
| policy_gradient_loss | -0.0138 |
| value_loss | 0.000402 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.7 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 670 |
| time_elapsed | 4872 |
| total_timesteps | 5488640 |
| train/ | |
| approx_kl | 0.06422448 |
| clip_fraction | 0.241 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.975 |
| learning_rate | 0.000236 |
| loss | -0.026 |
| n_updates | 2676 |
| policy_gradient_loss | -0.02 |
| value_loss | 0.000204 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 671 |
| time_elapsed | 4879 |
| total_timesteps | 5496832 |
| train/ | |
| approx_kl | 0.023435526 |
| clip_fraction | 0.23 |
| clip_range | 0.143 |
| entropy_loss | -4.92 |
| explained_variance | 0.989 |
| learning_rate | 0.000236 |
| loss | -0.00982 |
| n_updates | 2680 |
| policy_gradient_loss | -0.00685 |
| value_loss | 9.02e-05 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.6 |
| ep_rew_mean | 0.855 |
| time/ | |
| fps | 1126 |
| iterations | 672 |
| time_elapsed | 4886 |
| total_timesteps | 5505024 |
| train/ | |
| approx_kl | 0.05860194 |
| clip_fraction | 0.26 |
| clip_range | 0.143 |
| entropy_loss | -4.94 |
| explained_variance | 0.97 |
| learning_rate | 0.000236 |
| loss | -0.019 |
| n_updates | 2684 |
| policy_gradient_loss | -0.0127 |
| value_loss | 0.00021 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 673 |
| time_elapsed | 4894 |
| total_timesteps | 5513216 |
| train/ | |
| approx_kl | 0.03285363 |
| clip_fraction | 0.238 |
| clip_range | 0.143 |
| entropy_loss | -4.92 |
| explained_variance | 0.96 |
| learning_rate | 0.000236 |
| loss | -0.0125 |
| n_updates | 2688 |
| policy_gradient_loss | -0.0103 |
| value_loss | 0.000276 |
----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 674 |
| time_elapsed | 4901 |
| total_timesteps | 5521408 |
| train/ | |
| approx_kl | 0.0384774 |
| clip_fraction | 0.207 |
| clip_range | 0.143 |
| entropy_loss | -4.95 |
| explained_variance | 0.974 |
| learning_rate | 0.000236 |
| loss | -0.0173 |
| n_updates | 2692 |
| policy_gradient_loss | -0.00955 |
| value_loss | 0.000156 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 675 |
| time_elapsed | 4909 |
| total_timesteps | 5529600 |
| train/ | |
| approx_kl | 0.044978946 |
| clip_fraction | 0.281 |
| clip_range | 0.143 |
| entropy_loss | -5.17 |
| explained_variance | 0.956 |
| learning_rate | 0.000236 |
| loss | -0.0329 |
| n_updates | 2696 |
| policy_gradient_loss | -0.0214 |
| value_loss | 0.000395 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 676 |
| time_elapsed | 4916 |
| total_timesteps | 5537792 |
| train/ | |
| approx_kl | 0.044992045 |
| clip_fraction | 0.246 |
| clip_range | 0.143 |
| entropy_loss | -5.1 |
| explained_variance | 0.976 |
| learning_rate | 0.000236 |
| loss | -0.0221 |
| n_updates | 2700 |
| policy_gradient_loss | -0.0171 |
| value_loss | 0.000188 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 677 |
| time_elapsed | 4923 |
| total_timesteps | 5545984 |
| train/ | |
| approx_kl | 0.045260586 |
| clip_fraction | 0.185 |
| clip_range | 0.143 |
| entropy_loss | -5.06 |
| explained_variance | 0.99 |
| learning_rate | 0.000236 |
| loss | -0.022 |
| n_updates | 2704 |
| policy_gradient_loss | -0.0144 |
| value_loss | 7.56e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 678 |
| time_elapsed | 4930 |
| total_timesteps | 5554176 |
| train/ | |
| approx_kl | 0.031672657 |
| clip_fraction | 0.282 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.957 |
| learning_rate | 0.000236 |
| loss | -0.0145 |
| n_updates | 2708 |
| policy_gradient_loss | -0.0149 |
| value_loss | 0.000319 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 679 |
| time_elapsed | 4937 |
| total_timesteps | 5562368 |
| train/ | |
| approx_kl | 0.012920519 |
| clip_fraction | 0.238 |
| clip_range | 0.143 |
| entropy_loss | -4.96 |
| explained_variance | 0.971 |
| learning_rate | 0.000236 |
| loss | -0.0019 |
| n_updates | 2712 |
| policy_gradient_loss | -0.00681 |
| value_loss | 0.000175 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 680 |
| time_elapsed | 4945 |
| total_timesteps | 5570560 |
| train/ | |
| approx_kl | 0.05727388 |
| clip_fraction | 0.227 |
| clip_range | 0.143 |
| entropy_loss | -5.09 |
| explained_variance | 0.948 |
| learning_rate | 0.000236 |
| loss | -0.0196 |
| n_updates | 2716 |
| policy_gradient_loss | -0.0149 |
| value_loss | 0.000329 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 681 |
| time_elapsed | 4952 |
| total_timesteps | 5578752 |
| train/ | |
| approx_kl | 0.05344817 |
| clip_fraction | 0.212 |
| clip_range | 0.143 |
| entropy_loss | -5.16 |
| explained_variance | 0.976 |
| learning_rate | 0.000236 |
| loss | -0.0232 |
| n_updates | 2720 |
| policy_gradient_loss | -0.0165 |
| value_loss | 0.000174 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.8 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 682 |
| time_elapsed | 4959 |
| total_timesteps | 5586944 |
| train/ | |
| approx_kl | 0.046642303 |
| clip_fraction | 0.281 |
| clip_range | 0.143 |
| entropy_loss | -5.14 |
| explained_variance | 0.959 |
| learning_rate | 0.000236 |
| loss | -0.0293 |
| n_updates | 2724 |
| policy_gradient_loss | -0.0211 |
| value_loss | 0.000376 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.8 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 683 |
| time_elapsed | 4967 |
| total_timesteps | 5595136 |
| train/ | |
| approx_kl | 0.059482977 |
| clip_fraction | 0.23 |
| clip_range | 0.143 |
| entropy_loss | -5.13 |
| explained_variance | 0.956 |
| learning_rate | 0.000236 |
| loss | -0.0291 |
| n_updates | 2728 |
| policy_gradient_loss | -0.0186 |
| value_loss | 0.000353 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.4 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 684 |
| time_elapsed | 4974 |
| total_timesteps | 5603328 |
| train/ | |
| approx_kl | 0.028259914 |
| clip_fraction | 0.203 |
| clip_range | 0.143 |
| entropy_loss | -4.98 |
| explained_variance | 0.978 |
| learning_rate | 0.000236 |
| loss | -0.0137 |
| n_updates | 2732 |
| policy_gradient_loss | -0.00825 |
| value_loss | 0.000117 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 685 |
| time_elapsed | 4981 |
| total_timesteps | 5611520 |
| train/ | |
| approx_kl | 0.02907198 |
| clip_fraction | 0.225 |
| clip_range | 0.143 |
| entropy_loss | -4.99 |
| explained_variance | 0.963 |
| learning_rate | 0.000236 |
| loss | -0.00849 |
| n_updates | 2736 |
| policy_gradient_loss | -0.00956 |
| value_loss | 0.000239 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 686 |
| time_elapsed | 4988 |
| total_timesteps | 5619712 |
| train/ | |
| approx_kl | 0.037196048 |
| clip_fraction | 0.249 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.967 |
| learning_rate | 0.000236 |
| loss | -0.0243 |
| n_updates | 2740 |
| policy_gradient_loss | -0.0162 |
| value_loss | 0.000207 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 687 |
| time_elapsed | 4995 |
| total_timesteps | 5627904 |
| train/ | |
| approx_kl | 0.0347832 |
| clip_fraction | 0.201 |
| clip_range | 0.143 |
| entropy_loss | -5.06 |
| explained_variance | 0.98 |
| learning_rate | 0.000236 |
| loss | -0.0238 |
| n_updates | 2744 |
| policy_gradient_loss | -0.0165 |
| value_loss | 0.000133 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 688 |
| time_elapsed | 5003 |
| total_timesteps | 5636096 |
| train/ | |
| approx_kl | 0.04163856 |
| clip_fraction | 0.298 |
| clip_range | 0.143 |
| entropy_loss | -5.11 |
| explained_variance | 0.968 |
| learning_rate | 0.000236 |
| loss | -0.0223 |
| n_updates | 2748 |
| policy_gradient_loss | -0.019 |
| value_loss | 0.000276 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 689 |
| time_elapsed | 5010 |
| total_timesteps | 5644288 |
| train/ | |
| approx_kl | 0.049773544 |
| clip_fraction | 0.29 |
| clip_range | 0.143 |
| entropy_loss | -5.07 |
| explained_variance | 0.954 |
| learning_rate | 0.000236 |
| loss | -0.0248 |
| n_updates | 2752 |
| policy_gradient_loss | -0.0177 |
| value_loss | 0.000401 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 690 |
| time_elapsed | 5017 |
| total_timesteps | 5652480 |
| train/ | |
| approx_kl | 0.009857772 |
| clip_fraction | 0.198 |
| clip_range | 0.143 |
| entropy_loss | -4.98 |
| explained_variance | 0.993 |
| learning_rate | 0.000236 |
| loss | 0.0276 |
| n_updates | 2756 |
| policy_gradient_loss | -0.00352 |
| value_loss | 4.78e-05 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.7 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 691 |
| time_elapsed | 5025 |
| total_timesteps | 5660672 |
| train/ | |
| approx_kl | 0.04864275 |
| clip_fraction | 0.292 |
| clip_range | 0.143 |
| entropy_loss | -5.13 |
| explained_variance | 0.933 |
| learning_rate | 0.000236 |
| loss | -0.0312 |
| n_updates | 2760 |
| policy_gradient_loss | -0.0178 |
| value_loss | 0.000673 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1126 |
| iterations | 692 |
| time_elapsed | 5032 |
| total_timesteps | 5668864 |
| train/ | |
| approx_kl | 0.07535358 |
| clip_fraction | 0.264 |
| clip_range | 0.143 |
| entropy_loss | -5.12 |
| explained_variance | 0.976 |
| learning_rate | 0.000236 |
| loss | -0.0306 |
| n_updates | 2764 |
| policy_gradient_loss | -0.0206 |
| value_loss | 0.000229 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 693 |
| time_elapsed | 5039 |
| total_timesteps | 5677056 |
| train/ | |
| approx_kl | 0.05225493 |
| clip_fraction | 0.24 |
| clip_range | 0.143 |
| entropy_loss | -5.08 |
| explained_variance | 0.979 |
| learning_rate | 0.000236 |
| loss | -0.0153 |
| n_updates | 2768 |
| policy_gradient_loss | -0.0174 |
| value_loss | 0.000176 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 694 |
| time_elapsed | 5047 |
| total_timesteps | 5685248 |
| train/ | |
| approx_kl | 0.053044632 |
| clip_fraction | 0.324 |
| clip_range | 0.143 |
| entropy_loss | -5.18 |
| explained_variance | 0.941 |
| learning_rate | 0.000236 |
| loss | -0.0172 |
| n_updates | 2772 |
| policy_gradient_loss | -0.0167 |
| value_loss | 0.000566 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 695 |
| time_elapsed | 5054 |
| total_timesteps | 5693440 |
| train/ | |
| approx_kl | 0.058550157 |
| clip_fraction | 0.2 |
| clip_range | 0.143 |
| entropy_loss | -5.14 |
| explained_variance | 0.958 |
| learning_rate | 0.000236 |
| loss | -0.0242 |
| n_updates | 2776 |
| policy_gradient_loss | -0.0178 |
| value_loss | 0.000308 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 696 |
| time_elapsed | 5061 |
| total_timesteps | 5701632 |
| train/ | |
| approx_kl | 0.037914105 |
| clip_fraction | 0.286 |
| clip_range | 0.143 |
| entropy_loss | -5.08 |
| explained_variance | 0.96 |
| learning_rate | 0.000236 |
| loss | -0.0237 |
| n_updates | 2780 |
| policy_gradient_loss | -0.0151 |
| value_loss | 0.00031 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 697 |
| time_elapsed | 5068 |
| total_timesteps | 5709824 |
| train/ | |
| approx_kl | 0.038181815 |
| clip_fraction | 0.242 |
| clip_range | 0.143 |
| entropy_loss | -5.15 |
| explained_variance | 0.968 |
| learning_rate | 0.000236 |
| loss | -0.0127 |
| n_updates | 2784 |
| policy_gradient_loss | -0.0121 |
| value_loss | 0.000229 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.1 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 698 |
| time_elapsed | 5076 |
| total_timesteps | 5718016 |
| train/ | |
| approx_kl | 0.029108724 |
| clip_fraction | 0.234 |
| clip_range | 0.143 |
| entropy_loss | -5.17 |
| explained_variance | 0.946 |
| learning_rate | 0.000236 |
| loss | -0.0208 |
| n_updates | 2788 |
| policy_gradient_loss | -0.0128 |
| value_loss | 0.000365 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 699 |
| time_elapsed | 5083 |
| total_timesteps | 5726208 |
| train/ | |
| approx_kl | 0.03881312 |
| clip_fraction | 0.244 |
| clip_range | 0.143 |
| entropy_loss | -5.18 |
| explained_variance | 0.96 |
| learning_rate | 0.000236 |
| loss | -0.0219 |
| n_updates | 2792 |
| policy_gradient_loss | -0.0145 |
| value_loss | 0.000289 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.7 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1126 |
| iterations | 700 |
| time_elapsed | 5090 |
| total_timesteps | 5734400 |
| train/ | |
| approx_kl | 0.042412892 |
| clip_fraction | 0.247 |
| clip_range | 0.143 |
| entropy_loss | -5.14 |
| explained_variance | 0.944 |
| learning_rate | 0.000236 |
| loss | -0.0214 |
| n_updates | 2796 |
| policy_gradient_loss | -0.0174 |
| value_loss | 0.000451 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.7 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1126 |
| iterations | 701 |
| time_elapsed | 5098 |
| total_timesteps | 5742592 |
| train/ | |
| approx_kl | 0.058085926 |
| clip_fraction | 0.275 |
| clip_range | 0.143 |
| entropy_loss | -5.28 |
| explained_variance | 0.966 |
| learning_rate | 0.000236 |
| loss | -0.0397 |
| n_updates | 2800 |
| policy_gradient_loss | -0.0237 |
| value_loss | 0.000401 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 702 |
| time_elapsed | 5105 |
| total_timesteps | 5750784 |
| train/ | |
| approx_kl | 0.051446877 |
| clip_fraction | 0.214 |
| clip_range | 0.143 |
| entropy_loss | -5.13 |
| explained_variance | 0.971 |
| learning_rate | 0.000236 |
| loss | -0.0168 |
| n_updates | 2804 |
| policy_gradient_loss | -0.0151 |
| value_loss | 0.000245 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.2 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1126 |
| iterations | 703 |
| time_elapsed | 5113 |
| total_timesteps | 5758976 |
| train/ | |
| approx_kl | 0.031115629 |
| clip_fraction | 0.25 |
| clip_range | 0.143 |
| entropy_loss | -5.01 |
| explained_variance | 0.963 |
| learning_rate | 0.000236 |
| loss | -0.0171 |
| n_updates | 2808 |
| policy_gradient_loss | -0.0101 |
| value_loss | 0.000241 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.4 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 704 |
| time_elapsed | 5120 |
| total_timesteps | 5767168 |
| train/ | |
| approx_kl | 0.040584862 |
| clip_fraction | 0.262 |
| clip_range | 0.143 |
| entropy_loss | -5.08 |
| explained_variance | 0.964 |
| learning_rate | 0.000236 |
| loss | -0.0237 |
| n_updates | 2812 |
| policy_gradient_loss | -0.0174 |
| value_loss | 0.000297 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 705 |
| time_elapsed | 5127 |
| total_timesteps | 5775360 |
| train/ | |
| approx_kl | 0.050506927 |
| clip_fraction | 0.204 |
| clip_range | 0.143 |
| entropy_loss | -4.94 |
| explained_variance | 0.969 |
| learning_rate | 0.000236 |
| loss | -0.0125 |
| n_updates | 2816 |
| policy_gradient_loss | -0.00795 |
| value_loss | 0.000153 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.8 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 706 |
| time_elapsed | 5134 |
| total_timesteps | 5783552 |
| train/ | |
| approx_kl | 0.00870459 |
| clip_fraction | 0.185 |
| clip_range | 0.143 |
| entropy_loss | -4.92 |
| explained_variance | 0.995 |
| learning_rate | 0.000236 |
| loss | -0.00354 |
| n_updates | 2820 |
| policy_gradient_loss | -0.0031 |
| value_loss | 4.43e-05 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 707 |
| time_elapsed | 5141 |
| total_timesteps | 5791744 |
| train/ | |
| approx_kl | 0.026312161 |
| clip_fraction | 0.228 |
| clip_range | 0.143 |
| entropy_loss | -5.02 |
| explained_variance | 0.963 |
| learning_rate | 0.000236 |
| loss | -0.0247 |
| n_updates | 2824 |
| policy_gradient_loss | -0.0135 |
| value_loss | 0.000224 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 708 |
| time_elapsed | 5149 |
| total_timesteps | 5799936 |
| train/ | |
| approx_kl | 0.04797593 |
| clip_fraction | 0.236 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.982 |
| learning_rate | 0.000236 |
| loss | -0.0242 |
| n_updates | 2828 |
| policy_gradient_loss | -0.0194 |
| value_loss | 0.000167 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 709 |
| time_elapsed | 5156 |
| total_timesteps | 5808128 |
| train/ | |
| approx_kl | 0.013861181 |
| clip_fraction | 0.181 |
| clip_range | 0.143 |
| entropy_loss | -4.94 |
| explained_variance | 0.995 |
| learning_rate | 0.000236 |
| loss | 0.00966 |
| n_updates | 2832 |
| policy_gradient_loss | -0.00596 |
| value_loss | 3.17e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 710 |
| time_elapsed | 5163 |
| total_timesteps | 5816320 |
| train/ | |
| approx_kl | 0.011446411 |
| clip_fraction | 0.218 |
| clip_range | 0.143 |
| entropy_loss | -4.85 |
| explained_variance | 0.983 |
| learning_rate | 0.000236 |
| loss | -0.00876 |
| n_updates | 2836 |
| policy_gradient_loss | -0.00628 |
| value_loss | 9.09e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 711 |
| time_elapsed | 5170 |
| total_timesteps | 5824512 |
| train/ | |
| approx_kl | 0.027760707 |
| clip_fraction | 0.225 |
| clip_range | 0.143 |
| entropy_loss | -4.96 |
| explained_variance | 0.95 |
| learning_rate | 0.000236 |
| loss | -0.026 |
| n_updates | 2840 |
| policy_gradient_loss | -0.0112 |
| value_loss | 0.000339 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 712 |
| time_elapsed | 5178 |
| total_timesteps | 5832704 |
| train/ | |
| approx_kl | 0.020429067 |
| clip_fraction | 0.212 |
| clip_range | 0.143 |
| entropy_loss | -4.97 |
| explained_variance | 0.983 |
| learning_rate | 0.000236 |
| loss | -0.0122 |
| n_updates | 2844 |
| policy_gradient_loss | -0.00952 |
| value_loss | 0.000113 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 713 |
| time_elapsed | 5185 |
| total_timesteps | 5840896 |
| train/ | |
| approx_kl | 0.035782814 |
| clip_fraction | 0.211 |
| clip_range | 0.143 |
| entropy_loss | -5.05 |
| explained_variance | 0.954 |
| learning_rate | 0.000236 |
| loss | -0.0159 |
| n_updates | 2848 |
| policy_gradient_loss | -0.0101 |
| value_loss | 0.000299 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1126 |
| iterations | 714 |
| time_elapsed | 5192 |
| total_timesteps | 5849088 |
| train/ | |
| approx_kl | 0.03729223 |
| clip_fraction | 0.239 |
| clip_range | 0.143 |
| entropy_loss | -5 |
| explained_variance | 0.957 |
| learning_rate | 0.000236 |
| loss | -0.0241 |
| n_updates | 2852 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000314 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 715 |
| time_elapsed | 5199 |
| total_timesteps | 5857280 |
| train/ | |
| approx_kl | 0.031190388 |
| clip_fraction | 0.27 |
| clip_range | 0.143 |
| entropy_loss | -5.02 |
| explained_variance | 0.976 |
| learning_rate | 0.000236 |
| loss | -0.0201 |
| n_updates | 2856 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000189 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 716 |
| time_elapsed | 5207 |
| total_timesteps | 5865472 |
| train/ | |
| approx_kl | 0.029389545 |
| clip_fraction | 0.16 |
| clip_range | 0.143 |
| entropy_loss | -5.02 |
| explained_variance | 0.992 |
| learning_rate | 0.000236 |
| loss | -0.0157 |
| n_updates | 2860 |
| policy_gradient_loss | -0.0132 |
| value_loss | 5.72e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.5 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 717 |
| time_elapsed | 5214 |
| total_timesteps | 5873664 |
| train/ | |
| approx_kl | 0.022747431 |
| clip_fraction | 0.189 |
| clip_range | 0.143 |
| entropy_loss | -4.99 |
| explained_variance | 0.992 |
| learning_rate | 0.000235 |
| loss | -0.0134 |
| n_updates | 2864 |
| policy_gradient_loss | -0.00887 |
| value_loss | 7.38e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1126 |
| iterations | 718 |
| time_elapsed | 5221 |
| total_timesteps | 5881856 |
| train/ | |
| approx_kl | 0.039368197 |
| clip_fraction | 0.238 |
| clip_range | 0.143 |
| entropy_loss | -5.12 |
| explained_variance | 0.971 |
| learning_rate | 0.000235 |
| loss | -0.0225 |
| n_updates | 2868 |
| policy_gradient_loss | -0.0167 |
| value_loss | 0.000243 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 719 |
| time_elapsed | 5229 |
| total_timesteps | 5890048 |
| train/ | |
| approx_kl | 0.03455733 |
| clip_fraction | 0.248 |
| clip_range | 0.143 |
| entropy_loss | -5.12 |
| explained_variance | 0.961 |
| learning_rate | 0.000235 |
| loss | -0.0267 |
| n_updates | 2872 |
| policy_gradient_loss | -0.0173 |
| value_loss | 0.000348 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 720 |
| time_elapsed | 5236 |
| total_timesteps | 5898240 |
| train/ | |
| approx_kl | 0.029886011 |
| clip_fraction | 0.203 |
| clip_range | 0.143 |
| entropy_loss | -5.02 |
| explained_variance | 0.964 |
| learning_rate | 0.000235 |
| loss | -0.0156 |
| n_updates | 2876 |
| policy_gradient_loss | -0.00798 |
| value_loss | 0.000236 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 721 |
| time_elapsed | 5243 |
| total_timesteps | 5906432 |
| train/ | |
| approx_kl | 0.045287192 |
| clip_fraction | 0.196 |
| clip_range | 0.143 |
| entropy_loss | -5.09 |
| explained_variance | 0.983 |
| learning_rate | 0.000235 |
| loss | -0.0162 |
| n_updates | 2880 |
| policy_gradient_loss | -0.0147 |
| value_loss | 0.000125 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.3 |
| ep_rew_mean | 0.831 |
| time/ | |
| fps | 1126 |
| iterations | 722 |
| time_elapsed | 5251 |
| total_timesteps | 5914624 |
| train/ | |
| approx_kl | 0.04054501 |
| clip_fraction | 0.199 |
| clip_range | 0.143 |
| entropy_loss | -5.09 |
| explained_variance | 0.935 |
| learning_rate | 0.000235 |
| loss | -0.017 |
| n_updates | 2884 |
| policy_gradient_loss | -0.0121 |
| value_loss | 0.00039 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.3 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1126 |
| iterations | 723 |
| time_elapsed | 5258 |
| total_timesteps | 5922816 |
| train/ | |
| approx_kl | 0.050431214 |
| clip_fraction | 0.28 |
| clip_range | 0.143 |
| entropy_loss | -5.22 |
| explained_variance | 0.946 |
| learning_rate | 0.000235 |
| loss | -0.0331 |
| n_updates | 2888 |
| policy_gradient_loss | -0.0191 |
| value_loss | 0.000533 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.1 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 724 |
| time_elapsed | 5265 |
| total_timesteps | 5931008 |
| train/ | |
| approx_kl | 0.045170095 |
| clip_fraction | 0.243 |
| clip_range | 0.143 |
| entropy_loss | -5.28 |
| explained_variance | 0.972 |
| learning_rate | 0.000235 |
| loss | -0.0315 |
| n_updates | 2892 |
| policy_gradient_loss | -0.0225 |
| value_loss | 0.000293 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.6 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 725 |
| time_elapsed | 5273 |
| total_timesteps | 5939200 |
| train/ | |
| approx_kl | 0.035973076 |
| clip_fraction | 0.276 |
| clip_range | 0.143 |
| entropy_loss | -5.12 |
| explained_variance | 0.956 |
| learning_rate | 0.000235 |
| loss | -0.0242 |
| n_updates | 2896 |
| policy_gradient_loss | -0.0165 |
| value_loss | 0.00033 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 726 |
| time_elapsed | 5280 |
| total_timesteps | 5947392 |
| train/ | |
| approx_kl | 0.05976686 |
| clip_fraction | 0.285 |
| clip_range | 0.143 |
| entropy_loss | -5.24 |
| explained_variance | 0.951 |
| learning_rate | 0.000235 |
| loss | -0.0363 |
| n_updates | 2900 |
| policy_gradient_loss | -0.0241 |
| value_loss | 0.000538 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.7 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 727 |
| time_elapsed | 5287 |
| total_timesteps | 5955584 |
| train/ | |
| approx_kl | 0.034210984 |
| clip_fraction | 0.24 |
| clip_range | 0.143 |
| entropy_loss | -5.01 |
| explained_variance | 0.955 |
| learning_rate | 0.000235 |
| loss | -0.0198 |
| n_updates | 2904 |
| policy_gradient_loss | -0.0102 |
| value_loss | 0.000284 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 728 |
| time_elapsed | 5295 |
| total_timesteps | 5963776 |
| train/ | |
| approx_kl | 0.036749084 |
| clip_fraction | 0.244 |
| clip_range | 0.143 |
| entropy_loss | -5.12 |
| explained_variance | 0.959 |
| learning_rate | 0.000235 |
| loss | -0.0236 |
| n_updates | 2908 |
| policy_gradient_loss | -0.0152 |
| value_loss | 0.000316 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 729 |
| time_elapsed | 5302 |
| total_timesteps | 5971968 |
| train/ | |
| approx_kl | 0.038757585 |
| clip_fraction | 0.257 |
| clip_range | 0.143 |
| entropy_loss | -5.08 |
| explained_variance | 0.944 |
| learning_rate | 0.000235 |
| loss | -0.0194 |
| n_updates | 2912 |
| policy_gradient_loss | -0.0154 |
| value_loss | 0.000443 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 730 |
| time_elapsed | 5309 |
| total_timesteps | 5980160 |
| train/ | |
| approx_kl | 0.0453797 |
| clip_fraction | 0.259 |
| clip_range | 0.143 |
| entropy_loss | -5.26 |
| explained_variance | 0.966 |
| learning_rate | 0.000235 |
| loss | -0.0325 |
| n_updates | 2916 |
| policy_gradient_loss | -0.0224 |
| value_loss | 0.000317 |
---------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.6 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 731 |
| time_elapsed | 5317 |
| total_timesteps | 5988352 |
| train/ | |
| approx_kl | 0.03852643 |
| clip_fraction | 0.226 |
| clip_range | 0.143 |
| entropy_loss | -5.15 |
| explained_variance | 0.986 |
| learning_rate | 0.000235 |
| loss | -0.0299 |
| n_updates | 2920 |
| policy_gradient_loss | -0.0187 |
| value_loss | 0.000117 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 56.9 |
| ep_rew_mean | 0.83 |
| time/ | |
| fps | 1126 |
| iterations | 732 |
| time_elapsed | 5324 |
| total_timesteps | 5996544 |
| train/ | |
| approx_kl | 0.04784715 |
| clip_fraction | 0.307 |
| clip_range | 0.143 |
| entropy_loss | -5.18 |
| explained_variance | 0.948 |
| learning_rate | 0.000235 |
| loss | -0.0314 |
| n_updates | 2924 |
| policy_gradient_loss | -0.0193 |
| value_loss | 0.000505 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.4 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 733 |
| time_elapsed | 5331 |
| total_timesteps | 6004736 |
| train/ | |
| approx_kl | 0.06175911 |
| clip_fraction | 0.276 |
| clip_range | 0.143 |
| entropy_loss | -5.42 |
| explained_variance | 0.966 |
| learning_rate | 0.000235 |
| loss | -0.0377 |
| n_updates | 2928 |
| policy_gradient_loss | -0.0283 |
| value_loss | 0.000451 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1126 |
| iterations | 734 |
| time_elapsed | 5339 |
| total_timesteps | 6012928 |
| train/ | |
| approx_kl | 0.048298042 |
| clip_fraction | 0.255 |
| clip_range | 0.142 |
| entropy_loss | -5.21 |
| explained_variance | 0.964 |
| learning_rate | 0.000235 |
| loss | -0.0298 |
| n_updates | 2932 |
| policy_gradient_loss | -0.0179 |
| value_loss | 0.000372 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 735 |
| time_elapsed | 5346 |
| total_timesteps | 6021120 |
| train/ | |
| approx_kl | 0.042535838 |
| clip_fraction | 0.271 |
| clip_range | 0.142 |
| entropy_loss | -5.21 |
| explained_variance | 0.973 |
| learning_rate | 0.000235 |
| loss | -0.0199 |
| n_updates | 2936 |
| policy_gradient_loss | -0.0164 |
| value_loss | 0.000257 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1126 |
| iterations | 736 |
| time_elapsed | 5353 |
| total_timesteps | 6029312 |
| train/ | |
| approx_kl | 0.034904987 |
| clip_fraction | 0.282 |
| clip_range | 0.142 |
| entropy_loss | -5.25 |
| explained_variance | 0.959 |
| learning_rate | 0.000235 |
| loss | -0.0259 |
| n_updates | 2940 |
| policy_gradient_loss | -0.0185 |
| value_loss | 0.000341 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.3 |
| ep_rew_mean | 0.827 |
| time/ | |
| fps | 1126 |
| iterations | 737 |
| time_elapsed | 5360 |
| total_timesteps | 6037504 |
| train/ | |
| approx_kl | 0.019801997 |
| clip_fraction | 0.242 |
| clip_range | 0.142 |
| entropy_loss | -5.14 |
| explained_variance | 0.97 |
| learning_rate | 0.000235 |
| loss | -0.0133 |
| n_updates | 2944 |
| policy_gradient_loss | -0.0103 |
| value_loss | 0.000201 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.5 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1126 |
| iterations | 738 |
| time_elapsed | 5368 |
| total_timesteps | 6045696 |
| train/ | |
| approx_kl | 0.04305493 |
| clip_fraction | 0.275 |
| clip_range | 0.142 |
| entropy_loss | -5.27 |
| explained_variance | 0.962 |
| learning_rate | 0.000235 |
| loss | -0.0274 |
| n_updates | 2948 |
| policy_gradient_loss | -0.0205 |
| value_loss | 0.000372 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.6 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 739 |
| time_elapsed | 5375 |
| total_timesteps | 6053888 |
| train/ | |
| approx_kl | 0.03373812 |
| clip_fraction | 0.281 |
| clip_range | 0.142 |
| entropy_loss | -5.3 |
| explained_variance | 0.969 |
| learning_rate | 0.000235 |
| loss | -0.0236 |
| n_updates | 2952 |
| policy_gradient_loss | -0.0196 |
| value_loss | 0.000323 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 740 |
| time_elapsed | 5382 |
| total_timesteps | 6062080 |
| train/ | |
| approx_kl | 0.048344314 |
| clip_fraction | 0.305 |
| clip_range | 0.142 |
| entropy_loss | -5.3 |
| explained_variance | 0.963 |
| learning_rate | 0.000235 |
| loss | -0.0211 |
| n_updates | 2956 |
| policy_gradient_loss | -0.0213 |
| value_loss | 0.000393 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.3 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 741 |
| time_elapsed | 5390 |
| total_timesteps | 6070272 |
| train/ | |
| approx_kl | 0.041593716 |
| clip_fraction | 0.258 |
| clip_range | 0.142 |
| entropy_loss | -5.28 |
| explained_variance | 0.971 |
| learning_rate | 0.000235 |
| loss | -0.0332 |
| n_updates | 2960 |
| policy_gradient_loss | -0.0192 |
| value_loss | 0.00029 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.2 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1126 |
| iterations | 742 |
| time_elapsed | 5396 |
| total_timesteps | 6078464 |
| train/ | |
| approx_kl | 0.016287819 |
| clip_fraction | 0.24 |
| clip_range | 0.142 |
| entropy_loss | -5.1 |
| explained_variance | 0.975 |
| learning_rate | 0.000235 |
| loss | -0.0143 |
| n_updates | 2964 |
| policy_gradient_loss | -0.00889 |
| value_loss | 0.000156 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 743 |
| time_elapsed | 5404 |
| total_timesteps | 6086656 |
| train/ | |
| approx_kl | 0.05024436 |
| clip_fraction | 0.271 |
| clip_range | 0.142 |
| entropy_loss | -5.23 |
| explained_variance | 0.942 |
| learning_rate | 0.000235 |
| loss | -0.0206 |
| n_updates | 2968 |
| policy_gradient_loss | -0.0171 |
| value_loss | 0.000506 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 744 |
| time_elapsed | 5411 |
| total_timesteps | 6094848 |
| train/ | |
| approx_kl | 0.03224071 |
| clip_fraction | 0.241 |
| clip_range | 0.142 |
| entropy_loss | -5.21 |
| explained_variance | 0.957 |
| learning_rate | 0.000235 |
| loss | -0.0188 |
| n_updates | 2972 |
| policy_gradient_loss | -0.0153 |
| value_loss | 0.000331 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.8 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1126 |
| iterations | 745 |
| time_elapsed | 5418 |
| total_timesteps | 6103040 |
| train/ | |
| approx_kl | 0.044510987 |
| clip_fraction | 0.269 |
| clip_range | 0.142 |
| entropy_loss | -5.32 |
| explained_variance | 0.962 |
| learning_rate | 0.000235 |
| loss | -0.0286 |
| n_updates | 2976 |
| policy_gradient_loss | -0.0204 |
| value_loss | 0.000371 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 51.6 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 746 |
| time_elapsed | 5426 |
| total_timesteps | 6111232 |
| train/ | |
| approx_kl | 0.04014173 |
| clip_fraction | 0.289 |
| clip_range | 0.142 |
| entropy_loss | -5.28 |
| explained_variance | 0.973 |
| learning_rate | 0.000235 |
| loss | -0.0307 |
| n_updates | 2980 |
| policy_gradient_loss | -0.0187 |
| value_loss | 0.000296 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 51.1 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1126 |
| iterations | 747 |
| time_elapsed | 5433 |
| total_timesteps | 6119424 |
| train/ | |
| approx_kl | 0.038560018 |
| clip_fraction | 0.244 |
| clip_range | 0.142 |
| entropy_loss | -5.28 |
| explained_variance | 0.981 |
| learning_rate | 0.000235 |
| loss | -0.0257 |
| n_updates | 2984 |
| policy_gradient_loss | -0.0185 |
| value_loss | 0.000181 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 748 |
| time_elapsed | 5440 |
| total_timesteps | 6127616 |
| train/ | |
| approx_kl | 0.048225008 |
| clip_fraction | 0.324 |
| clip_range | 0.142 |
| entropy_loss | -5.36 |
| explained_variance | 0.958 |
| learning_rate | 0.000235 |
| loss | -0.0312 |
| n_updates | 2988 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.000507 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 47 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1126 |
| iterations | 749 |
| time_elapsed | 5447 |
| total_timesteps | 6135808 |
| train/ | |
| approx_kl | 0.0355388 |
| clip_fraction | 0.239 |
| clip_range | 0.142 |
| entropy_loss | -5.17 |
| explained_variance | 0.962 |
| learning_rate | 0.000235 |
| loss | -0.026 |
| n_updates | 2992 |
| policy_gradient_loss | -0.0148 |
| value_loss | 0.000295 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 750 |
| time_elapsed | 5455 |
| total_timesteps | 6144000 |
| train/ | |
| approx_kl | 0.035041135 |
| clip_fraction | 0.22 |
| clip_range | 0.142 |
| entropy_loss | -5.1 |
| explained_variance | 0.964 |
| learning_rate | 0.000235 |
| loss | -0.0191 |
| n_updates | 2996 |
| policy_gradient_loss | -0.0106 |
| value_loss | 0.000233 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.1 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1126 |
| iterations | 751 |
| time_elapsed | 5462 |
| total_timesteps | 6152192 |
| train/ | |
| approx_kl | 0.028162979 |
| clip_fraction | 0.2 |
| clip_range | 0.142 |
| entropy_loss | -5.1 |
| explained_variance | 0.982 |
| learning_rate | 0.000235 |
| loss | -0.0186 |
| n_updates | 3000 |
| policy_gradient_loss | -0.0119 |
| value_loss | 0.000123 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 752 |
| time_elapsed | 5469 |
| total_timesteps | 6160384 |
| train/ | |
| approx_kl | 0.038256727 |
| clip_fraction | 0.251 |
| clip_range | 0.142 |
| entropy_loss | -5.21 |
| explained_variance | 0.966 |
| learning_rate | 0.000235 |
| loss | -0.0139 |
| n_updates | 3004 |
| policy_gradient_loss | -0.0162 |
| value_loss | 0.000307 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 753 |
| time_elapsed | 5477 |
| total_timesteps | 6168576 |
| train/ | |
| approx_kl | 0.05544287 |
| clip_fraction | 0.275 |
| clip_range | 0.142 |
| entropy_loss | -5.18 |
| explained_variance | 0.973 |
| learning_rate | 0.000235 |
| loss | -0.0125 |
| n_updates | 3008 |
| policy_gradient_loss | -0.015 |
| value_loss | 0.000218 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.2 |
| ep_rew_mean | 0.834 |
| time/ | |
| fps | 1126 |
| iterations | 754 |
| time_elapsed | 5484 |
| total_timesteps | 6176768 |
| train/ | |
| approx_kl | 0.058045685 |
| clip_fraction | 0.239 |
| clip_range | 0.142 |
| entropy_loss | -5.16 |
| explained_variance | 0.98 |
| learning_rate | 0.000235 |
| loss | -0.0199 |
| n_updates | 3012 |
| policy_gradient_loss | -0.0162 |
| value_loss | 0.000151 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1126 |
| iterations | 755 |
| time_elapsed | 5491 |
| total_timesteps | 6184960 |
| train/ | |
| approx_kl | 0.057210833 |
| clip_fraction | 0.251 |
| clip_range | 0.142 |
| entropy_loss | -5.25 |
| explained_variance | 0.971 |
| learning_rate | 0.000235 |
| loss | -0.0344 |
| n_updates | 3016 |
| policy_gradient_loss | -0.0205 |
| value_loss | 0.000297 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.3 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 756 |
| time_elapsed | 5498 |
| total_timesteps | 6193152 |
| train/ | |
| approx_kl | 0.03760905 |
| clip_fraction | 0.281 |
| clip_range | 0.142 |
| entropy_loss | -5.16 |
| explained_variance | 0.957 |
| learning_rate | 0.000235 |
| loss | -0.0248 |
| n_updates | 3020 |
| policy_gradient_loss | -0.0174 |
| value_loss | 0.000372 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 757 |
| time_elapsed | 5505 |
| total_timesteps | 6201344 |
| train/ | |
| approx_kl | 0.038085088 |
| clip_fraction | 0.23 |
| clip_range | 0.142 |
| entropy_loss | -5.1 |
| explained_variance | 0.961 |
| learning_rate | 0.000235 |
| loss | -0.0171 |
| n_updates | 3024 |
| policy_gradient_loss | -0.0107 |
| value_loss | 0.000274 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 758 |
| time_elapsed | 5513 |
| total_timesteps | 6209536 |
| train/ | |
| approx_kl | 0.047488715 |
| clip_fraction | 0.274 |
| clip_range | 0.142 |
| entropy_loss | -5.19 |
| explained_variance | 0.972 |
| learning_rate | 0.000235 |
| loss | -0.0243 |
| n_updates | 3028 |
| policy_gradient_loss | -0.0157 |
| value_loss | 0.000241 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 759 |
| time_elapsed | 5520 |
| total_timesteps | 6217728 |
| train/ | |
| approx_kl | 0.039855327 |
| clip_fraction | 0.21 |
| clip_range | 0.142 |
| entropy_loss | -5.15 |
| explained_variance | 0.988 |
| learning_rate | 0.000235 |
| loss | -0.0263 |
| n_updates | 3032 |
| policy_gradient_loss | -0.0144 |
| value_loss | 9.13e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 760 |
| time_elapsed | 5527 |
| total_timesteps | 6225920 |
| train/ | |
| approx_kl | 0.023532707 |
| clip_fraction | 0.201 |
| clip_range | 0.142 |
| entropy_loss | -5.07 |
| explained_variance | 0.964 |
| learning_rate | 0.000235 |
| loss | -0.0079 |
| n_updates | 3036 |
| policy_gradient_loss | -0.00859 |
| value_loss | 0.000194 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 761 |
| time_elapsed | 5534 |
| total_timesteps | 6234112 |
| train/ | |
| approx_kl | 0.025123313 |
| clip_fraction | 0.214 |
| clip_range | 0.142 |
| entropy_loss | -5.1 |
| explained_variance | 0.98 |
| learning_rate | 0.000235 |
| loss | -0.0135 |
| n_updates | 3040 |
| policy_gradient_loss | -0.0114 |
| value_loss | 0.00011 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 762 |
| time_elapsed | 5542 |
| total_timesteps | 6242304 |
| train/ | |
| approx_kl | 0.037490234 |
| clip_fraction | 0.271 |
| clip_range | 0.142 |
| entropy_loss | -5.18 |
| explained_variance | 0.971 |
| learning_rate | 0.000235 |
| loss | -0.0226 |
| n_updates | 3044 |
| policy_gradient_loss | -0.0151 |
| value_loss | 0.000232 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1126 |
| iterations | 763 |
| time_elapsed | 5549 |
| total_timesteps | 6250496 |
| train/ | |
| approx_kl | 0.03347466 |
| clip_fraction | 0.227 |
| clip_range | 0.142 |
| entropy_loss | -5.22 |
| explained_variance | 0.975 |
| learning_rate | 0.000235 |
| loss | -0.0192 |
| n_updates | 3048 |
| policy_gradient_loss | -0.0178 |
| value_loss | 0.000203 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.7 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1126 |
| iterations | 764 |
| time_elapsed | 5557 |
| total_timesteps | 6258688 |
| train/ | |
| approx_kl | 0.033448763 |
| clip_fraction | 0.22 |
| clip_range | 0.142 |
| entropy_loss | -5.23 |
| explained_variance | 0.971 |
| learning_rate | 0.000235 |
| loss | -0.0171 |
| n_updates | 3052 |
| policy_gradient_loss | -0.0151 |
| value_loss | 0.000227 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.8 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1126 |
| iterations | 765 |
| time_elapsed | 5564 |
| total_timesteps | 6266880 |
| train/ | |
| approx_kl | 0.040871978 |
| clip_fraction | 0.294 |
| clip_range | 0.142 |
| entropy_loss | -5.33 |
| explained_variance | 0.96 |
| learning_rate | 0.000235 |
| loss | -0.0267 |
| n_updates | 3056 |
| policy_gradient_loss | -0.0209 |
| value_loss | 0.000444 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.7 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1126 |
| iterations | 766 |
| time_elapsed | 5571 |
| total_timesteps | 6275072 |
| train/ | |
| approx_kl | 0.03903518 |
| clip_fraction | 0.261 |
| clip_range | 0.142 |
| entropy_loss | -5.21 |
| explained_variance | 0.967 |
| learning_rate | 0.000234 |
| loss | -0.0304 |
| n_updates | 3060 |
| policy_gradient_loss | -0.0171 |
| value_loss | 0.0003 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.6 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1126 |
| iterations | 767 |
| time_elapsed | 5579 |
| total_timesteps | 6283264 |
| train/ | |
| approx_kl | 0.030962426 |
| clip_fraction | 0.234 |
| clip_range | 0.142 |
| entropy_loss | -5.13 |
| explained_variance | 0.973 |
| learning_rate | 0.000234 |
| loss | -0.0216 |
| n_updates | 3064 |
| policy_gradient_loss | -0.0147 |
| value_loss | 0.000202 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 768 |
| time_elapsed | 5586 |
| total_timesteps | 6291456 |
| train/ | |
| approx_kl | 0.035079446 |
| clip_fraction | 0.257 |
| clip_range | 0.142 |
| entropy_loss | -5.16 |
| explained_variance | 0.977 |
| learning_rate | 0.000234 |
| loss | -0.0197 |
| n_updates | 3068 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.00021 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 769 |
| time_elapsed | 5593 |
| total_timesteps | 6299648 |
| train/ | |
| approx_kl | 0.032604642 |
| clip_fraction | 0.187 |
| clip_range | 0.142 |
| entropy_loss | -5.04 |
| explained_variance | 0.984 |
| learning_rate | 0.000234 |
| loss | -0.00746 |
| n_updates | 3072 |
| policy_gradient_loss | -0.00535 |
| value_loss | 8.02e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 770 |
| time_elapsed | 5601 |
| total_timesteps | 6307840 |
| train/ | |
| approx_kl | 0.018493613 |
| clip_fraction | 0.245 |
| clip_range | 0.142 |
| entropy_loss | -5.08 |
| explained_variance | 0.977 |
| learning_rate | 0.000234 |
| loss | -0.0141 |
| n_updates | 3076 |
| policy_gradient_loss | -0.00727 |
| value_loss | 0.00013 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 771 |
| time_elapsed | 5608 |
| total_timesteps | 6316032 |
| train/ | |
| approx_kl | 0.028190378 |
| clip_fraction | 0.256 |
| clip_range | 0.142 |
| entropy_loss | -5.05 |
| explained_variance | 0.974 |
| learning_rate | 0.000234 |
| loss | -0.0181 |
| n_updates | 3080 |
| policy_gradient_loss | -0.0113 |
| value_loss | 0.000127 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 46.5 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1126 |
| iterations | 772 |
| time_elapsed | 5616 |
| total_timesteps | 6324224 |
| train/ | |
| approx_kl | 0.0286576 |
| clip_fraction | 0.237 |
| clip_range | 0.142 |
| entropy_loss | -5.03 |
| explained_variance | 0.97 |
| learning_rate | 0.000234 |
| loss | -0.0195 |
| n_updates | 3084 |
| policy_gradient_loss | -0.0135 |
| value_loss | 0.000219 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.5 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1126 |
| iterations | 773 |
| time_elapsed | 5623 |
| total_timesteps | 6332416 |
| train/ | |
| approx_kl | 0.026856178 |
| clip_fraction | 0.204 |
| clip_range | 0.142 |
| entropy_loss | -5.01 |
| explained_variance | 0.977 |
| learning_rate | 0.000234 |
| loss | -0.0118 |
| n_updates | 3088 |
| policy_gradient_loss | -0.00806 |
| value_loss | 0.000132 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1126 |
| iterations | 774 |
| time_elapsed | 5630 |
| total_timesteps | 6340608 |
| train/ | |
| approx_kl | 0.022221375 |
| clip_fraction | 0.215 |
| clip_range | 0.142 |
| entropy_loss | -5 |
| explained_variance | 0.984 |
| learning_rate | 0.000234 |
| loss | -0.0146 |
| n_updates | 3092 |
| policy_gradient_loss | -0.0096 |
| value_loss | 0.000122 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 775 |
| time_elapsed | 5637 |
| total_timesteps | 6348800 |
| train/ | |
| approx_kl | 0.037792154 |
| clip_fraction | 0.247 |
| clip_range | 0.142 |
| entropy_loss | -5.01 |
| explained_variance | 0.978 |
| learning_rate | 0.000234 |
| loss | -0.0159 |
| n_updates | 3096 |
| policy_gradient_loss | -0.013 |
| value_loss | 0.00017 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 776 |
| time_elapsed | 5645 |
| total_timesteps | 6356992 |
| train/ | |
| approx_kl | 0.020882806 |
| clip_fraction | 0.239 |
| clip_range | 0.142 |
| entropy_loss | -5 |
| explained_variance | 0.986 |
| learning_rate | 0.000234 |
| loss | -0.0167 |
| n_updates | 3100 |
| policy_gradient_loss | -0.0096 |
| value_loss | 0.000112 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1126 |
| iterations | 777 |
| time_elapsed | 5652 |
| total_timesteps | 6365184 |
| train/ | |
| approx_kl | 0.022384431 |
| clip_fraction | 0.174 |
| clip_range | 0.142 |
| entropy_loss | -4.99 |
| explained_variance | 0.991 |
| learning_rate | 0.000234 |
| loss | -0.00844 |
| n_updates | 3104 |
| policy_gradient_loss | -0.00749 |
| value_loss | 7.09e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 778 |
| time_elapsed | 5659 |
| total_timesteps | 6373376 |
| train/ | |
| approx_kl | 0.039117202 |
| clip_fraction | 0.216 |
| clip_range | 0.142 |
| entropy_loss | -5.04 |
| explained_variance | 0.975 |
| learning_rate | 0.000234 |
| loss | -0.0238 |
| n_updates | 3108 |
| policy_gradient_loss | -0.016 |
| value_loss | 0.000178 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1126 |
| iterations | 779 |
| time_elapsed | 5667 |
| total_timesteps | 6381568 |
| train/ | |
| approx_kl | 0.031001236 |
| clip_fraction | 0.244 |
| clip_range | 0.142 |
| entropy_loss | -5 |
| explained_variance | 0.979 |
| learning_rate | 0.000234 |
| loss | -0.016 |
| n_updates | 3112 |
| policy_gradient_loss | -0.0142 |
| value_loss | 0.000152 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 780 |
| time_elapsed | 5674 |
| total_timesteps | 6389760 |
| train/ | |
| approx_kl | 0.042975467 |
| clip_fraction | 0.229 |
| clip_range | 0.142 |
| entropy_loss | -5.05 |
| explained_variance | 0.984 |
| learning_rate | 0.000234 |
| loss | -0.0147 |
| n_updates | 3116 |
| policy_gradient_loss | -0.0157 |
| value_loss | 0.000129 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1126 |
| iterations | 781 |
| time_elapsed | 5681 |
| total_timesteps | 6397952 |
| train/ | |
| approx_kl | 0.012288848 |
| clip_fraction | 0.22 |
| clip_range | 0.142 |
| entropy_loss | -4.94 |
| explained_variance | 0.983 |
| learning_rate | 0.000234 |
| loss | -0.014 |
| n_updates | 3120 |
| policy_gradient_loss | -0.00573 |
| value_loss | 7.39e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.9 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 782 |
| time_elapsed | 5689 |
| total_timesteps | 6406144 |
| train/ | |
| approx_kl | 0.012277699 |
| clip_fraction | 0.212 |
| clip_range | 0.142 |
| entropy_loss | -4.95 |
| explained_variance | 0.987 |
| learning_rate | 0.000234 |
| loss | -0.0131 |
| n_updates | 3124 |
| policy_gradient_loss | -0.00448 |
| value_loss | 8.29e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.1 |
| ep_rew_mean | 0.836 |
| time/ | |
| fps | 1125 |
| iterations | 783 |
| time_elapsed | 5696 |
| total_timesteps | 6414336 |
| train/ | |
| approx_kl | 0.020281263 |
| clip_fraction | 0.21 |
| clip_range | 0.142 |
| entropy_loss | -4.96 |
| explained_variance | 0.983 |
| learning_rate | 0.000234 |
| loss | -0.00463 |
| n_updates | 3128 |
| policy_gradient_loss | -0.00717 |
| value_loss | 0.000108 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 784 |
| time_elapsed | 5704 |
| total_timesteps | 6422528 |
| train/ | |
| approx_kl | 0.043180197 |
| clip_fraction | 0.245 |
| clip_range | 0.142 |
| entropy_loss | -5.15 |
| explained_variance | 0.973 |
| learning_rate | 0.000234 |
| loss | -0.0245 |
| n_updates | 3132 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000256 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.4 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 785 |
| time_elapsed | 5711 |
| total_timesteps | 6430720 |
| train/ | |
| approx_kl | 0.039829828 |
| clip_fraction | 0.205 |
| clip_range | 0.142 |
| entropy_loss | -5.04 |
| explained_variance | 0.983 |
| learning_rate | 0.000234 |
| loss | -0.0198 |
| n_updates | 3136 |
| policy_gradient_loss | -0.0146 |
| value_loss | 0.000117 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1125 |
| iterations | 786 |
| time_elapsed | 5718 |
| total_timesteps | 6438912 |
| train/ | |
| approx_kl | 0.033817418 |
| clip_fraction | 0.214 |
| clip_range | 0.142 |
| entropy_loss | -5.12 |
| explained_variance | 0.984 |
| learning_rate | 0.000234 |
| loss | -0.0229 |
| n_updates | 3140 |
| policy_gradient_loss | -0.0159 |
| value_loss | 0.000127 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.1 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1125 |
| iterations | 787 |
| time_elapsed | 5726 |
| total_timesteps | 6447104 |
| train/ | |
| approx_kl | 0.043065824 |
| clip_fraction | 0.243 |
| clip_range | 0.142 |
| entropy_loss | -5.16 |
| explained_variance | 0.979 |
| learning_rate | 0.000234 |
| loss | -0.0259 |
| n_updates | 3144 |
| policy_gradient_loss | -0.0193 |
| value_loss | 0.000201 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1125 |
| iterations | 788 |
| time_elapsed | 5733 |
| total_timesteps | 6455296 |
| train/ | |
| approx_kl | 0.054211844 |
| clip_fraction | 0.298 |
| clip_range | 0.142 |
| entropy_loss | -5.22 |
| explained_variance | 0.965 |
| learning_rate | 0.000234 |
| loss | -0.032 |
| n_updates | 3148 |
| policy_gradient_loss | -0.021 |
| value_loss | 0.000367 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1125 |
| iterations | 789 |
| time_elapsed | 5741 |
| total_timesteps | 6463488 |
| train/ | |
| approx_kl | 0.04307641 |
| clip_fraction | 0.269 |
| clip_range | 0.142 |
| entropy_loss | -5.16 |
| explained_variance | 0.953 |
| learning_rate | 0.000234 |
| loss | -0.0258 |
| n_updates | 3152 |
| policy_gradient_loss | -0.0167 |
| value_loss | 0.000482 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 790 |
| time_elapsed | 5748 |
| total_timesteps | 6471680 |
| train/ | |
| approx_kl | 0.040333666 |
| clip_fraction | 0.255 |
| clip_range | 0.142 |
| entropy_loss | -5.21 |
| explained_variance | 0.98 |
| learning_rate | 0.000234 |
| loss | -0.0311 |
| n_updates | 3156 |
| policy_gradient_loss | -0.022 |
| value_loss | 0.000211 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1125 |
| iterations | 791 |
| time_elapsed | 5755 |
| total_timesteps | 6479872 |
| train/ | |
| approx_kl | 0.028134856 |
| clip_fraction | 0.203 |
| clip_range | 0.142 |
| entropy_loss | -5.09 |
| explained_variance | 0.967 |
| learning_rate | 0.000234 |
| loss | -0.0185 |
| n_updates | 3160 |
| policy_gradient_loss | -0.0121 |
| value_loss | 0.000229 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1125 |
| iterations | 792 |
| time_elapsed | 5762 |
| total_timesteps | 6488064 |
| train/ | |
| approx_kl | 0.017897256 |
| clip_fraction | 0.21 |
| clip_range | 0.142 |
| entropy_loss | -5.02 |
| explained_variance | 0.982 |
| learning_rate | 0.000234 |
| loss | -0.0104 |
| n_updates | 3164 |
| policy_gradient_loss | -0.00701 |
| value_loss | 9.29e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1125 |
| iterations | 793 |
| time_elapsed | 5770 |
| total_timesteps | 6496256 |
| train/ | |
| approx_kl | 0.037010256 |
| clip_fraction | 0.26 |
| clip_range | 0.142 |
| entropy_loss | -5.13 |
| explained_variance | 0.965 |
| learning_rate | 0.000234 |
| loss | -0.0201 |
| n_updates | 3168 |
| policy_gradient_loss | -0.0148 |
| value_loss | 0.000249 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.3 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1125 |
| iterations | 794 |
| time_elapsed | 5777 |
| total_timesteps | 6504448 |
| train/ | |
| approx_kl | 0.029477585 |
| clip_fraction | 0.176 |
| clip_range | 0.142 |
| entropy_loss | -5.09 |
| explained_variance | 0.955 |
| learning_rate | 0.000234 |
| loss | -0.0196 |
| n_updates | 3172 |
| policy_gradient_loss | -0.0125 |
| value_loss | 0.000219 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1125 |
| iterations | 795 |
| time_elapsed | 5785 |
| total_timesteps | 6512640 |
| train/ | |
| approx_kl | 0.03641277 |
| clip_fraction | 0.221 |
| clip_range | 0.142 |
| entropy_loss | -5.06 |
| explained_variance | 0.974 |
| learning_rate | 0.000234 |
| loss | -0.0161 |
| n_updates | 3176 |
| policy_gradient_loss | -0.011 |
| value_loss | 0.000158 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.8 |
| ep_rew_mean | 0.841 |
| time/ | |
| fps | 1125 |
| iterations | 796 |
| time_elapsed | 5792 |
| total_timesteps | 6520832 |
| train/ | |
| approx_kl | 0.03163231 |
| clip_fraction | 0.245 |
| clip_range | 0.142 |
| entropy_loss | -5.12 |
| explained_variance | 0.952 |
| learning_rate | 0.000234 |
| loss | -0.0218 |
| n_updates | 3180 |
| policy_gradient_loss | -0.0161 |
| value_loss | 0.000349 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.3 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1125 |
| iterations | 797 |
| time_elapsed | 5800 |
| total_timesteps | 6529024 |
| train/ | |
| approx_kl | 0.03802508 |
| clip_fraction | 0.235 |
| clip_range | 0.142 |
| entropy_loss | -5.11 |
| explained_variance | 0.979 |
| learning_rate | 0.000234 |
| loss | -0.0209 |
| n_updates | 3184 |
| policy_gradient_loss | -0.0189 |
| value_loss | 0.000181 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.4 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1125 |
| iterations | 798 |
| time_elapsed | 5807 |
| total_timesteps | 6537216 |
| train/ | |
| approx_kl | 0.055112638 |
| clip_fraction | 0.235 |
| clip_range | 0.142 |
| entropy_loss | -5.19 |
| explained_variance | 0.974 |
| learning_rate | 0.000234 |
| loss | -0.0309 |
| n_updates | 3188 |
| policy_gradient_loss | -0.0199 |
| value_loss | 0.000222 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.8 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1125 |
| iterations | 799 |
| time_elapsed | 5814 |
| total_timesteps | 6545408 |
| train/ | |
| approx_kl | 0.040802427 |
| clip_fraction | 0.258 |
| clip_range | 0.142 |
| entropy_loss | -5.14 |
| explained_variance | 0.969 |
| learning_rate | 0.000234 |
| loss | -0.0207 |
| n_updates | 3192 |
| policy_gradient_loss | -0.0169 |
| value_loss | 0.00024 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 800 |
| time_elapsed | 5821 |
| total_timesteps | 6553600 |
| train/ | |
| approx_kl | 0.02460128 |
| clip_fraction | 0.225 |
| clip_range | 0.142 |
| entropy_loss | -5.05 |
| explained_variance | 0.986 |
| learning_rate | 0.000234 |
| loss | -0.0153 |
| n_updates | 3196 |
| policy_gradient_loss | -0.0102 |
| value_loss | 0.000104 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 801 |
| time_elapsed | 5829 |
| total_timesteps | 6561792 |
| train/ | |
| approx_kl | 0.030457243 |
| clip_fraction | 0.196 |
| clip_range | 0.142 |
| entropy_loss | -5.02 |
| explained_variance | 0.995 |
| learning_rate | 0.000234 |
| loss | -0.0201 |
| n_updates | 3200 |
| policy_gradient_loss | -0.00937 |
| value_loss | 4.1e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 54.3 |
| ep_rew_mean | 0.835 |
| time/ | |
| fps | 1125 |
| iterations | 802 |
| time_elapsed | 5836 |
| total_timesteps | 6569984 |
| train/ | |
| approx_kl | 0.012211589 |
| clip_fraction | 0.227 |
| clip_range | 0.142 |
| entropy_loss | -5.01 |
| explained_variance | 0.977 |
| learning_rate | 0.000234 |
| loss | 0.0199 |
| n_updates | 3204 |
| policy_gradient_loss | -0.00474 |
| value_loss | 0.000147 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1125 |
| iterations | 803 |
| time_elapsed | 5843 |
| total_timesteps | 6578176 |
| train/ | |
| approx_kl | 0.061349977 |
| clip_fraction | 0.315 |
| clip_range | 0.142 |
| entropy_loss | -5.28 |
| explained_variance | 0.932 |
| learning_rate | 0.000234 |
| loss | -0.0326 |
| n_updates | 3208 |
| policy_gradient_loss | -0.0205 |
| value_loss | 0.000833 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 804 |
| time_elapsed | 5851 |
| total_timesteps | 6586368 |
| train/ | |
| approx_kl | 0.04115832 |
| clip_fraction | 0.23 |
| clip_range | 0.142 |
| entropy_loss | -5.07 |
| explained_variance | 0.965 |
| learning_rate | 0.000234 |
| loss | -0.0191 |
| n_updates | 3212 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000229 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 805 |
| time_elapsed | 5858 |
| total_timesteps | 6594560 |
| train/ | |
| approx_kl | 0.032970298 |
| clip_fraction | 0.226 |
| clip_range | 0.142 |
| entropy_loss | -5.03 |
| explained_variance | 0.973 |
| learning_rate | 0.000234 |
| loss | -0.0204 |
| n_updates | 3216 |
| policy_gradient_loss | -0.0133 |
| value_loss | 0.000204 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 806 |
| time_elapsed | 5866 |
| total_timesteps | 6602752 |
| train/ | |
| approx_kl | 0.03360557 |
| clip_fraction | 0.209 |
| clip_range | 0.142 |
| entropy_loss | -4.98 |
| explained_variance | 0.984 |
| learning_rate | 0.000234 |
| loss | -0.0125 |
| n_updates | 3220 |
| policy_gradient_loss | -0.0117 |
| value_loss | 0.000111 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.9 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1125 |
| iterations | 807 |
| time_elapsed | 5873 |
| total_timesteps | 6610944 |
| train/ | |
| approx_kl | 0.015501356 |
| clip_fraction | 0.218 |
| clip_range | 0.142 |
| entropy_loss | -4.98 |
| explained_variance | 0.985 |
| learning_rate | 0.000234 |
| loss | -0.0081 |
| n_updates | 3224 |
| policy_gradient_loss | -0.00752 |
| value_loss | 8.94e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1125 |
| iterations | 808 |
| time_elapsed | 5880 |
| total_timesteps | 6619136 |
| train/ | |
| approx_kl | 0.020969227 |
| clip_fraction | 0.234 |
| clip_range | 0.142 |
| entropy_loss | -5.04 |
| explained_variance | 0.977 |
| learning_rate | 0.000234 |
| loss | -0.0154 |
| n_updates | 3228 |
| policy_gradient_loss | -0.00933 |
| value_loss | 0.000155 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 809 |
| time_elapsed | 5888 |
| total_timesteps | 6627328 |
| train/ | |
| approx_kl | 0.04721541 |
| clip_fraction | 0.213 |
| clip_range | 0.142 |
| entropy_loss | -5.04 |
| explained_variance | 0.964 |
| learning_rate | 0.000234 |
| loss | -0.0179 |
| n_updates | 3232 |
| policy_gradient_loss | -0.0113 |
| value_loss | 0.000254 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 810 |
| time_elapsed | 5895 |
| total_timesteps | 6635520 |
| train/ | |
| approx_kl | 0.025107604 |
| clip_fraction | 0.205 |
| clip_range | 0.142 |
| entropy_loss | -5.02 |
| explained_variance | 0.983 |
| learning_rate | 0.000234 |
| loss | -0.00671 |
| n_updates | 3236 |
| policy_gradient_loss | -0.01 |
| value_loss | 0.000109 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.6 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 811 |
| time_elapsed | 5902 |
| total_timesteps | 6643712 |
| train/ | |
| approx_kl | 0.022637725 |
| clip_fraction | 0.213 |
| clip_range | 0.142 |
| entropy_loss | -4.98 |
| explained_variance | 0.98 |
| learning_rate | 0.000234 |
| loss | -0.0151 |
| n_updates | 3240 |
| policy_gradient_loss | -0.0105 |
| value_loss | 0.000126 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 812 |
| time_elapsed | 5910 |
| total_timesteps | 6651904 |
| train/ | |
| approx_kl | 0.028323751 |
| clip_fraction | 0.223 |
| clip_range | 0.142 |
| entropy_loss | -5.07 |
| explained_variance | 0.969 |
| learning_rate | 0.000234 |
| loss | -0.0182 |
| n_updates | 3244 |
| policy_gradient_loss | -0.0133 |
| value_loss | 0.000225 |
-----------------------------------------
--------------------------------------
| rollout/ | |
| ep_len_mean | 47.5 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1125 |
| iterations | 813 |
| time_elapsed | 5917 |
| total_timesteps | 6660096 |
| train/ | |
| approx_kl | 0.034639 |
| clip_fraction | 0.216 |
| clip_range | 0.142 |
| entropy_loss | -5.08 |
| explained_variance | 0.977 |
| learning_rate | 0.000234 |
| loss | -0.0121 |
| n_updates | 3248 |
| policy_gradient_loss | -0.012 |
| value_loss | 0.000176 |
--------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1125 |
| iterations | 814 |
| time_elapsed | 5924 |
| total_timesteps | 6668288 |
| train/ | |
| approx_kl | 0.059522096 |
| clip_fraction | 0.22 |
| clip_range | 0.142 |
| entropy_loss | -5.13 |
| explained_variance | 0.96 |
| learning_rate | 0.000234 |
| loss | -0.0212 |
| n_updates | 3252 |
| policy_gradient_loss | -0.0142 |
| value_loss | 0.000314 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1125 |
| iterations | 815 |
| time_elapsed | 5931 |
| total_timesteps | 6676480 |
| train/ | |
| approx_kl | 0.04286322 |
| clip_fraction | 0.236 |
| clip_range | 0.142 |
| entropy_loss | -5.16 |
| explained_variance | 0.965 |
| learning_rate | 0.000233 |
| loss | -0.0209 |
| n_updates | 3256 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000274 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 816 |
| time_elapsed | 5938 |
| total_timesteps | 6684672 |
| train/ | |
| approx_kl | 0.037303083 |
| clip_fraction | 0.226 |
| clip_range | 0.142 |
| entropy_loss | -5.09 |
| explained_variance | 0.967 |
| learning_rate | 0.000233 |
| loss | -0.0112 |
| n_updates | 3260 |
| policy_gradient_loss | -0.0129 |
| value_loss | 0.000205 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1125 |
| iterations | 817 |
| time_elapsed | 5946 |
| total_timesteps | 6692864 |
| train/ | |
| approx_kl | 0.015058521 |
| clip_fraction | 0.17 |
| clip_range | 0.142 |
| entropy_loss | -5.06 |
| explained_variance | 0.987 |
| learning_rate | 0.000233 |
| loss | -0.0132 |
| n_updates | 3264 |
| policy_gradient_loss | -0.00847 |
| value_loss | 7.98e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 818 |
| time_elapsed | 5953 |
| total_timesteps | 6701056 |
| train/ | |
| approx_kl | 0.022279281 |
| clip_fraction | 0.202 |
| clip_range | 0.142 |
| entropy_loss | -5.14 |
| explained_variance | 0.986 |
| learning_rate | 0.000233 |
| loss | -0.0151 |
| n_updates | 3268 |
| policy_gradient_loss | -0.011 |
| value_loss | 9.2e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1125 |
| iterations | 819 |
| time_elapsed | 5961 |
| total_timesteps | 6709248 |
| train/ | |
| approx_kl | 0.026741974 |
| clip_fraction | 0.244 |
| clip_range | 0.142 |
| entropy_loss | -5.15 |
| explained_variance | 0.946 |
| learning_rate | 0.000233 |
| loss | -0.0232 |
| n_updates | 3272 |
| policy_gradient_loss | -0.0119 |
| value_loss | 0.000403 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1125 |
| iterations | 820 |
| time_elapsed | 5968 |
| total_timesteps | 6717440 |
| train/ | |
| approx_kl | 0.03894692 |
| clip_fraction | 0.199 |
| clip_range | 0.142 |
| entropy_loss | -5.2 |
| explained_variance | 0.954 |
| learning_rate | 0.000233 |
| loss | -0.021 |
| n_updates | 3276 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000335 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.842 |
| time/ | |
| fps | 1125 |
| iterations | 821 |
| time_elapsed | 5976 |
| total_timesteps | 6725632 |
| train/ | |
| approx_kl | 0.032750554 |
| clip_fraction | 0.212 |
| clip_range | 0.142 |
| entropy_loss | -5.14 |
| explained_variance | 0.973 |
| learning_rate | 0.000233 |
| loss | -0.0153 |
| n_updates | 3280 |
| policy_gradient_loss | -0.0161 |
| value_loss | 0.000188 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.5 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 822 |
| time_elapsed | 5983 |
| total_timesteps | 6733824 |
| train/ | |
| approx_kl | 0.046135433 |
| clip_fraction | 0.207 |
| clip_range | 0.142 |
| entropy_loss | -5.11 |
| explained_variance | 0.969 |
| learning_rate | 0.000233 |
| loss | -0.0157 |
| n_updates | 3284 |
| policy_gradient_loss | -0.0143 |
| value_loss | 0.000223 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 823 |
| time_elapsed | 5990 |
| total_timesteps | 6742016 |
| train/ | |
| approx_kl | 0.02728849 |
| clip_fraction | 0.199 |
| clip_range | 0.142 |
| entropy_loss | -5.12 |
| explained_variance | 0.99 |
| learning_rate | 0.000233 |
| loss | -0.021 |
| n_updates | 3288 |
| policy_gradient_loss | -0.0125 |
| value_loss | 7.42e-05 |
----------------------------------------
------------------------------------------
| rollout/ | |
| ep_len_mean | 46.5 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1125 |
| iterations | 824 |
| time_elapsed | 5998 |
| total_timesteps | 6750208 |
| train/ | |
| approx_kl | 0.0128123695 |
| clip_fraction | 0.218 |
| clip_range | 0.142 |
| entropy_loss | -5.07 |
| explained_variance | 0.99 |
| learning_rate | 0.000233 |
| loss | -0.000859 |
| n_updates | 3292 |
| policy_gradient_loss | -0.00815 |
| value_loss | 7.19e-05 |
------------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.2 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1125 |
| iterations | 825 |
| time_elapsed | 6006 |
| total_timesteps | 6758400 |
| train/ | |
| approx_kl | 0.028587349 |
| clip_fraction | 0.229 |
| clip_range | 0.142 |
| entropy_loss | -5.11 |
| explained_variance | 0.965 |
| learning_rate | 0.000233 |
| loss | -0.0128 |
| n_updates | 3296 |
| policy_gradient_loss | -0.0119 |
| value_loss | 0.000237 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1125 |
| iterations | 826 |
| time_elapsed | 6013 |
| total_timesteps | 6766592 |
| train/ | |
| approx_kl | 0.04846013 |
| clip_fraction | 0.245 |
| clip_range | 0.142 |
| entropy_loss | -5.2 |
| explained_variance | 0.956 |
| learning_rate | 0.000233 |
| loss | -0.0204 |
| n_updates | 3300 |
| policy_gradient_loss | -0.0149 |
| value_loss | 0.000328 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 52.7 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1125 |
| iterations | 827 |
| time_elapsed | 6020 |
| total_timesteps | 6774784 |
| train/ | |
| approx_kl | 0.019571748 |
| clip_fraction | 0.218 |
| clip_range | 0.142 |
| entropy_loss | -5.13 |
| explained_variance | 0.975 |
| learning_rate | 0.000233 |
| loss | -0.00798 |
| n_updates | 3304 |
| policy_gradient_loss | -0.0118 |
| value_loss | 0.000164 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 50.2 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1125 |
| iterations | 828 |
| time_elapsed | 6027 |
| total_timesteps | 6782976 |
| train/ | |
| approx_kl | 0.04891327 |
| clip_fraction | 0.251 |
| clip_range | 0.142 |
| entropy_loss | -5.3 |
| explained_variance | 0.973 |
| learning_rate | 0.000233 |
| loss | -0.0356 |
| n_updates | 3308 |
| policy_gradient_loss | -0.0208 |
| value_loss | 0.000263 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 829 |
| time_elapsed | 6035 |
| total_timesteps | 6791168 |
| train/ | |
| approx_kl | 0.037181236 |
| clip_fraction | 0.24 |
| clip_range | 0.142 |
| entropy_loss | -5.26 |
| explained_variance | 0.96 |
| learning_rate | 0.000233 |
| loss | -0.025 |
| n_updates | 3312 |
| policy_gradient_loss | -0.019 |
| value_loss | 0.000352 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.3 |
| ep_rew_mean | 0.837 |
| time/ | |
| fps | 1125 |
| iterations | 830 |
| time_elapsed | 6042 |
| total_timesteps | 6799360 |
| train/ | |
| approx_kl | 0.023251036 |
| clip_fraction | 0.22 |
| clip_range | 0.142 |
| entropy_loss | -5.2 |
| explained_variance | 0.978 |
| learning_rate | 0.000233 |
| loss | -0.0237 |
| n_updates | 3316 |
| policy_gradient_loss | -0.0129 |
| value_loss | 0.00015 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.9 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1125 |
| iterations | 831 |
| time_elapsed | 6049 |
| total_timesteps | 6807552 |
| train/ | |
| approx_kl | 0.04387694 |
| clip_fraction | 0.235 |
| clip_range | 0.142 |
| entropy_loss | -5.29 |
| explained_variance | 0.974 |
| learning_rate | 0.000233 |
| loss | -0.0195 |
| n_updates | 3320 |
| policy_gradient_loss | -0.0158 |
| value_loss | 0.000222 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 832 |
| time_elapsed | 6056 |
| total_timesteps | 6815744 |
| train/ | |
| approx_kl | 0.024846584 |
| clip_fraction | 0.193 |
| clip_range | 0.141 |
| entropy_loss | -5.1 |
| explained_variance | 0.945 |
| learning_rate | 0.000233 |
| loss | -0.0138 |
| n_updates | 3324 |
| policy_gradient_loss | -0.00831 |
| value_loss | 0.000306 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.845 |
| time/ | |
| fps | 1125 |
| iterations | 833 |
| time_elapsed | 6064 |
| total_timesteps | 6823936 |
| train/ | |
| approx_kl | 0.02767839 |
| clip_fraction | 0.229 |
| clip_range | 0.141 |
| entropy_loss | -5.22 |
| explained_variance | 0.976 |
| learning_rate | 0.000233 |
| loss | -0.0182 |
| n_updates | 3328 |
| policy_gradient_loss | -0.0141 |
| value_loss | 0.000175 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.8 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1125 |
| iterations | 834 |
| time_elapsed | 6071 |
| total_timesteps | 6832128 |
| train/ | |
| approx_kl | 0.034100402 |
| clip_fraction | 0.221 |
| clip_range | 0.141 |
| entropy_loss | -5.26 |
| explained_variance | 0.973 |
| learning_rate | 0.000233 |
| loss | -0.0238 |
| n_updates | 3332 |
| policy_gradient_loss | -0.017 |
| value_loss | 0.000236 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1125 |
| iterations | 835 |
| time_elapsed | 6078 |
| total_timesteps | 6840320 |
| train/ | |
| approx_kl | 0.029370539 |
| clip_fraction | 0.2 |
| clip_range | 0.141 |
| entropy_loss | -5.25 |
| explained_variance | 0.982 |
| learning_rate | 0.000233 |
| loss | -0.0224 |
| n_updates | 3336 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000149 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1125 |
| iterations | 836 |
| time_elapsed | 6086 |
| total_timesteps | 6848512 |
| train/ | |
| approx_kl | 0.022283178 |
| clip_fraction | 0.197 |
| clip_range | 0.141 |
| entropy_loss | -5.2 |
| explained_variance | 0.974 |
| learning_rate | 0.000233 |
| loss | -0.00426 |
| n_updates | 3340 |
| policy_gradient_loss | -0.00999 |
| value_loss | 0.000174 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.5 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 837 |
| time_elapsed | 6093 |
| total_timesteps | 6856704 |
| train/ | |
| approx_kl | 0.016606688 |
| clip_fraction | 0.202 |
| clip_range | 0.141 |
| entropy_loss | -5.17 |
| explained_variance | 0.968 |
| learning_rate | 0.000233 |
| loss | -0.00984 |
| n_updates | 3344 |
| policy_gradient_loss | -0.00688 |
| value_loss | 0.000169 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1125 |
| iterations | 838 |
| time_elapsed | 6100 |
| total_timesteps | 6864896 |
| train/ | |
| approx_kl | 0.032574862 |
| clip_fraction | 0.177 |
| clip_range | 0.141 |
| entropy_loss | -5.28 |
| explained_variance | 0.989 |
| learning_rate | 0.000233 |
| loss | -0.0193 |
| n_updates | 3348 |
| policy_gradient_loss | -0.0152 |
| value_loss | 9.98e-05 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 839 |
| time_elapsed | 6108 |
| total_timesteps | 6873088 |
| train/ | |
| approx_kl | 0.04932686 |
| clip_fraction | 0.239 |
| clip_range | 0.141 |
| entropy_loss | -5.29 |
| explained_variance | 0.971 |
| learning_rate | 0.000233 |
| loss | -0.0257 |
| n_updates | 3352 |
| policy_gradient_loss | -0.019 |
| value_loss | 0.000249 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 840 |
| time_elapsed | 6115 |
| total_timesteps | 6881280 |
| train/ | |
| approx_kl | 0.02459896 |
| clip_fraction | 0.183 |
| clip_range | 0.141 |
| entropy_loss | -5.2 |
| explained_variance | 0.988 |
| learning_rate | 0.000233 |
| loss | -0.0193 |
| n_updates | 3356 |
| policy_gradient_loss | -0.0106 |
| value_loss | 7.9e-05 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1125 |
| iterations | 841 |
| time_elapsed | 6122 |
| total_timesteps | 6889472 |
| train/ | |
| approx_kl | 0.024406128 |
| clip_fraction | 0.166 |
| clip_range | 0.141 |
| entropy_loss | -5.14 |
| explained_variance | 0.984 |
| learning_rate | 0.000233 |
| loss | -0.0158 |
| n_updates | 3360 |
| policy_gradient_loss | -0.00626 |
| value_loss | 7.64e-05 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1125 |
| iterations | 842 |
| time_elapsed | 6130 |
| total_timesteps | 6897664 |
| train/ | |
| approx_kl | 0.0415909 |
| clip_fraction | 0.22 |
| clip_range | 0.141 |
| entropy_loss | -5.16 |
| explained_variance | 0.944 |
| learning_rate | 0.000233 |
| loss | -0.0205 |
| n_updates | 3364 |
| policy_gradient_loss | -0.0127 |
| value_loss | 0.000358 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1125 |
| iterations | 843 |
| time_elapsed | 6137 |
| total_timesteps | 6905856 |
| train/ | |
| approx_kl | 0.020347431 |
| clip_fraction | 0.221 |
| clip_range | 0.141 |
| entropy_loss | -5.14 |
| explained_variance | 0.982 |
| learning_rate | 0.000233 |
| loss | -0.0211 |
| n_updates | 3368 |
| policy_gradient_loss | -0.00986 |
| value_loss | 0.000117 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 844 |
| time_elapsed | 6144 |
| total_timesteps | 6914048 |
| train/ | |
| approx_kl | 0.028655581 |
| clip_fraction | 0.204 |
| clip_range | 0.141 |
| entropy_loss | -5.18 |
| explained_variance | 0.977 |
| learning_rate | 0.000233 |
| loss | -0.0214 |
| n_updates | 3372 |
| policy_gradient_loss | -0.0133 |
| value_loss | 0.000173 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.4 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 845 |
| time_elapsed | 6152 |
| total_timesteps | 6922240 |
| train/ | |
| approx_kl | 0.024476504 |
| clip_fraction | 0.231 |
| clip_range | 0.141 |
| entropy_loss | -5.16 |
| explained_variance | 0.979 |
| learning_rate | 0.000233 |
| loss | -0.0149 |
| n_updates | 3376 |
| policy_gradient_loss | -0.0117 |
| value_loss | 0.000157 |
-----------------------------------------
---------------------------------------
| rollout/ | |
| ep_len_mean | 51.2 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1125 |
| iterations | 846 |
| time_elapsed | 6159 |
| total_timesteps | 6930432 |
| train/ | |
| approx_kl | 0.0510982 |
| clip_fraction | 0.198 |
| clip_range | 0.141 |
| entropy_loss | -5.21 |
| explained_variance | 0.981 |
| learning_rate | 0.000233 |
| loss | -0.017 |
| n_updates | 3380 |
| policy_gradient_loss | -0.0156 |
| value_loss | 0.000148 |
---------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.3 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1125 |
| iterations | 847 |
| time_elapsed | 6167 |
| total_timesteps | 6938624 |
| train/ | |
| approx_kl | 0.042876672 |
| clip_fraction | 0.218 |
| clip_range | 0.141 |
| entropy_loss | -5.29 |
| explained_variance | 0.975 |
| learning_rate | 0.000233 |
| loss | -0.0265 |
| n_updates | 3384 |
| policy_gradient_loss | -0.0196 |
| value_loss | 0.000224 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1125 |
| iterations | 848 |
| time_elapsed | 6174 |
| total_timesteps | 6946816 |
| train/ | |
| approx_kl | 0.034393117 |
| clip_fraction | 0.214 |
| clip_range | 0.141 |
| entropy_loss | -5.2 |
| explained_variance | 0.981 |
| learning_rate | 0.000233 |
| loss | -0.0174 |
| n_updates | 3388 |
| policy_gradient_loss | -0.0148 |
| value_loss | 0.000137 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1125 |
| iterations | 849 |
| time_elapsed | 6182 |
| total_timesteps | 6955008 |
| train/ | |
| approx_kl | 0.029551372 |
| clip_fraction | 0.193 |
| clip_range | 0.141 |
| entropy_loss | -5.21 |
| explained_variance | 0.986 |
| learning_rate | 0.000233 |
| loss | -0.0152 |
| n_updates | 3392 |
| policy_gradient_loss | -0.0108 |
| value_loss | 0.000109 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 48.2 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1125 |
| iterations | 850 |
| time_elapsed | 6189 |
| total_timesteps | 6963200 |
| train/ | |
| approx_kl | 0.03489526 |
| clip_fraction | 0.269 |
| clip_range | 0.141 |
| entropy_loss | -5.38 |
| explained_variance | 0.938 |
| learning_rate | 0.000233 |
| loss | -0.033 |
| n_updates | 3396 |
| policy_gradient_loss | -0.0209 |
| value_loss | 0.000606 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.9 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1125 |
| iterations | 851 |
| time_elapsed | 6196 |
| total_timesteps | 6971392 |
| train/ | |
| approx_kl | 0.043191776 |
| clip_fraction | 0.202 |
| clip_range | 0.141 |
| entropy_loss | -5.27 |
| explained_variance | 0.964 |
| learning_rate | 0.000233 |
| loss | -0.0216 |
| n_updates | 3400 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000294 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 852 |
| time_elapsed | 6203 |
| total_timesteps | 6979584 |
| train/ | |
| approx_kl | 0.033072513 |
| clip_fraction | 0.255 |
| clip_range | 0.141 |
| entropy_loss | -5.22 |
| explained_variance | 0.966 |
| learning_rate | 0.000233 |
| loss | -0.0125 |
| n_updates | 3404 |
| policy_gradient_loss | -0.0134 |
| value_loss | 0.000289 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1125 |
| iterations | 853 |
| time_elapsed | 6211 |
| total_timesteps | 6987776 |
| train/ | |
| approx_kl | 0.02262435 |
| clip_fraction | 0.155 |
| clip_range | 0.141 |
| entropy_loss | -5.28 |
| explained_variance | 0.976 |
| learning_rate | 0.000233 |
| loss | -0.00991 |
| n_updates | 3408 |
| policy_gradient_loss | -0.00966 |
| value_loss | 0.000126 |
----------------------------------------
------------------------------------------
| rollout/ | |
| ep_len_mean | 51.9 |
| ep_rew_mean | 0.839 |
| time/ | |
| fps | 1124 |
| iterations | 854 |
| time_elapsed | 6218 |
| total_timesteps | 6995968 |
| train/ | |
| approx_kl | 0.0075386907 |
| clip_fraction | 0.156 |
| clip_range | 0.141 |
| entropy_loss | -5.25 |
| explained_variance | 0.985 |
| learning_rate | 0.000233 |
| loss | -0.0128 |
| n_updates | 3412 |
| policy_gradient_loss | -0.00369 |
| value_loss | 8.72e-05 |
------------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.9 |
| ep_rew_mean | 0.843 |
| time/ | |
| fps | 1124 |
| iterations | 855 |
| time_elapsed | 6226 |
| total_timesteps | 7004160 |
| train/ | |
| approx_kl | 0.032338783 |
| clip_fraction | 0.221 |
| clip_range | 0.141 |
| entropy_loss | -5.34 |
| explained_variance | 0.966 |
| learning_rate | 0.000233 |
| loss | -0.0275 |
| n_updates | 3416 |
| policy_gradient_loss | -0.0184 |
| value_loss | 0.000282 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.7 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1124 |
| iterations | 856 |
| time_elapsed | 6233 |
| total_timesteps | 7012352 |
| train/ | |
| approx_kl | 0.03896132 |
| clip_fraction | 0.227 |
| clip_range | 0.141 |
| entropy_loss | -5.34 |
| explained_variance | 0.942 |
| learning_rate | 0.000233 |
| loss | -0.0208 |
| n_updates | 3420 |
| policy_gradient_loss | -0.0177 |
| value_loss | 0.000486 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.85 |
| time/ | |
| fps | 1124 |
| iterations | 857 |
| time_elapsed | 6240 |
| total_timesteps | 7020544 |
| train/ | |
| approx_kl | 0.036895618 |
| clip_fraction | 0.186 |
| clip_range | 0.141 |
| entropy_loss | -5.27 |
| explained_variance | 0.966 |
| learning_rate | 0.000233 |
| loss | -0.0182 |
| n_updates | 3424 |
| policy_gradient_loss | -0.016 |
| value_loss | 0.000289 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 858 |
| time_elapsed | 6247 |
| total_timesteps | 7028736 |
| train/ | |
| approx_kl | 0.029945202 |
| clip_fraction | 0.182 |
| clip_range | 0.141 |
| entropy_loss | -5.2 |
| explained_variance | 0.987 |
| learning_rate | 0.000233 |
| loss | -0.0208 |
| n_updates | 3428 |
| policy_gradient_loss | -0.0144 |
| value_loss | 0.000103 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 47.1 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1124 |
| iterations | 859 |
| time_elapsed | 6255 |
| total_timesteps | 7036928 |
| train/ | |
| approx_kl | 0.008434278 |
| clip_fraction | 0.187 |
| clip_range | 0.141 |
| entropy_loss | -5.15 |
| explained_variance | 0.998 |
| learning_rate | 0.000233 |
| loss | -0.0235 |
| n_updates | 3432 |
| policy_gradient_loss | -0.00704 |
| value_loss | 3.02e-05 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1124 |
| iterations | 860 |
| time_elapsed | 6262 |
| total_timesteps | 7045120 |
| train/ | |
| approx_kl | 0.04286689 |
| clip_fraction | 0.251 |
| clip_range | 0.141 |
| entropy_loss | -5.29 |
| explained_variance | 0.963 |
| learning_rate | 0.000233 |
| loss | -0.0229 |
| n_updates | 3436 |
| policy_gradient_loss | -0.0181 |
| value_loss | 0.000336 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 49 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1124 |
| iterations | 861 |
| time_elapsed | 6270 |
| total_timesteps | 7053312 |
| train/ | |
| approx_kl | 0.03362903 |
| clip_fraction | 0.242 |
| clip_range | 0.141 |
| entropy_loss | -5.26 |
| explained_variance | 0.967 |
| learning_rate | 0.000233 |
| loss | -0.0237 |
| n_updates | 3440 |
| policy_gradient_loss | -0.0187 |
| value_loss | 0.000289 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 862 |
| time_elapsed | 6277 |
| total_timesteps | 7061504 |
| train/ | |
| approx_kl | 0.04660075 |
| clip_fraction | 0.255 |
| clip_range | 0.141 |
| entropy_loss | -5.23 |
| explained_variance | 0.956 |
| learning_rate | 0.000233 |
| loss | -0.0244 |
| n_updates | 3444 |
| policy_gradient_loss | -0.0161 |
| value_loss | 0.000384 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1124 |
| iterations | 863 |
| time_elapsed | 6284 |
| total_timesteps | 7069696 |
| train/ | |
| approx_kl | 0.052064296 |
| clip_fraction | 0.176 |
| clip_range | 0.141 |
| entropy_loss | -5.2 |
| explained_variance | 0.982 |
| learning_rate | 0.000233 |
| loss | -0.021 |
| n_updates | 3448 |
| policy_gradient_loss | -0.015 |
| value_loss | 0.000138 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.7 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1124 |
| iterations | 864 |
| time_elapsed | 6291 |
| total_timesteps | 7077888 |
| train/ | |
| approx_kl | 0.03355575 |
| clip_fraction | 0.211 |
| clip_range | 0.141 |
| entropy_loss | -5.2 |
| explained_variance | 0.981 |
| learning_rate | 0.000233 |
| loss | -0.0172 |
| n_updates | 3452 |
| policy_gradient_loss | -0.0139 |
| value_loss | 0.000151 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 53.6 |
| ep_rew_mean | 0.833 |
| time/ | |
| fps | 1124 |
| iterations | 865 |
| time_elapsed | 6298 |
| total_timesteps | 7086080 |
| train/ | |
| approx_kl | 0.03970369 |
| clip_fraction | 0.259 |
| clip_range | 0.141 |
| entropy_loss | -5.23 |
| explained_variance | 0.973 |
| learning_rate | 0.000232 |
| loss | -0.0208 |
| n_updates | 3456 |
| policy_gradient_loss | -0.0155 |
| value_loss | 0.000195 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.3 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1124 |
| iterations | 866 |
| time_elapsed | 6306 |
| total_timesteps | 7094272 |
| train/ | |
| approx_kl | 0.037389383 |
| clip_fraction | 0.245 |
| clip_range | 0.141 |
| entropy_loss | -5.35 |
| explained_variance | 0.961 |
| learning_rate | 0.000232 |
| loss | -0.0358 |
| n_updates | 3460 |
| policy_gradient_loss | -0.0204 |
| value_loss | 0.000394 |
-----------------------------------------
------------------------------------------
| rollout/ | |
| ep_len_mean | 46.3 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1124 |
| iterations | 867 |
| time_elapsed | 6313 |
| total_timesteps | 7102464 |
| train/ | |
| approx_kl | 0.0120342355 |
| clip_fraction | 0.207 |
| clip_range | 0.141 |
| entropy_loss | -5.09 |
| explained_variance | 0.981 |
| learning_rate | 0.000232 |
| loss | -0.00787 |
| n_updates | 3464 |
| policy_gradient_loss | -0.00701 |
| value_loss | 0.000117 |
------------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 52.2 |
| ep_rew_mean | 0.84 |
| time/ | |
| fps | 1124 |
| iterations | 868 |
| time_elapsed | 6321 |
| total_timesteps | 7110656 |
| train/ | |
| approx_kl | 0.01594349 |
| clip_fraction | 0.205 |
| clip_range | 0.141 |
| entropy_loss | -5.1 |
| explained_variance | 0.978 |
| learning_rate | 0.000232 |
| loss | -0.00746 |
| n_updates | 3468 |
| policy_gradient_loss | -0.0089 |
| value_loss | 0.00013 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 47.6 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1124 |
| iterations | 869 |
| time_elapsed | 6328 |
| total_timesteps | 7118848 |
| train/ | |
| approx_kl | 0.04062698 |
| clip_fraction | 0.245 |
| clip_range | 0.141 |
| entropy_loss | -5.25 |
| explained_variance | 0.965 |
| learning_rate | 0.000232 |
| loss | -0.0281 |
| n_updates | 3472 |
| policy_gradient_loss | -0.0189 |
| value_loss | 0.00035 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 870 |
| time_elapsed | 6335 |
| total_timesteps | 7127040 |
| train/ | |
| approx_kl | 0.028115515 |
| clip_fraction | 0.213 |
| clip_range | 0.141 |
| entropy_loss | -5.13 |
| explained_variance | 0.977 |
| learning_rate | 0.000232 |
| loss | -0.0226 |
| n_updates | 3476 |
| policy_gradient_loss | -0.0142 |
| value_loss | 0.000159 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.9 |
| ep_rew_mean | 0.851 |
| time/ | |
| fps | 1124 |
| iterations | 871 |
| time_elapsed | 6343 |
| total_timesteps | 7135232 |
| train/ | |
| approx_kl | 0.01063107 |
| clip_fraction | 0.192 |
| clip_range | 0.141 |
| entropy_loss | -5.08 |
| explained_variance | 0.991 |
| learning_rate | 0.000232 |
| loss | -0.00917 |
| n_updates | 3480 |
| policy_gradient_loss | -0.00406 |
| value_loss | 6.02e-05 |
----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 872 |
| time_elapsed | 6350 |
| total_timesteps | 7143424 |
| train/ | |
| approx_kl | 0.02534625 |
| clip_fraction | 0.225 |
| clip_range | 0.141 |
| entropy_loss | -5.11 |
| explained_variance | 0.969 |
| learning_rate | 0.000232 |
| loss | -0.0158 |
| n_updates | 3484 |
| policy_gradient_loss | -0.0124 |
| value_loss | 0.000218 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 873 |
| time_elapsed | 6357 |
| total_timesteps | 7151616 |
| train/ | |
| approx_kl | 0.008821163 |
| clip_fraction | 0.184 |
| clip_range | 0.141 |
| entropy_loss | -5.02 |
| explained_variance | 0.997 |
| learning_rate | 0.000232 |
| loss | -0.0122 |
| n_updates | 3488 |
| policy_gradient_loss | -0.00656 |
| value_loss | 2.68e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.2 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1124 |
| iterations | 874 |
| time_elapsed | 6365 |
| total_timesteps | 7159808 |
| train/ | |
| approx_kl | 0.008496272 |
| clip_fraction | 0.193 |
| clip_range | 0.141 |
| entropy_loss | -5.04 |
| explained_variance | 0.992 |
| learning_rate | 0.000232 |
| loss | -0.00815 |
| n_updates | 3492 |
| policy_gradient_loss | -0.00528 |
| value_loss | 6.85e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.6 |
| ep_rew_mean | 0.849 |
| time/ | |
| fps | 1124 |
| iterations | 875 |
| time_elapsed | 6372 |
| total_timesteps | 7168000 |
| train/ | |
| approx_kl | 0.025475107 |
| clip_fraction | 0.235 |
| clip_range | 0.141 |
| entropy_loss | -5.16 |
| explained_variance | 0.973 |
| learning_rate | 0.000232 |
| loss | -0.0183 |
| n_updates | 3496 |
| policy_gradient_loss | -0.0136 |
| value_loss | 0.000193 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 53.1 |
| ep_rew_mean | 0.838 |
| time/ | |
| fps | 1124 |
| iterations | 876 |
| time_elapsed | 6379 |
| total_timesteps | 7176192 |
| train/ | |
| approx_kl | 0.028008547 |
| clip_fraction | 0.233 |
| clip_range | 0.141 |
| entropy_loss | -5.16 |
| explained_variance | 0.955 |
| learning_rate | 0.000232 |
| loss | -0.0215 |
| n_updates | 3500 |
| policy_gradient_loss | -0.0163 |
| value_loss | 0.000325 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.1 |
| ep_rew_mean | 0.847 |
| time/ | |
| fps | 1124 |
| iterations | 877 |
| time_elapsed | 6386 |
| total_timesteps | 7184384 |
| train/ | |
| approx_kl | 0.045767725 |
| clip_fraction | 0.224 |
| clip_range | 0.141 |
| entropy_loss | -5.29 |
| explained_variance | 0.978 |
| learning_rate | 0.000232 |
| loss | -0.0338 |
| n_updates | 3504 |
| policy_gradient_loss | -0.0221 |
| value_loss | 0.000205 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.7 |
| ep_rew_mean | 0.852 |
| time/ | |
| fps | 1124 |
| iterations | 878 |
| time_elapsed | 6394 |
| total_timesteps | 7192576 |
| train/ | |
| approx_kl | 0.027111448 |
| clip_fraction | 0.179 |
| clip_range | 0.141 |
| entropy_loss | -5.08 |
| explained_variance | 0.991 |
| learning_rate | 0.000232 |
| loss | -0.0194 |
| n_updates | 3508 |
| policy_gradient_loss | -0.013 |
| value_loss | 7.57e-05 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46 |
| ep_rew_mean | 0.853 |
| time/ | |
| fps | 1124 |
| iterations | 879 |
| time_elapsed | 6401 |
| total_timesteps | 7200768 |
| train/ | |
| approx_kl | 0.02790926 |
| clip_fraction | 0.181 |
| clip_range | 0.141 |
| entropy_loss | -5.03 |
| explained_variance | 0.963 |
| learning_rate | 0.000232 |
| loss | -0.0119 |
| n_updates | 3512 |
| policy_gradient_loss | -0.0115 |
| value_loss | 0.000237 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 50.2 |
| ep_rew_mean | 0.846 |
| time/ | |
| fps | 1124 |
| iterations | 880 |
| time_elapsed | 6409 |
| total_timesteps | 7208960 |
| train/ | |
| approx_kl | 0.008467438 |
| clip_fraction | 0.175 |
| clip_range | 0.141 |
| entropy_loss | -4.96 |
| explained_variance | 0.997 |
| learning_rate | 0.000232 |
| loss | -0.00275 |
| n_updates | 3516 |
| policy_gradient_loss | -0.00521 |
| value_loss | 3.07e-05 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 49.5 |
| ep_rew_mean | 0.844 |
| time/ | |
| fps | 1124 |
| iterations | 881 |
| time_elapsed | 6416 |
| total_timesteps | 7217152 |
| train/ | |
| approx_kl | 0.028228959 |
| clip_fraction | 0.226 |
| clip_range | 0.141 |
| entropy_loss | -5.06 |
| explained_variance | 0.961 |
| learning_rate | 0.000232 |
| loss | -0.0193 |
| n_updates | 3520 |
| policy_gradient_loss | -0.0149 |
| value_loss | 0.000297 |
-----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 46.4 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1124 |
| iterations | 882 |
| time_elapsed | 6424 |
| total_timesteps | 7225344 |
| train/ | |
| approx_kl | 0.039644137 |
| clip_fraction | 0.247 |
| clip_range | 0.141 |
| entropy_loss | -5.15 |
| explained_variance | 0.956 |
| learning_rate | 0.000232 |
| loss | -0.0264 |
| n_updates | 3524 |
| policy_gradient_loss | -0.0176 |
| value_loss | 0.000395 |
-----------------------------------------
----------------------------------------
| rollout/ | |
| ep_len_mean | 46.2 |
| ep_rew_mean | 0.854 |
| time/ | |
| fps | 1124 |
| iterations | 883 |
| time_elapsed | 6431 |
| total_timesteps | 7233536 |
| train/ | |
| approx_kl | 0.03067332 |
| clip_fraction | 0.214 |
| clip_range | 0.141 |
| entropy_loss | -5.07 |
| explained_variance | 0.965 |
| learning_rate | 0.000232 |
| loss | -0.0226 |
| n_updates | 3528 |
| policy_gradient_loss | -0.0124 |
| value_loss | 0.000221 |
----------------------------------------
-----------------------------------------
| rollout/ | |
| ep_len_mean | 48.4 |
| ep_rew_mean | 0.848 |
| time/ | |
| fps | 1124 |
| iterations | 884 |
| time_elapsed | 6439 |
| total_timesteps | 7241728 |
| train/ | |
| approx_kl | 0.026549514 |
| clip_fraction | 0.182 |
| clip_range | 0.141 |
| entropy_loss | -5.08 |
| explained_variance | 0.988 |
| learning_rate | 0.000232 |
| loss | -0.011 |
| n_updates | 3532 |
| policy_gradient_loss | -0.0126 |
| value_loss | 6.91e-05 |
-----------------------------------------
Reference in New Issue Copy Permalink