2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_setup.py:_flush():76] Configure stats pid to 49300
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_setup.py:_flush():76] Loading settings from /home/chenj0g/.config/wandb/settings
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_setup.py:_flush():76] Loading settings from /ibex/project/c2133/minigpt2_finetune/MiniGPT-4_finetune/wandb/settings
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'train.py', 'program': '/ibex/project/c2133/minigpt2_finetune/MiniGPT-4_finetune/train.py'}
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_init.py:_log_setup():507] Logging user logs to /ibex/project/c2133/minigpt2_finetune/MiniGPT-4_finetune/wandb/run-20231023_085438-bxwpu63q/logs/debug.log
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_init.py:_log_setup():508] Logging internal logs to /ibex/project/c2133/minigpt2_finetune/MiniGPT-4_finetune/wandb/run-20231023_085438-bxwpu63q/logs/debug-internal.log
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_init.py:init():547] calling init triggers
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_init.py:init():554] wandb.init called with sweep_config: {}
config: {}
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_init.py:init():595] starting backend
2023-10-23 08:54:38,127 INFO    MainThread:49300 [wandb_init.py:init():599] setting up manager
2023-10-23 08:54:38,129 INFO    MainThread:49300 [backend.py:_multiprocessing_setup():106] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2023-10-23 08:54:38,151 INFO    MainThread:49300 [wandb_init.py:init():605] backend started and connected
2023-10-23 08:54:38,153 INFO    MainThread:49300 [wandb_init.py:init():695] updated telemetry
2023-10-23 08:54:38,561 INFO    MainThread:49300 [wandb_init.py:init():732] communicating run to backend with 60.0 second timeout
2023-10-23 08:54:39,256 INFO    MainThread:49300 [wandb_run.py:_on_init():2176] communicating current version
2023-10-23 08:54:39,594 INFO    MainThread:49300 [wandb_run.py:_on_init():2185] got version response upgrade_message: "wandb version 0.15.12 is available!  To upgrade, please run:\n $ pip install wandb --upgrade"

2023-10-23 08:54:39,594 INFO    MainThread:49300 [wandb_init.py:init():782] starting run threads in backend
2023-10-23 08:54:52,772 INFO    MainThread:49300 [wandb_run.py:_console_start():2157] atexit reg
2023-10-23 08:54:52,772 INFO    MainThread:49300 [wandb_run.py:_redirect():2012] redirect: SettingsConsole.WRAP_RAW
2023-10-23 08:54:52,772 INFO    MainThread:49300 [wandb_run.py:_redirect():2077] Wrapping output streams.
2023-10-23 08:54:52,772 INFO    MainThread:49300 [wandb_run.py:_redirect():2102] Redirects installed.
2023-10-23 08:54:52,773 INFO    MainThread:49300 [wandb_init.py:init():824] run started, returning control to user process
2023-10-23 08:54:52,773 INFO    MainThread:49300 [wandb_watch.py:watch():51] Watching
2023-10-23 08:57:49,249 WARNING MsgRouterThr:49300 [router.py:message_loop():77] message_loop has been closed