marcelovidigal's picture
Training in progress, epoch 1
a7a4eae verified
raw
history blame
18.2 kB
2024-09-23 00:39:46,603 INFO StreamThr :9987 [internal.py:wandb_internal():85] W&B internal server running at pid: 9987, started at: 2024-09-23 00:39:46.602955
2024-09-23 00:39:46,605 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status
2024-09-23 00:39:46,617 INFO WriterThread:9987 [datastore.py:open_for_write():87] open: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/classificacao_texto/classificacao_texto_hugging_face/wandb/run-20240923_003946-8x4nifku/run-8x4nifku.wandb
2024-09-23 00:39:46,618 DEBUG SenderThread:9987 [sender.py:send():379] send: header
2024-09-23 00:39:46,650 DEBUG SenderThread:9987 [sender.py:send():379] send: run
2024-09-23 00:39:47,422 INFO SenderThread:9987 [dir_watcher.py:__init__():211] watching files in: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/classificacao_texto/classificacao_texto_hugging_face/wandb/run-20240923_003946-8x4nifku/files
2024-09-23 00:39:47,422 INFO SenderThread:9987 [sender.py:_start_run_threads():1188] run started: 8x4nifku with start time 1727062786.603785
2024-09-23 00:39:47,434 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: check_version
2024-09-23 00:39:47,434 DEBUG SenderThread:9987 [sender.py:send_request():406] send_request: check_version
2024-09-23 00:39:47,800 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: run_start
2024-09-23 00:39:47,811 DEBUG HandlerThread:9987 [system_info.py:__init__():26] System info init
2024-09-23 00:39:47,811 DEBUG HandlerThread:9987 [system_info.py:__init__():41] System info init done
2024-09-23 00:39:47,811 INFO HandlerThread:9987 [system_monitor.py:start():194] Starting system monitor
2024-09-23 00:39:47,811 INFO SystemMonitor:9987 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-23 00:39:47,812 INFO HandlerThread:9987 [system_monitor.py:probe():214] Collecting system info
2024-09-23 00:39:47,813 INFO SystemMonitor:9987 [interfaces.py:start():188] Started cpu monitoring
2024-09-23 00:39:47,813 DEBUG HandlerThread:9987 [system_info.py:probe():152] Probing system
2024-09-23 00:39:47,815 INFO SystemMonitor:9987 [interfaces.py:start():188] Started disk monitoring
2024-09-23 00:39:47,816 INFO SystemMonitor:9987 [interfaces.py:start():188] Started memory monitoring
2024-09-23 00:39:47,817 INFO SystemMonitor:9987 [interfaces.py:start():188] Started network monitoring
2024-09-23 00:39:47,823 DEBUG HandlerThread:9987 [system_info.py:_probe_git():137] Probing git
2024-09-23 00:39:47,858 DEBUG HandlerThread:9987 [system_info.py:_probe_git():145] Probing git done
2024-09-23 00:39:47,858 DEBUG HandlerThread:9987 [system_info.py:probe():200] Probing system done
2024-09-23 00:39:47,858 DEBUG HandlerThread:9987 [system_monitor.py:probe():223] {'os': 'macOS-15.0-x86_64-i386-64bit', 'python': '3.11.9', 'heartbeatAt': '2024-09-23T03:39:47.813460', 'startedAt': '2024-09-23T03:39:46.593000', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': '<python with no main file>', 'codePathLocal': None, 'git': {'remote': 'https://github.com/marcelovidigal/retrieval_augmented_generation.git', 'commit': '23db3b3a0427b4dfac5df9b26ac2572134e857c4'}, 'email': 'marcelovidigal@gmail.com', 'root': '/Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation', 'host': 'mace16.local', 'username': 'marcelovidigal', 'executable': '/usr/local/bin/python3', 'cpu_count': 8, 'cpu_count_logical': 16, 'cpu_freq': {'current': 2300, 'min': 2300, 'max': 2300}, 'cpu_freq_per_core': [{'current': 2300, 'min': 2300, 'max': 2300}], 'disk': {'/': {'total': 931.546989440918, 'used': 9.93536376953125}}, 'memory': {'total': 16.0}}
2024-09-23 00:39:47,858 INFO HandlerThread:9987 [system_monitor.py:probe():224] Finished collecting system info
2024-09-23 00:39:47,858 INFO HandlerThread:9987 [system_monitor.py:probe():227] Publishing system info
2024-09-23 00:39:47,860 INFO HandlerThread:9987 [system_monitor.py:probe():229] Finished publishing system info
2024-09-23 00:39:47,862 DEBUG SenderThread:9987 [sender.py:send():379] send: files
2024-09-23 00:39:47,863 INFO SenderThread:9987 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now
2024-09-23 00:39:48,115 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: python_packages
2024-09-23 00:39:48,115 DEBUG SenderThread:9987 [sender.py:send_request():406] send_request: python_packages
2024-09-23 00:39:48,116 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: stop_status
2024-09-23 00:39:48,116 DEBUG SenderThread:9987 [sender.py:send_request():406] send_request: stop_status
2024-09-23 00:39:48,117 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:48,121 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: pause
2024-09-23 00:39:48,121 INFO HandlerThread:9987 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-23 00:39:48,122 INFO HandlerThread:9987 [system_monitor.py:finish():203] Stopping system monitor
2024-09-23 00:39:48,122 DEBUG SystemMonitor:9987 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-23 00:39:48,122 DEBUG SystemMonitor:9987 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-23 00:39:48,122 DEBUG SystemMonitor:9987 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-23 00:39:48,122 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined cpu monitor
2024-09-23 00:39:48,123 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined disk monitor
2024-09-23 00:39:48,123 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined memory monitor
2024-09-23 00:39:48,123 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined network monitor
2024-09-23 00:39:48,426 INFO Thread-12 :9987 [dir_watcher.py:_on_file_created():271] file/dir created: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/classificacao_texto/classificacao_texto_hugging_face/wandb/run-20240923_003946-8x4nifku/files/wandb-metadata.json
2024-09-23 00:39:48,427 INFO Thread-12 :9987 [dir_watcher.py:_on_file_created():271] file/dir created: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/classificacao_texto/classificacao_texto_hugging_face/wandb/run-20240923_003946-8x4nifku/files/requirements.txt
2024-09-23 00:39:48,598 DEBUG SenderThread:9987 [sender.py:send():379] send: telemetry
2024-09-23 00:39:48,599 DEBUG SenderThread:9987 [sender.py:send():379] send: stats
2024-09-23 00:39:48,860 INFO wandb-upload_0:9987 [upload_job.py:push():130] Uploaded file /var/folders/75/ky9nhpn56rg6m0h92jqhqfd80000gn/T/tmpwhnuoooxwandb/eaipgtq2-wandb-metadata.json
2024-09-23 00:39:49,119 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:50,120 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:51,122 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:52,123 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:52,607 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:39:53,125 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:54,128 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:55,132 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:56,134 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:57,136 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:58,123 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:39:58,141 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:39:59,145 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:00,150 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:01,152 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:02,156 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:03,120 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: stop_status
2024-09-23 00:40:03,120 DEBUG SenderThread:9987 [sender.py:send_request():406] send_request: stop_status
2024-09-23 00:40:03,159 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:03,494 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:04,162 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:05,167 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:06,170 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:07,171 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:08,175 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:09,133 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:09,179 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:10,181 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:11,184 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:12,186 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:13,188 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:14,135 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:14,191 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:15,195 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:16,197 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:17,201 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:18,123 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: stop_status
2024-09-23 00:40:18,123 DEBUG SenderThread:9987 [sender.py:send_request():406] send_request: stop_status
2024-09-23 00:40:18,202 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:19,207 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:19,550 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:20,210 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:20,530 INFO Thread-12 :9987 [dir_watcher.py:_on_file_modified():288] file/dir modified: /Users/marcelovidigal/Library/CloudStorage/GoogleDrive-marcelovidigal@gmail.com/Meu Drive/projetos/python/retrieval_augmented_generation/modelos/classificacao_texto/classificacao_texto_hugging_face/wandb/run-20240923_003946-8x4nifku/files/config.yaml
2024-09-23 00:40:21,211 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:22,213 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:22,784 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: resume
2024-09-23 00:40:22,784 INFO HandlerThread:9987 [handler.py:handle_request_resume():715] starting system metrics thread
2024-09-23 00:40:22,784 INFO HandlerThread:9987 [system_monitor.py:start():194] Starting system monitor
2024-09-23 00:40:22,784 INFO SystemMonitor:9987 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-09-23 00:40:22,785 INFO SystemMonitor:9987 [interfaces.py:start():188] Started cpu monitoring
2024-09-23 00:40:22,785 INFO SystemMonitor:9987 [interfaces.py:start():188] Started disk monitoring
2024-09-23 00:40:22,785 INFO SystemMonitor:9987 [interfaces.py:start():188] Started memory monitoring
2024-09-23 00:40:22,787 INFO SystemMonitor:9987 [interfaces.py:start():188] Started network monitoring
2024-09-23 00:40:22,788 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: pause
2024-09-23 00:40:22,788 INFO HandlerThread:9987 [handler.py:handle_request_pause():724] stopping system metrics thread
2024-09-23 00:40:22,788 INFO HandlerThread:9987 [system_monitor.py:finish():203] Stopping system monitor
2024-09-23 00:40:22,789 DEBUG SystemMonitor:9987 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-09-23 00:40:22,789 DEBUG SystemMonitor:9987 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-09-23 00:40:22,789 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined cpu monitor
2024-09-23 00:40:22,789 DEBUG SystemMonitor:9987 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-09-23 00:40:22,789 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined disk monitor
2024-09-23 00:40:22,789 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined memory monitor
2024-09-23 00:40:22,790 INFO HandlerThread:9987 [interfaces.py:finish():200] Joined network monitor
2024-09-23 00:40:22,790 DEBUG SenderThread:9987 [sender.py:send():379] send: stats
2024-09-23 00:40:23,215 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:24,217 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:25,140 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:25,219 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:26,224 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:27,226 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:28,229 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:29,233 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:30,149 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:30,235 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:31,238 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:32,240 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:33,126 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: stop_status
2024-09-23 00:40:33,127 DEBUG SenderThread:9987 [sender.py:send_request():406] send_request: stop_status
2024-09-23 00:40:33,245 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:34,246 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:35,250 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:35,507 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:36,252 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:37,255 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:38,256 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:39,259 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:40,260 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:41,157 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: status_report
2024-09-23 00:40:41,265 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:42,269 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:43,272 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages
2024-09-23 00:40:44,274 DEBUG HandlerThread:9987 [handler.py:handle_request():158] handle_request: internal_messages