Scribd
Upload
21 views3 pages

Training Log Error

The document logs the training process over several epochs, detailing loss values and batch counts. It highlights recurring logging errors due to file handling issues, which disrupt the logging of loss metrics. Additionally, it notes a problem with training continuity after a restart, indicating a potential issue with the training setup.

Uploaded by

Crystal B
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
21 views3 pages

Training Log Error

The document logs the training process over several epochs, detailing loss values and batch counts. It highlights recurring logging errors due to file handling issues, which disrupt the logging of loss metrics. Additionally, it notes a problem with training continuity after a restart, indicating a potential issue with the training setup.

Uploaded by

Crystal B
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd

Epoch: 13 2024-11-14 [Link].

516178
Loss: -2.478 batch count: 96348
[Preprocess]: True
[TemplateMatch]: True
[Masking]: True
[Postprocess]: True

Epoch: 14 2024-11-14 [Link].523678


Loss: -2.478 batch count: 96348
--- Logging error ---
Traceback (most recent call last):
File "logging\__init__.py", line 1104, in emit
File "logging\__init__.py", line 1084, in flush
FileNotFoundError: [Errno 2] No such file or directory
Call stack:
File "[Link]", line 38, in <module>
File "[Link]", line 27, in main
File "[Link]", line 22, in train
File "unsupervised_core\unsupervised_module.py", line 68, in train
File "unsupervised_core\log_maker.py", line 30, in process_log
File "logging\__init__.py", line 1547, in log
File "logging\__init__.py", line 1624, in _log
File "logging\__init__.py", line 1634, in handle
File "logging\__init__.py", line 1696, in callHandlers
File "logging\__init__.py", line 968, in handle
File "logging\__init__.py", line 1218, in emit
File "logging\__init__.py", line 1108, in emit
Message: 'loss: -2.478, epoch: 14, last time: 23646'
Arguments: ()
[Preprocess]: True
[TemplateMatch]: True
[Masking]: True
[Postprocess]: True

Epoch: 15 2024-11-14 [Link].630573


Loss: -2.478 batch count: 96348
--- Logging error ---
Traceback (most recent call last):
File "logging\__init__.py", line 1104, in emit
File "logging\__init__.py", line 1084, in flush
OSError: [Errno 22] Invalid argument
Call stack:
File "[Link]", line 38, in <module>
File "[Link]", line 27, in main
File "[Link]", line 22, in train
File "unsupervised_core\unsupervised_module.py", line 68, in train
File "unsupervised_core\log_maker.py", line 30, in process_log
File "logging\__init__.py", line 1547, in log
File "logging\__init__.py", line 1624, in _log
File "logging\__init__.py", line 1634, in handle
File "logging\__init__.py", line 1696, in callHandlers
File "logging\__init__.py", line 968, in handle
File "logging\__init__.py", line 1218, in emit
File "logging\__init__.py", line 1108, in emit
Message: 'loss: -2.478, epoch: 15, last time: 19705'
Arguments: ()
[Preprocess]: True
[TemplateMatch]: True
[Masking]: True
[Postprocess]: True

Epoch: 16 2024-11-14 [Link].504048


Loss: -2.473 batch count: 96348
--- Logging error ---
Traceback (most recent call last):
File "logging\__init__.py", line 1104, in emit
File "logging\__init__.py", line 1084, in flush
OSError: [Errno 22] Invalid argument
Call stack:
File "[Link]", line 38, in <module>
File "[Link]", line 27, in main
File "[Link]", line 22, in train
File "unsupervised_core\unsupervised_module.py", line 68, in train
File "unsupervised_core\log_maker.py", line 30, in process_log
File "logging\__init__.py", line 1547, in log
File "logging\__init__.py", line 1624, in _log
File "logging\__init__.py", line 1634, in handle
File "logging\__init__.py", line 1696, in callHandlers
File "logging\__init__.py", line 968, in handle
File "logging\__init__.py", line 1218, in emit
File "logging\__init__.py", line 1108, in emit
Message: 'loss: -2.473, epoch: 16, last time: 15764'
Arguments: ()
[Preprocess]: True
[TemplateMatch]: True
[Masking]: True
[Postprocess]: True

Epoch: 17 2024-11-14 [Link].453072


Loss: -2.472 batch count: 96348
--- Logging error ---
Traceback (most recent call last):
File "logging\__init__.py", line 1104, in emit
File "logging\__init__.py", line 1084, in flush
OSError: [Errno 22] Invalid argument
Call stack:
File "[Link]", line 38, in <module>
File "[Link]", line 27, in main
File "[Link]", line 22, in train
File "unsupervised_core\unsupervised_module.py", line 68, in train
File "unsupervised_core\log_maker.py", line 30, in process_log
File "logging\__init__.py", line 1547, in log
File "logging\__init__.py", line 1624, in _log
File "logging\__init__.py", line 1634, in handle
File "logging\__init__.py", line 1696, in callHandlers
File "logging\__init__.py", line 968, in handle
File "logging\__init__.py", line 1218, in emit
File "logging\__init__.py", line 1108, in emit
Message: 'loss: -2.472, epoch: 17, last time: 11820'
Arguments: ()
[Preprocess]: True
[TemplateMatch]: True
[Masking]: True
[Postprocess]: True

Epoch: 18 2024-11-14 [Link].379405


problem: training is not continuing.
reason: after restarting the 213.

You might also like