wandb fail: large final metrics file
Created by: voorhs
wandb: ERROR failed to upsert bucket: returned error 400: {"data":{"upsertBucket":null},"errors":[{"message":"run config cannot exceed 15 MB","path":["upsertBucket"]}]}
Traceback (most recent call last):
File "/data/home/alekseev/AutoIntent-experiments/quality_scorers.py", line 147, in <module>
pipe.fit(Dataset.from_hub(dataset), refit_after=True, sampler="tpe", incompatible_search_space="filter")
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_pipeline/_pipeline.py", line 253, in fit
context.callback_handler.log_final_metrics(context.optimization_info.dump_evaluation_results())
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_callbacks/callback_handler.py", line 74, in log_final_metrics
self.call_events("log_final_metrics", metrics=metrics)
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_callbacks/callback_handler.py", line 84, in call_events
getattr(callback, event)(**kwargs)
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_callbacks/wandb.py", line 97, in log_final_metrics
self.wandb.init(
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/sdk/wandb_init.py", line 1664, in init
wandb._sentry.reraise(e)
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/analytics/sentry.py", line 156, in reraise
raise exc.with_traceback(sys.exc_info()[2])
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/sdk/wandb_init.py", line 1650, in init
return wi.init(run_settings, run_config, run_printer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/sdk/wandb_init.py", line 1074, in init
raise error
wandb.errors.errors.CommError: failed to upsert bucket: returned error 400: {"data":{"upsertBucket":null},"errors":[{"message":"run config cannot exceed 15 MB","path":["upsertBucket"]}]}
wandb:
wandb: 🚀 View run final_metrics at:
wandb: Find logs at: wandb/run-20250504_214100-0ds6nvau/logs