Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • A AutoIntent
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 10
    • Issues 10
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 2
    • Merge requests 2
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • DeepPavlov
  • AutoIntent
  • Issues
  • #202
Closed
Open
Issue created May 04, 2025 by Roman Zlobin@RLKRoMaintainer

wandb fail: large final metrics file

Created by: voorhs

wandb: ERROR failed to upsert bucket: returned error 400: {"data":{"upsertBucket":null},"errors":[{"message":"run config cannot exceed 15 MB","path":["upsertBucket"]}]}
Traceback (most recent call last):
  File "/data/home/alekseev/AutoIntent-experiments/quality_scorers.py", line 147, in <module>
    pipe.fit(Dataset.from_hub(dataset), refit_after=True, sampler="tpe", incompatible_search_space="filter")
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_pipeline/_pipeline.py", line 253, in fit
    context.callback_handler.log_final_metrics(context.optimization_info.dump_evaluation_results())
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_callbacks/callback_handler.py", line 74, in log_final_metrics
    self.call_events("log_final_metrics", metrics=metrics)
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_callbacks/callback_handler.py", line 84, in call_events
    getattr(callback, event)(**kwargs)
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/autointent/_callbacks/wandb.py", line 97, in log_final_metrics
    self.wandb.init(
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/sdk/wandb_init.py", line 1664, in init
    wandb._sentry.reraise(e)
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/analytics/sentry.py", line 156, in reraise
    raise exc.with_traceback(sys.exc_info()[2])
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/sdk/wandb_init.py", line 1650, in init
    return wi.init(run_settings, run_config, run_printer)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/data/home/alekseev/AutoIntent-experiments/.venv/lib/python3.12/site-packages/wandb/sdk/wandb_init.py", line 1074, in init
    raise error
wandb.errors.errors.CommError: failed to upsert bucket: returned error 400: {"data":{"upsertBucket":null},"errors":[{"message":"run config cannot exceed 15 MB","path":["upsertBucket"]}]}
wandb: 
wandb: 🚀 View run final_metrics at: 
wandb: Find logs at: wandb/run-20250504_214100-0ds6nvau/logs
Assignee
Assign to
Time tracking