Значение freeze=False не учитывается после Pipeline.load(), модель тянется с huggingface
Created by: astrovvv
При попытке использования локальной модели эмбеддера и установке параметра freeze=False эта настройка игнорируется после загрузки пайплайна с диска. Загруженный пайп всё равно пытается вызвать huggingface что приводит к сбою в автономном режиме
loaded_pipeline = Pipeline.load(run_dir)
loaded_pipeline.set_config(
EmbedderConfig(
model_name="models/e5-large-instruct", # локальный путь
freeze=False,
)
)
result = loaded_pipeline.predict_with_metadata(utterances)
Трейс ошибки
Loaded pipeline for inference from dump.
urllib3.exceptions.SSLError: [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1028)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "D:\.venv\Lib\site-packages\requests\adapters.py", line 667, in send
resp = conn.urlopen(
method=request.method,
...<9 lines>...
chunked=chunked,
)
File "D:\.venv\Lib\site-packages\urllib3\connectionpool.py", line 841, in urlopen
retries = retries.increment(
method, url, error=new_e, _pool=self, _stacktrace=sys.exc_info()[2]
)
File "D:\.venv\Lib\site-packages\urllib3\util\retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/models/e5-large-instruct/revision/main (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1028)')))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "D:\docs\autointent_test.py", line 171, in <module>
preds = loaded_pipeline.predict(utterances)
File "D:\.venv\Lib\site-packages\autointent\_pipeline\_pipeline.py", line 362, in predict
scores = scoring_module.predict(utterances)
File "D:\.venv\Lib\site-packages\autointent\modules\scoring\_linear.py", line 137, in predict
features = self._embedder.embed(utterances, TaskTypeEnum.classification)
File "D:\.venv\Lib\site-packages\autointent\_wrappers\embedder.py", line 196, in embed
hasher.update(self._get_hash())
~~~~~~~~~~~~~~^^
File "D:\.venv\Lib\site-packages\autointent\_wrappers\embedder.py", line 106, in _get_hash
commit_hash = _get_latest_commit_hash(self.config.model_name)
File "D:\.venv\Lib\site-packages\autointent\_wrappers\embedder.py", line 55, in _get_latest_commit_hash
commit_hash = huggingface_hub.model_info(model_name, revision="main").sha
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\.venv\Lib\site-packages\huggingface_hub\utils\_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "D:\.venv\Lib\site-packages\huggingface_hub\hf_api.py", line 2637, in model_info
r = get_session().get(path, headers=headers, timeout=timeout, params=params)
File "D:\.venv\Lib\site-packages\requests\sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
File "D:\.venv\Lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "D:\.venv\Lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "D:\.venv\Lib\site-packages\huggingface_hub\utils\_http.py", line 96, in send
return super().send(request, *args, **kwargs)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\.venv\Lib\site-packages\requests\adapters.py", line 698, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/models/e5-large-instruct/revision/main (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1028)')))"), '(Request ID: 90dcab73-8be7-4a56-99ef-94eb828d38a4)')