Releases: explosion/spacy-transformers
v1.3.8: Fix wheels on v1.3.7 release
v1.3.7 updates the transformers pin to allow use of new models such as ModernBERT. However there was an error in the wheel publication. This release corrects it.
v1.3.6
v1.3.5
v1.3.4
- Extend support for transformers to v4.36.
v1.3.3
- Drop support for Python 3.6.
- Extend support for transformers to v4.35.
v1.3.2
- Extend support for transformers to v4.34.
v1.3.1
This release addresses incompatibilities related to saving and loading models across a range of transformers
versions following changes in transformers
v4.31.
- Extend support to transformers v4.33 (#402).
- Add fallback to load
state_dict
withstrict=False
, due to incompatibilities related tostate_dict
keys betweentransformers
v4.30 and v4.31 (#398).
Options for improved pipeline package compatibility
If you are packaging models with spacy package
and you'd like to avoid having your users run into the fallback strict=False
loading and warnings related to state_dict
keys, you may want to add a stricter transformers
requirement that corresponds to the version used during training.
If you're training with the newest supported transformers
version (v4.33.x), you could currently add transformers>=4.31
to your package requirements. Note that this would restrict your users to Python 3.8+ and PyTorch 1.9+ due to transformers
requirements.
Create meta.json
with your additional requirements:
{
"requirements": ["transformers>=4.31"]
}
Package with spacy package
:
spacy package --meta meta.json input_dir output_dir
The requirement transformers>=4.31
will be added to any other package requirements that are automatically determined based on your pipeline config.
v1.3.0
NOTE: This release has been yanked on PyPI because of the incompatibilities between saved pipelines for transformers
v4.30 and v4.31. Please use spacy-transformers
v1.2.x instead.
-
Update build constraints to use numpy v1.25+ for python 3.9+ (#394).
-
Extend support for transformers up to v4.31 (#395).
⚠️ After upgrading totransformers
v4.31+ you may not be able to load certain older saved pipelines. All older saved models can still be loaded withtransformers<4.31
or you can retrain your models so they are compatible with newer versions oftransformers
(#395).If you have created packages with
spacy package
usingspacy-transformers
v1.2 or earlier, those package requirements should be restricted to compatible versions oftransformers
and should not require updates.
v1.2.5
- Extend support for transformers up to v4.30.x.
v1.2.4
- Extend support for transformers up to v4.29.x.