Skip to content

Commit

Permalink
Support Llama 3.2 conversion (text models) (#33778)
Browse files Browse the repository at this point in the history
* Support Llama 3.2 conversion (text models)

Co-authored-by: Omar Sanseviero <[email protected]>

* Fix rope factor

* Update chat template

Initialize from a well-known template.
The guidance is that the changes should be applied to 3.1 models as
well.

* Remove import

* Support Llama Guard 3 conversion

* Tokenizer details

* Fix eos added token in base models

* Fix generation config for base models

* Specify revision for known tokenizers

* Style

* Reuse chat templates for older models

* Improve error when converting tokenizer < Llama 3

---------

Co-authored-by: Omar Sanseviero <[email protected]>
  • Loading branch information
pcuenca and osanseviero authored Oct 17, 2024
1 parent c1c7e89 commit 7a06d07
Showing 1 changed file with 338 additions and 215 deletions.
Loading

0 comments on commit 7a06d07

Please sign in to comment.