New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gemma2:2b example #2392

Open

evgenyigumnov opened this issue Aug 3, 2024 · 2 comments

Contributor

evgenyigumnov commented Aug 3, 2024

Hello Sir and Madam,

Do you plan to add the gemma2:2b example?

This model is very small and smart.

Best regards, Evgeny

Collaborator

LaurentMazare commented Aug 19, 2024

This should now be available and the default when using the gemma example!

Contributor Author

evgenyigumnov commented Sep 2, 2024 •

edited

Loading

Thanks a lot! But what about quntinezed mode ? #2450

gemma2:2b quntinezed version have 1.5Gb size! This is amaziong and high quelity!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment