Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check whether avx2 instruction set is supported for linux binary #3694

Open
wsxiaoys opened this issue Jan 14, 2025 · 2 comments
Open

Check whether avx2 instruction set is supported for linux binary #3694

wsxiaoys opened this issue Jan 14, 2025 · 2 comments
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@wsxiaoys
Copy link
Member

Please describe the feature you want
Before running llama-server binary.

Additional context
Code location:

let handle = tokio::spawn(async move {


Please reply with a 👍 if you want this feature.

@wsxiaoys wsxiaoys added the enhancement New feature or request label Jan 14, 2025
@wsxiaoys wsxiaoys added the good first issue Good for newcomers label Jan 14, 2025
@Evalir
Copy link

Evalir commented Jan 15, 2025

i'd like to take this (replied). What would be the outcome of the check here? any additional info helps :)

@wsxiaoys
Copy link
Member Author

i'd like to take this (replied). What would be the outcome of the check here? any additional info helps :)

On Linux build - when avx2 instruction is not supported, generated a warning messages saying llama-server would likely fail with default binary distribution

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants