Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kantv NPU #238

Closed
MenghuaZheng opened this issue Jun 26, 2024 · 1 comment
Closed

Kantv NPU #238

MenghuaZheng opened this issue Jun 26, 2024 · 1 comment

Comments

@MenghuaZheng
Copy link

大佬您好,我最近使用kantv在8+Gen1(小米平板)上跑qwen1.8b,cpu、gpu和ggml后端均可以正常测试,但是使用npu后端会出现app闪退或者无法正确测试的情况,是kantv 暂时还不支持 npu后端 还是 我编译或者使用问题的 原因。期待大佬的解答,谢谢。

@zhouwg
Copy link
Owner

zhouwg commented Feb 9, 2025

为了技术交流方便,我将用中文回答您的问题:
请参考这个回答:#239

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants