Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

paddle-lite 当前可以用于大模型部署吗,未来是否有相关的开发计划 #10596

Open
chayliu1991 opened this issue Nov 19, 2024 · 1 comment

Comments

@chayliu1991
Copy link

欢迎您对 Paddle Lite 提出建议,非常感谢您对 Paddle Lite 的贡献!
在留下您的建议时,辛苦您同步提供如下信息:

  • 版本、环境信息
    1)Paddle Lite 版本:请提供您的 Paddle Lite 版本号(如v2.10)或 CommitID
       2)Host 环境:请描述 Host 系统类型、OS 版本,如 Mac OS 10.14、Ubuntu 18.04
       3)预测后端信息:请描述使用的预测后端信息,如 CPU/GPU/NPU/others 加速器
  • 复现信息:如为报错,请给出复现环境、复现步骤
  • 建议描述:请您详细描述,您认为需优化的功能
@yulangz
Copy link

yulangz commented Nov 19, 2024

目前来看,能力是具备的,但是到具体模型的时候,算子可能会缺失,如果有需求,可以提到 #10452

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants