Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 35
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

460 Open 673 Closed
460 Open 673 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Error when building wheels on Linux FileNotFoundError: [Errno 2] No such file or directory: 'ninja'`
#1839 opened Nov 23, 2024 by sabaimran
4 tasks done
1
Release the GIL
#1836 opened Nov 18, 2024 by simonw
2
updated from 0.2.90 to 0.3.2 and now my GPU won't load
#1835 opened Nov 17, 2024 by rookiemann
1
Mistral-instruct not using system prompt.
#1832 opened Nov 14, 2024 by AkiraRy
"eval time" and "prompt eval time" is 0.00ms after Ver0.3.0
#1830 opened Nov 12, 2024 by nai-kon
sys:1: ResourceWarning: unclosed file <_io.TextIOWrapper name='nul' mode='w' encoding='cp932'>
#1828 opened Nov 11, 2024 by AkiraRy
llama-server not using GPU
#1826 opened Nov 9, 2024 by RakshitAralimatti
Request for prebuilt CUDA wheels for newer version
#1824 opened Nov 5, 2024 by XJF2332
7
Prebuilt CUDA wheels not working
#1822 opened Nov 5, 2024 by mjwweb
2
AttributeError: function 'llama_sampler_init_tail_free' not found after compiling llama.pcc with hipBLAS
#1818 opened Oct 30, 2024 by Micromanner
2
Specify GPU Selection (e.g., CUDA:0, CUDA:1)
#1816 opened Oct 30, 2024 by RakshitAralimatti
4
[Feature request] High-level API support for DRY and XTC samplers
#1813 opened Oct 28, 2024 by ddh0
2
llama_get_logits_ith: invalid logits id -1, reason: no logits
#1812 opened Oct 28, 2024 by ba0gu0
1
Add support of Qwen2vl
#1811 opened Oct 28, 2024 by PredyDaddy
2
Setting seed to -1 (random) or using default LLAMA_DEFAULT_SEED generates a deterministic reply chain
#1809 opened Oct 24, 2024 by m-from-space
1
Assistant message with tool_calls and without content raises an error
#1805 opened Oct 21, 2024 by feloy
4 tasks done
1
1
low level examples broken after [feat: Update sampling API for llama.cpp (#1742)]
#1803 opened Oct 20, 2024 by mite51
Llama.from_pretrained should work with HF_HUB_OFFLINE=1
#1801 opened Oct 16, 2024 by davidgilbertson
top_p = 1 causes deterministic outputs
#1797 opened Oct 14, 2024 by oobabooga
2
Add reranking support
#1794 opened Oct 14, 2024 by donguyen32
4
Long Context Generation Crashes Google Colab Instance
#1792 opened Oct 12, 2024 by kazunator
server: chat completions returns wrong logprobs model
#1787 opened Oct 6, 2024 by domdomegg
4 tasks done
1
1
Tool parser cannot analysis tool calls string from qwen2.5.
#1784 opened Oct 5, 2024 by hpx502766238
Why is this not working for the current release. UNABLE TO USE GPU
#1781 opened Oct 2, 2024 by AnirudhJM24
1
llama-cpp-python not using GPU on google colab
#1780 opened Oct 2, 2024 by AnirudhJM24
3
ProTip! Exclude everything labeled bug with -label:bug.