Skip to content

Issues: vllm-project/production-stack

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

9 Open 9 Closed
9 Open 9 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Helm Chart Lacks Clear Support for Multi-Node vLLM Deployment
#50 opened Jan 31, 2025 by shohamyamin
2
feat: Offline batched inference based on OpenAI offline batching API
#47 opened Jan 31, 2025 by gaocegege
3
Document how to configure /dev/shm size
#44 opened Jan 30, 2025 by nrober734
1
Fix Installation Steps in vLLM Production Stack Tutorials
#37 opened Jan 29, 2025 by dxu104
3
Pluggable Router Implementations
#36 opened Jan 29, 2025 by danehans
2
feat: Add Ingress configuration
#28 opened Jan 28, 2025 by 0xThresh
1
1
[Roadmap] vLLM production stack roadmap for 2025 Q1
#26 opened Jan 27, 2025 by ApostaC
3 of 13 tasks
9
Is prefix-aware routing implemented in this repo?
#19 opened Jan 24, 2025 by tdoublep
5
Does routing logic works depends on the just QPS of the endpoint?
#16 opened Jan 24, 2025 by pandyamarut
2
ProTip! no:milestone will show everything without a milestone.