Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q4)
#1487 opened Sep 21, 2024 by Ying1123
Open 9
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

71 Open 593 Closed
71 Open 593 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature] How to accelerate constrained decoding when regex needs to change with input?
#2168 opened Nov 25, 2024 by GrittyChen
2 tasks done
[Bug] cannot import name 'CachedGrammarCompiler' from 'xgrammar' (version 0.3.6)
#2166 opened Nov 25, 2024 by Quang-elec44
5 tasks done
[Bug] llava use image hash as token，leading to cache bug
#2151 opened Nov 24, 2024 by zwc163
5 tasks done
1
[Feature] Support LLaMA-3.2 finetuned with Sentence Transformers !
#2131 opened Nov 23, 2024 by thusinh1969
2 tasks done
[Bug] Unable to load GPTQ Mixtral 8x7 v0.1 with SGLang
#2117 opened Nov 22, 2024 by DhruvaBansal00
5 tasks done
[Bug] Qwen2-VL-7B with sglang Performance Degradation on MME benchmark
#2112 opened Nov 21, 2024 by Mr-Loevan
5 tasks done
@yizhang2077
4
[Feature] Support for rerank models
#2109 opened Nov 21, 2024 by dinhanhx
2 tasks done
1
[Bug] RuntimeError: Failed to allocate memory for batch_prefill_tmp_v with size 435814400 and alignment 16 in AlignedAllocator
#2102 opened Nov 20, 2024 by yuki252111
1 of 5 tasks
1
[Bug] canot load Gemma2 awq
#2099 opened Nov 20, 2024 by Foreist
5 tasks done
[Bug] big TPOT and ITL when running the offline benchmark
#2097 opened Nov 20, 2024 by TraceIvan
5 tasks done
3
[Bug] disk cache io error when simultaneously loading lots of sglang offline engine
#2090 opened Nov 19, 2024 by LeeSureman
5 tasks done
1
[Feature, Performance] kv cache performance improvement
#2087 opened Nov 19, 2024 by HaiShaw
2 tasks done
2
[Bug] Qwen-2.5-Math-7B-Instruct and Llama-3.1-8B-Instruct Produce Nonsensical Results
#2084 opened Nov 18, 2024 by Broyojo
5 tasks done
@ispobock @zhyncs
4
[Feature] TorchAO support for Qwen 32B
#2080 opened Nov 18, 2024 by grahama1970
2 tasks
[Performance] why so many bubbles between steps when running llava-one-vision?
#2076 opened Nov 18, 2024 by sleepwalker2017
[Feature] Add Dockerfile.dev for development purposes backlog
#2060 opened Nov 17, 2024 by zhyncs
2 tasks
@zhyncs
1
[Bug] lmms-lab/llava-onevision-qwen2-7b-ov-chat. Missing file dependencies, no preprocessor_config.json processor_config.json
#2057 opened Nov 17, 2024 by zhangucan
5 tasks done
[BUG] Problems with jump forward decoding grammar-backend
#2045 opened Nov 15, 2024 by merrymercy
1
[BUG] Jump forward w/ outlines backend slightly changes the decoding results grammar-backend
#2025 opened Nov 13, 2024 by merrymercy
[BUG] xgrammar does not follow the constraint grammar-backend
#2017 opened Nov 12, 2024 by merrymercy
5
[Feature] Regex stop condition good first issue Good for newcomers
#2007 opened Nov 11, 2024 by SinanAkkoyun
2 tasks done
1
[Feature] Are there plans to support AWQ and torch compile?
#1991 opened Nov 11, 2024 by sitabulaixizawaluduo
2 tasks done
3
[Bug] how to combine with ray.data
#1987 opened Nov 10, 2024 by mdy666
1 of 5 tasks
2
[Feature] Throughput-aware speculative decoding
#1979 opened Nov 10, 2024 by vkc1vk
2 tasks done
1
[Feature] Is AWQ W4Afp8 supported?
#1964 opened Nov 8, 2024 by vkc1vk
2 tasks done
1
ProTip! Adding no:label will show everything without a label.