Hao AI Lab

All

24 repositories

FastVideo
Public
A unified inference and post-training framework for accelerated video generation.
inference post-training distillation video-generation diffusion-models diffusers
Python
•
Apache License 2.0
•233•2.9k•91•15•Updated Jan 3, 2026Jan 3, 2026
DistCA
Public
Efficient Long-context Language Model Training by Core Attention Disaggregation
llm
Python
•4•73•2•2•Updated Dec 29, 2025Dec 29, 2025
hao-ai-lab.github.io
Public
HTML
•20•5•0•0•Updated Dec 23, 2025Dec 23, 2025
d3LLM
Public
d3LLM: Ultra-Fast Diffusion LLM 🚀
inference diffusion efficient-algorithm post-training fast-inference diffusion-models large-language-models llm text-diffusion diffusion-language-models
Python
•2•48•0•0•Updated Dec 19, 2025Dec 19, 2025
JacobiForcing
Public
Jacobi Forcing: Fast and Accurate Diffusion-style Decoding
large-language-models parallel-decoding efficient-llm-inference
Python
•
Apache License 2.0
•2•146•2•0•Updated Dec 18, 2025Dec 18, 2025
dsc204a-f25
Public
Website for DSC 204A, Fall 2025
SCSS
•
Other
•75•0•0•0•Updated Dec 12, 2025Dec 12, 2025
LookaheadReasoning
Public
[NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning
Python
•
Apache License 2.0
•6•56•2•1•Updated Oct 31, 2025Oct 31, 2025
Awesome-Video-Attention
Public
A curated list of recent papers on efficient video attention for video diffusion models, including sparsification, quantization, and caching, etc.
4•52•0•0•Updated Oct 27, 2025Oct 27, 2025
MuxServe
Public
Jupyter Notebook
•
Apache License 2.0
•10•80•4•0•Updated Oct 17, 2025Oct 17, 2025
Dynasor
Public
[NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
llm reasoning-models deepseek-r1
Python
•
MIT License
•27•216•7•2•Updated May 31, 2025May 31, 2025
ComfyUI
Public
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
Python
•
GNU General Public License v3.0
•11k•0•0•0•Updated May 23, 2025May 23, 2025
vllm
Public
A high-throughput and memory-efficient inference and serving engine for LLMs
Python
•
Apache License 2.0
•12k•2•0•0•Updated Apr 24, 2025Apr 24, 2025
env-setup
Public
General repository to setup environments
JavaScript
•0•1•0•0•Updated Apr 14, 2025Apr 14, 2025
dynamo
Public
A Datacenter Scale Distributed Inference Serving Framework
Rust
•
Apache License 2.0
•761•2•0•0•Updated Apr 12, 2025Apr 12, 2025
sglang
Public
SGLang is a fast serving framework for large language models and vision language models.
Python
•
Apache License 2.0
•3.9k•1•0•0•Updated Mar 28, 2025Mar 28, 2025
cse234-w25
Public
Website for CSE 234, Winter 2025
SCSS
•
Other
•75•13•0•1•Updated Mar 24, 2025Mar 24, 2025
cse234-w25-PA
Public
Python
•66•44•1•0•Updated Mar 14, 2025Mar 14, 2025
llmutils
Public
LLM Utils
Python
•0•1•0•0•Updated Mar 13, 2025Mar 13, 2025
LookaheadDecoding
Public
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
Python
•
Apache License 2.0
•77•1.3k•32•1•Updated Mar 6, 2025Mar 6, 2025
Consistency_LLM
Public
[ICML 2024] CLLMs: Consistency Large Language Models
large-language-models efficient-llm efficient-llm-inference
Python
•
Apache License 2.0
•19•410•7•0•Updated Nov 16, 2024Nov 16, 2024
vllm-ltr
Public
[NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
Python
•
Apache License 2.0
•15•66•0•0•Updated Nov 4, 2024Nov 4, 2024
dsc291-PA
Public
Jupyter Notebook
•3•6•0•0•Updated Jun 6, 2024Jun 6, 2024
dsc291-s24
Public
Website for DSC 291, Spring 2024
SCSS
•
Other
•75•1•0•0•Updated Jun 5, 2024Jun 5, 2024
dsc204a-w24
Public
Website for DSC 204a, Winter 2024
SCSS
•
Other
•75•9•0•1•Updated Mar 24, 2024Mar 24, 2024