Skip to content

@vllm-project vLLM

Change the repository type filter

All

    Repositories list

    13 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      amdcudainferencepytorchtransformerllamagptrocmmodel-servingtpu
      Python
      •
      Apache License 2.0
      •5.4k•36k•1.2k•474•Updated Feb 2, 2025Feb 2, 2025

    • production-stack

      Public
      Python
      •
      Apache License 2.0
      •16•120•9•4•Updated Jan 31, 2025Jan 31, 2025

    • llm-compressor

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      sparsitycompressionquantization
      Python
      •
      Apache License 2.0
      •75•916•12•37•Updated Jan 31, 2025Jan 31, 2025

    • buildkite-ci

      Public
      HCL
      •17•8•0•3•Updated Jan 31, 2025Jan 31, 2025

    • vllm-project.github.io

      Public
      HTML
      •
      MIT License
      •7•6•0•1•Updated Jan 30, 2025Jan 30, 2025

    • vllm-blog-source

      Public
      SCSS
      •
      MIT License
      •7•4•0•0•Updated Jan 30, 2025Jan 30, 2025

    • vllm-spyre

      Public
      Community maintained hardware plugin for vLLM on Spyre
      Apache License 2.0
      •0•2•0•0•Updated Jan 29, 2025Jan 29, 2025

    • vllm-ascend

      Public
      Community maintained hardware plugin for vLLM on Ascend
      Apache License 2.0
      •3•12•1•1•Updated Jan 29, 2025Jan 29, 2025

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •1.4k•43•0•8•Updated Jan 26, 2025Jan 26, 2025

    • vllm_allocator_adaptor

      Public
      An adaptor to allow Python allocator for PyTorch pluggable allocator
      C++
      •
      Apache License 2.0
      •0•2•0•0•Updated Jan 5, 2025Jan 5, 2025

    • media-kit

      Public
      vLLM Logo Assets
      0•0•0•0•Updated Dec 12, 2024Dec 12, 2024

    • vllm-nccl

      Public archive
      Manages vllm-nccl dependency
      Python
      •
      Apache License 2.0
      •3•16•2•0•Updated Jun 3, 2024Jun 3, 2024

    • dashboard

      Public
      vLLM performance dashboard
      Python
      •
      Apache License 2.0
      •4•20•0•0•Updated Apr 26, 2024Apr 26, 2024