A native gRPC client & server implementation with async/await support.

Bindings for RDMA ibverbs through rdma-core

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

DeepEP: an efficient expert-parallel communication library

Graphical display of file sizes on terminal

Janus-Series: Unified Multimodal Understanding and Generation Models

Disaggregated serving system for Large Language Models (LLMs).

The Rust package manager

An extremely fast Python package and project manager, written in Rust.

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

CUDA Templates for Linear Algebra Subroutines

List of Rust books

how to optimize some algorithm in cuda.

Official repository of "SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memory"

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Fast, Flexible and Portable Structured Generation

源來適你的各種文章、金句、八卦和文字備份

Library for industrial alignment.

Setuptools plugin for Rust support

Empowering everyone to build reliable and efficient software.

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

Fast low-bit matmul kernels in Triton