Pinned Loading

1. NVIDIA/TensorRT NVIDIA/TensorRT Public

   NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

   C++ 10.9k 2.1k

2. tensorrt-insight tensorrt-insight Public

   Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda

   C++ 14

3. xinfer xinfer Public

   AI infer engine

   C++ 5

4. llm-deploy llm-deploy Public

   AI Infra LLM infer/ tensorrt-llm/ vllm

   Python 10

5. ocr ocr Public

   OCR related

   C++