acceleration examples #82

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

tangkangqi wants to merge 2 commits into nvidia-cosmos:main from tangkangqi:feature/acceleration

tangkangqi commented Nov 13, 2025

Description

This PR adds a TensorRT-LLM acceleration example for Cosmos-Reason1, including:

Complete setup guide with Docker instructions
TensorRT-LLM server configuration
Gradio-based web interface for video inference
Benchmark examples
Documentation of known issues

Changes

Added examples/acceleration/README.md with comprehensive setup instructions
Added examples/acceleration/trtllm_infer_web.py for web-based inference
Included example images and documentation

tangkangqi added 2 commits

November 13, 2025 08:43


          add a gradio playground gui with support for trtllm backend service

c463060


          add README.md with step instructions, prompt format, expect output an…

66ced6e

…d issue log

tangkangqi changed the title ~~Feature/acceleration~~ acceleration examples

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet