MLC LLM：Everything runs locally with no server support and accelerated with local GPUs on your phone and laptop

[haiker2011]

https://github.com/mlc-ai/mlc-llm

https://mlc.ai/mlc-llm/

[haiker2011]

[haiker2011]

Everything runs locally with no server support and accelerated with local GPUs on your phone and laptops. mlc-ai/mlc-llm#15 include:

iPhone, iPad;
Android phones;
Apple Silicon and x86 MacBooks;
AMD, Intel and NVIDIA GPUs via Vulkan on Windows and Linux;
NVIDIA GPUs via CUDA on Windows and Linux;
WebGPU on browsers (through companion project WebLLM).