Files

 main

/

examples

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

alex-jw-brooks

[Core][Frontend] Add Support for Inference Time mm_processor_kwargs (v…

Oct 8, 2024

a3691b6 · Oct 8, 2024

History

History

This branch is 2009 commits behind vllm-project/vllm:main.

/

examples

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
fp8		fp8
production_monitoring		production_monitoring
api_client.py		api_client.py
aqlm_example.py		aqlm_example.py
cpu_offload.py		cpu_offload.py
gguf_inference.py		gguf_inference.py
gradio_openai_chatbot_webserver.py		gradio_openai_chatbot_webserver.py
gradio_webserver.py		gradio_webserver.py
llm_engine_example.py		llm_engine_example.py
logging_configuration.md		logging_configuration.md
lora_with_quantization_inference.py		lora_with_quantization_inference.py
multilora_inference.py		multilora_inference.py
offline_chat_with_tools.py		offline_chat_with_tools.py
offline_inference.py		offline_inference.py
offline_inference_arctic.py		offline_inference_arctic.py
offline_inference_audio_language.py		offline_inference_audio_language.py
offline_inference_chat.py		offline_inference_chat.py
offline_inference_distributed.py		offline_inference_distributed.py
offline_inference_embedding.py		offline_inference_embedding.py
offline_inference_encoder_decoder.py		offline_inference_encoder_decoder.py
offline_inference_mlpspeculator.py		offline_inference_mlpspeculator.py
offline_inference_neuron.py		offline_inference_neuron.py
offline_inference_neuron_int8_quantization.py		offline_inference_neuron_int8_quantization.py
offline_inference_openai.md		offline_inference_openai.md
offline_inference_pixtral.py		offline_inference_pixtral.py
offline_inference_tpu.py		offline_inference_tpu.py
offline_inference_vision_language.py		offline_inference_vision_language.py
offline_inference_vision_language_multi_image.py		offline_inference_vision_language_multi_image.py
offline_inference_with_prefix.py		offline_inference_with_prefix.py
offline_inference_with_profiler.py		offline_inference_with_profiler.py
openai_audio_api_client.py		openai_audio_api_client.py
openai_chat_completion_client.py		openai_chat_completion_client.py
openai_chat_completion_client_with_tools.py		openai_chat_completion_client_with_tools.py
openai_completion_client.py		openai_completion_client.py
openai_embedding_client.py		openai_embedding_client.py
openai_example_batch.jsonl		openai_example_batch.jsonl
openai_vision_api_client.py		openai_vision_api_client.py
run_cluster.sh		run_cluster.sh
save_sharded_state.py		save_sharded_state.py
template_alpaca.jinja		template_alpaca.jinja
template_baichuan.jinja		template_baichuan.jinja
template_blip2.jinja		template_blip2.jinja
template_chatglm.jinja		template_chatglm.jinja
template_chatglm2.jinja		template_chatglm2.jinja
template_chatml.jinja		template_chatml.jinja
template_falcon.jinja		template_falcon.jinja
template_falcon_180b.jinja		template_falcon_180b.jinja
template_inkbot.jinja		template_inkbot.jinja
template_llava.jinja		template_llava.jinja
tensorize_vllm_model.py		tensorize_vllm_model.py
tool_chat_template_hermes.jinja		tool_chat_template_hermes.jinja
tool_chat_template_internlm2_tool.jinja		tool_chat_template_internlm2_tool.jinja
tool_chat_template_llama3.1_json.jinja		tool_chat_template_llama3.1_json.jinja
tool_chat_template_llama3.2_json.jinja		tool_chat_template_llama3.2_json.jinja
tool_chat_template_mistral.jinja		tool_chat_template_mistral.jinja
tool_chat_template_mistral_parallel.jinja		tool_chat_template_mistral_parallel.jinja
View all files