Releases: the-seeds/imitater
Releases · the-seeds/imitater
v0.2.4: Patch release
v0.2.3: Patch release
v0.2.2: OpenAI models, Config docs
New features
- Support OpenAI models
- Add configuration instruction
v0.2.0: Multi-LLM Serving, Infinity Backend
New features
- Support deploying multiple language models in a unified server
- Use infinity backend for embedding service
What's Changed
- Bump up vllm version to v0.3.0