Skip to content

Releases: the-seeds/imitater

v0.2.4: Patch release

11 Jun 07:18
Compare
Choose a tag to compare
  • Bump vllm version to 0.4.3 (+torch 2.3.0)
  • Bump infinity_emb version to 0.0.40

v0.2.3: Patch release

24 Feb 17:36
Compare
Choose a tag to compare

v0.2.2: OpenAI models, Config docs

24 Feb 14:30
Compare
Choose a tag to compare

New features

  • Support OpenAI models
  • Add configuration instruction

v0.2.0: Multi-LLM Serving, Infinity Backend

03 Feb 10:21
Compare
Choose a tag to compare

New features

  • Support deploying multiple language models in a unified server
  • Use infinity backend for embedding service

What's Changed

  • Bump up vllm version to v0.3.0