Skip to content

v0.0.1

Latest
Compare
Choose a tag to compare
@bebetterest bebetterest released this 26 Dec 21:19
· 3 commits to main since this release
d2bae36

support:

  • deploy vllm engines on multi-gpu env.
  • vllm caller & TogetherAI caller
  • simple search template

todo:

  • detailed desc
  • more callers