vllm API- add regex support #474
Answered
by
rlouf
mjsteele12
asked this question in
Q&A
-
The JSON implementation for vllm API is fantastic! I am opening this discussion to suggest adding regex support since I believe it will be equally useful. IMO one place where local llms really shine is running data ETL/NLP tasks around the clock. This requires guaranteed output structure provided by regex/outlines. For example, something I am working on right now in my RAG pipeline is to add structured/curated metadata derived from text which can be used to drastically reduce the search space. Regex support is crucial for extraction tasks like dates, emails, phone numbers etc. |
Beta Was this translation helpful? Give feedback.
Answered by
rlouf
Jan 4, 2024
Replies: 1 comment
-
Implemented by #481 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
rlouf
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Implemented by #481