Returning an object instead of plain text for generation #1732
RobinPicard
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, Outlines's generation functions return a plain string or a list of strings in the case of batching. This is convenient for end users as they can directly use the output without accessing a specific field, but it's quite constraining for us. There are features for which the possibility to return different things encapsulated in an object would be very useful. I have in mind in particular:
Ideally, the object we would return could be used as a message in the
Chat
input type.Beta Was this translation helpful? Give feedback.
All reactions