Replies: 1 comment
-
Hey @Zambito1 👋 The |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The
http_client
has a stream field that allows you to break the response into a series of messages. I am trying to use Benthos to link sources to Ollama, which has a streaming API. I tried using theunarchive
processor, but that will still block until the reply is complete, which is not ideal. Here is what I currently have:The timeout must be set higher than the total response time from the API as well, which (though I have not tested) I assume is not required with the
http_client
timeout
field. Is it possible to do what I want with thehttp
processor?Beta Was this translation helpful? Give feedback.
All reactions