Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure OpenAI using print_response streaming error #1066

Open
fengruozhu opened this issue Jul 24, 2024 · 3 comments
Open

Azure OpenAI using print_response streaming error #1066

fengruozhu opened this issue Jul 24, 2024 · 3 comments

Comments

@fengruozhu
Copy link

When using print_response, using Azure models, get this issue:
raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'error': {'message': "Unknown parameter: 'stream_options'.", 'type': 'invalid_request_error', 'param': 'stream_options', 'code': 'unknown_parameter'}}

only if "stream=False" will work.

@zzstarfish
Copy link

same here! BTW, Where did you add stream=False? @fengruozhu

@fengruozhu
Copy link
Author

This will do as a temporary patch
assistant.print_response(query, markdown=True, stream=False)

@Ghat0tkach
Copy link

because azure doesnt support stream options https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants