Add support for stream_usage in AzureChatOpenAI #28493
KeiKawashima-HEROZ
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Checked
Feature request
AzureChatOpenAI does not support stream_usage, which is in ChatOpenAI.
Azure's API version
2024-10-21
now supports include_usage.See: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chatcompletionstreamoptions
Therefore, AzureChatOpenAI will also support stream_usage.
Motivation
I want to use
usage
from the API response.Proposal (If applicable)
No response
Beta Was this translation helpful? Give feedback.
All reactions