Common IssuesAzure OpenAI Slow to Stream
Azure OpenAI Slow To Stream
Issue
When using OpenAI hosted on Azure, streaming is slow and in big chunks.
Solution
This is a Microsoft issue. Some users have reported the following solutions:
- Update Content Filtering Settings: OpenAI Azure portal, within Content Filtering (Preview), there's an option to set Streaming mode from Default to Asynchronous Modified Filter.