I transitioned from LLM OpenAI to AzureOpenAI gpt4o deployment, but I can't get the model to produce more than 1000 tokens. I have not set up max_tokens and confirmed its None in Settings.llm. Not sure what settings im missing here. any one experience the same?
Pretty sure if max tokens isn't set, it sends it as None to the api. Maybe openai handles that differently than azure? Have you tried actually setting it to a value like 2000?
