Find answers from the community

Updated 3 months ago

Format response

What is the standard way to format the response sent back? Like to remove the <|im_end|> tags, etc?

5 comments

Are you using a custom llm model? Never seen that tag before

Either way, you should be able to just do some string/regex parsing for that 👌

vvampir

Using AzureOpenAi but the documents i feed from for embedding are not superb either, i don't know if that affects the response

vvampir

I just switched to AzureChatOpenai since i was using chatgpt 3.5 deployment and its much better already

BBioHacker

Can you clarify if you’re getting better results from azure gpt 3.5 compared openai gpt 3.5

vvampir

Sorry for the confusion, I used AzureOpenAI llm then switched to AzureChatOpenAI impl with a chatgpt3.5-turbo deployment and got better results. Never used OpenAi directly

Add a reply