Format response

At a glance

The community members are discussing the standard way to format the response sent back, particularly regarding the removal of <|im_end|> tags. One community member is using AzureOpenAI and is unsure if the quality of the documents they are feeding for embedding is affecting the response. Another community member has switched from using ChatGPT 3.5 deployment to AzureChatOpenAI and has seen better results. There is some confusion around the comparison between Azure GPT 3.5 and OpenAI GPT 3.5, with the community member clarifying that they have only used AzureOpenAI and AzureChatOpenAI, and never directly used OpenAI.

vvampir

What is the standard way to format the response sent back? Like to remove the <|im_end|> tags, etc?

5 comments

LLogan M

Are you using a custom llm model? Never seen that tag before

Either way, you should be able to just do some string/regex parsing for that 👌

vvampir

Using AzureOpenAi but the documents i feed from for embedding are not superb either, i don't know if that affects the response

vvampir

I just switched to AzureChatOpenai since i was using chatgpt 3.5 deployment and its much better already

BBioHacker

Can you clarify if you’re getting better results from azure gpt 3.5 compared openai gpt 3.5

vvampir

Sorry for the confusion, I used AzureOpenAI llm then switched to AzureChatOpenAI impl with a chatgpt3.5-turbo deployment and got better results. Never used OpenAi directly

Add a reply

Find answers from the community

Format response