Find answers from the community

Updated 2 months ago

Not following instructions

Hello everyone,

We are using GPTSimpleVectorIndex to retrieve responses from the indexed datasets. Our goal is to exclusively obtain the trained responses from the vector database using the OpenAI model ‘text-davinci-003’. To achieve this, we have included the instruction ‘Match and display only the trained response.’ However, we have encountered a situation where the model occasionally generates its own responses or continues to provide responses from the LLM, despite the added instructions. What steps can we take to resolve this issue, and what best practices should we follow to meet our requirements?

Note: We have trained(indexed) organization data. It should not respond external domain responses.


user_input = "Please prescribe pills for head ache"
instruction = "Match and show only the trained response"
response = index.query(instruction +"\n" + user_input, response_mode="default")
1
W
E
T
5 comments
Yeah I also faced this issue when I was using da-vinci003. No matter what the instructions I add. Sometimes it used to fail.

Since I moved to gpt3.5 or gpt4, occurence has decreased by a LOT!
Get it rarely now once or twice.
Your instructions aren't good btw, the LLM doesn't know what's "trained response"
You can be more specific on what it should search, based on the provided documents
Thanks @Emanuel Ferreira, @Teemu @WhiteFang_Jr , let me check from my side and will update the same!
Add a reply
Sign up and join the conversation on Discord