Find answers from the community

Updated 3 months ago

Hi here, I am testing localLLm with

Hi here, I am testing localLLm with Ollama, where I am using model phi3:medium/phi3.5. Now I want to restrict the model to only respond from the local database, how should I acheive it

7 comments

WWhiteFang_Jr

You need to try this with setting prompts and then trying

SSumitPandit

thanks, is there any example I can refer

JJake

try adding a context prompt to your chat engine or query engine

JJake

Explicitly state in there for the model to only answer based off of context

JJake

@SumitPandit

SSumitPandit

thanks

SSumitPandit

also, got, one example https://medium.com/rahasak/build-rag-application-using-a-llm-running-on-local-computer-with-ollama-and-llamaindex-97703153db20

Add a reply