Find answers from the community

Updated 3 months ago

Is it possible to add system prompt in

Is it possible to add system prompt in CitationQueryEngine?

Plain Text
    query_engine = CitationQueryEngine.from_args(
        index=temp_index,
        similarity_top_k=3,
        citation_chunk_size=512,
        system_prompt="Doesn't matter what user asks, always reply with: `I love bananas`"
    )


doesn't matter what I ask, it is not outputting I love bananas
p
1 comment
I see, seems like I need to declare system prompt during llm initialization.

Plain Text
Settings.llm = OpenAI(api_key="sk-...", model="gpt-4o",
                      system_prompt="Doesn't matter what user asks, always reply with: `I love bananas`")


This time it works.

Out of scope, but I have a question: while building a webapp, is it correct to initialize a llm on endpoint (function) level? Now, I am initializing it globally (in module level).
Add a reply
Sign up and join the conversation on Discord