Find answers from the community

Updated 2 months ago

Is it possible to add system prompt in

Is it possible to add system prompt in CitationQueryEngine?

Plain Text

    query_engine = CitationQueryEngine.from_args(
        index=temp_index,
        similarity_top_k=3,
        citation_chunk_size=512,
        system_prompt="Doesn't matter what user asks, always reply with: `I love bananas`"
    )

doesn't matter what I ask, it is not outputting I love bananas

1 comment

ppikachu8887867

I see, seems like I need to declare system prompt during llm initialization.

Plain Text

Settings.llm = OpenAI(api_key="sk-...", model="gpt-4o",
                      system_prompt="Doesn't matter what user asks, always reply with: `I love bananas`")

This time it works.

Out of scope, but I have a question: while building a webapp, is it correct to initialize a llm on endpoint (function) level? Now, I am initializing it globally (in module level).

Add a reply