Find answers from the community

Updated 2 months ago

Setting system prompt with nvidia llama model

Hello,
Does anyone know how to set a system prompt when using the NVIDIA class ?

line : llm = NVIDIA(model="meta/llama-3.1-70b-instruct")

I want to use FunctionCallingAgent with the llm above but I couldnt figure how to set a prompt that defines its general purpose.

agent = FunctionCallingAgent.from_tools(
[discovery_tool],
llm=llm,
verbose=True,
)

3 comments

LLogan M

Plain Text

agent = FunctionCallingAgent.from_tools(
    [discovery_tool],
    llm=llm,
    verbose=True, 
    system_prompt="Talk like a pirate in every response."
)

LLogan M

should be that no?

kkere

thanks a lot

Add a reply