The community member is asking if it is possible to create a chat agent (chatbot) using a local Large Language Model (LLM) like LlamaCPP, and provides an example of using an OpenAI LLM instance. In the comments, another community member suggests using the React Agent for Open-Source Software (OSS) models, and provides a link to the relevant documentation.
Is it possible to create a chat agent (chatbot) with a local LLM (e.g. llm = LlamaCPP(...))?
With an OpenAI LLM instance, I do this
Plain Text
llm = OpenAI(model="gpt-3.5-turbo-0613")
agent = OpenAIAgent.from_tools([weather_tool], llm=llm, verbose=True)
response = agent.chat(
"What's the weather like in San Francisco, Tokyo, and Paris?"
)
