Find answers from the community

Updated 5 months ago

Agent

At a glance

The community member is wondering if they can use llama2 in the same way as OpenAIAgent.from_tools(). The comments suggest that llama2 may not be the best choice for an agent, but provide an example of using zypher as a local language model for an agent. There is no explicitly marked answer, but the comments provide some guidance on using local language models for agents.

Useful resources

TTungdepzai

Hey, Im using OpenAIAgent.from_tools(), just wondering if I can do the same thing with llama2?

3 comments

LLogan M

You can use the react agent, but llama2 is probably the worst at being an agent

TTungdepzai

can you give some other example that uses local llm for agent pls

LLogan M

We have many examples

Its just about a) setting up the LLM, and b) passing that llm to the agent

Theres an example here using zypher (llm defined at the top, agent at the bottom)
https://colab.research.google.com/drive/1UoPcoiA5EOBghxWKWduQhChliMHxla7U?usp=sharing

Add a reply