gameveloster

Openai

Hi, is OpenAIAgent meant for openai models only? I tried several local chat models like mixtral but they do not appear to be able call any of the tools/functions.

2 comments

ggameveloster

How do you set the llm or ServiceContext

How do you set the llm or ServiceContext when using UnstructuredElementNodeParser? Calling node_parser.get_nodes_from_documents method appears to try using OpenAI llm but I want to use something else thats already defined in my service context.

1 comment

ggameveloster

Hi, how do you use

Hi, how do you use HuggingFaceTextGenInference with query_wrapper_prompt?
The only way I can do it is to use the deprecated LLMPredictor

Plain Text

llm = HuggingFaceTextGenInference(...)
query_wrapper_prompt = PromptTemplate("...")
llm_predictor = LLMPredictor(llm=llm, query_wrapper_prompt=query_wrapper_prompt)

This give the warning when used: LLMPredictor is deprecated, please use LLM instead. and still works for simple cases.

But LLMPredictor cant seem to work with UnstructuredElementNodeParser

Plain Text

node_parser = UnstructuredElementNodeParser()
node_parser.llm = self.llm_predictor

Doing the above gives the error ValueError: "LLMPredictor" object has no field "callback_manager"
Any advice please? Thanks

4 comments

ggameveloster

Agents

Is there a collection of system prompts for prompting ReactAgent? I cant seem to get any models to use the tools or have half-decent reasoning in conversations over a few messages, except for gpt4.
I'm trying to avoid using openai models

5 comments

Find answers from the community

Openai

How do you set the llm or ServiceContext

Hi, how do you use

Agents