Find answers from the community

Updated 8 months ago

Has anyone built any Agents with DBRX in

Has anyone built any Agents with DBRX in LlamaIndex? How does it perform? Are there any considerations or issues with the LI abstractions (I understand for a while most of LangChain and LlamaIndex were tilted towards OpenAI)

4 comments

WWhiteFang_Jr

LlamaIndex provides easy abstractions to almost everyting that you can use to create your custom agents.

Also OpenAI is used when nothing is passed in the form of llm or embedding model. If you pass them it will use your settings only!

nno_dice

I'm familiar with the abstraction part - I just wasn't sure if the abstractions were generalized enough to support DBRX like it does OpenAI for example.

Thank you!

WWhiteFang_Jr

Yeah, just need to pass the llm and it will work.

Plain Text

#define the llm here
llm = Your dbrx llm

# Now make the llm global 
from llama_index.core import Settings
Settings.llm = llm

# or pass the llm inside every func
query_engine = index.as_query_engine(llm=llm,..)

nno_dice

Thanks friend 😄

Add a reply