Probably the LLM stopped following

LLogan M

Probably the LLM stopped following instructions and printed some output that langchain couldn't parse

Pretty common error with langchain tbh. The parsing code for that specific agent it here https://github.com/hwchase17/langchain/blob/master/langchain/agents/chat/output_parser.py

Langchain at some post probably needs less-brittle parsing. Not much to do about it besides making a PR or maybe improving the tool instructions
https://github.com/hwchase17/langchain/blob/master/langchain/agents/chat/prompt.py

13 comments

ppikachu8887867

yeah, it sucks... I asked 5 questions and all of them fail with such an exception. I'm really struggling to ask cross-index questions.

When a question requires only one index, it works fine, but when it requires multiple indices, it always fails :/

LLogan M

which LLM are you using?

ppikachu8887867

ChatOpenAI

LLogan M

with gpt-3.5 I'm assuimg? Yea, that model is... not great lately haha I honestly think they downgraded it.

LLogan M

(conspiracy theory to make everyone using text-davinci-003 or gpt-4 LOL)

ppikachu8887867

@Logan M jajajaja. You mean by using OpenAI(model_name="text-davinci-003") , I can overcome the issue?

LLogan M

maybe! But it will cost a bit more 😦 ... 10x more actually 💸

ppikachu8887867

Yeah with gpt-3.5-turbo. Btw, nothing turbo about it lol. It is slow as hell 🙂

ppikachu8887867

@Logan M really waiting for Llama model to become open-source or this model to be published. So we could get rid of openAI addiction 😖

https://www.nextbigfuture.com/2023/04/red-pajama-is-a-1-2-trillion-token-large-language-model.html

LLogan M

so many people making open-source models, but yea most of them are non-commerical 😦

I did actually have some good experience with this one (actually open source/commerical!), assuming you have enough GPU to run it:
https://huggingface.co/Writer/camel-5b-hf

ppikachu8887867

sheeesh! Gonna try that out definitely! I was quite impressed by Vicuna tho, but as you wrote, it is non-commercial 👍

ppikachu8887867

@Logan M wew! Camel goes brrr 💯

Attachment

LLogan M

Hahaha nice!

Add a reply

Find answers from the community

Probably the LLM stopped following