LlamaIndex
Log in

Find answers from the community

Updated 6 months ago

When I run this locally it works fine. I

LLucas
·
When I run this locally it works fine. I made a custom LLM with a remote API running on my own server and it loops like this anyone else see this error?
Attachment
image.png
L
L
6 comments
LLogan M
looks like its just either hallucinating the entire react sequence, or getting stuck in a loop
LLucas
I found this when first starts up is there anyone I could remote this line in the prompt?
Attachment
image.png
LLucas
@Logan M any reason why u would think it would loop remotely but not locally?
LLogan M
I think I linked to the page about changing prompts in another thread of yours.

No idea why local vs. Server would be different 🤷‍♂️
LLucas
would u know someone who might know?
LLucas
fixed it we were not maintaning context on our end which causes it to loop
Add a reply
Sign up and join the conversation on Discord