Find answers from the community

Updated 3 months ago

Hello guys~ I need some help,,

Hello guys~ I need some help,,
LlamaIndex keeps repeating the same responses or generating odd responses after completing an answer. I think it might be trying to fill up the maximum token length. What should I do?

Attachment

4 comments

LLogan M

what llm are you using?

hhyunjung0906

i"m using llama3.1-instruct, and sentence-transformer(bert)

LLogan M

How did you setup the llm? Ollama?

hhyunjung0906

like this

Attachment

Add a reply