Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
Hello Logan M
Hello Logan M
Inactive
0
Follow
T
Thomas1234
last year
Β·
Hello
When using the query engine with streaming set to True on your index how can you avoid having the </S> at the end of your answer ?
Thanks for the help
L
T
5 comments
Share
Open in Discord
L
Logan M
last year
are you using a custom LLM?
T
Thomas1234
last year
Yes I'm using a finetuned version of Llama 2
L
Logan M
last year
hmm, likely your best bet is just removing it with python string parsing haha
T
Thomas1234
last year
Okay thanks ! I was wondering if there a command to remove special tokens π
L
Logan M
last year
HuggingFace has a few utils for it with their tokenizer, but not sure what your setup looks like
Add a reply
Sign up and join the conversation on Discord
Join on Discord