Log in
Log into community
Find answers from the community
View all posts
Related posts
Was this helpful?
π
π
π
Powered by
Hall
Active
Updated 4 days ago
0
Follow
llama_index/llama-index-core/llama_index...
llama_index/llama-index-core/llama_index...
Active
0
Follow
p
pablonm
4 days ago
Β·
Hi there! I observed that ChatSummaryMemoryBuffer crashes for Anthropic due to sending a single message with role system and no message with role user. when reading the code here:
https://github.com/run-llama/llama_index/blob/90761a9f789bb7628d4faf40ae900d93f16065b7/llama-index-core/llama_index/core/memory/chat_summary_memory_buffer.py#L272
I'm seeding that it's sending the context as role system but doesn't send the system prompt instruction to summarize the context. In the image attached I fixed it and it works perfect for me. Is the current implementation bugged?
Attachment
L
p
3 comments
Share
Open in Discord
L
Logan M
4 days ago
Feel free to make a PR -- probably a bug tbh
p
pablonm
edited 4 days ago
Thank you. created this PR:
https://github.com/run-llama/llama_index/pull/17845
L
Logan M
4 days ago
cool thanks π
Add a reply
Sign up and join the conversation on Discord
Join on Discord