Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Hi, im doing an app with streamlit and
Hi, im doing an app with streamlit and
Inactive
0
Follow
g
gingerwizard
10 months ago
ยท
Hi, im doing an app with streamlit and llama index and im curious what the recommendation is re which objects to cache and how. What level of thread safety is guaranteed? should i share indexes or engines across requests or create per user session?
L
2 comments
Share
Open in Discord
L
Logan M
10 months ago
hmm, in general, anything thats writing to an object in memory is probably not thread safe. Reads should be fine as far as I know
L
Logan M
10 months ago
If you have a chat engine/agent for example, that has memory, that won't be thread safe
Add a reply
Sign up and join the conversation on Discord
Join on Discord