LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Hi, this might be an easy one, I am

oogg
·
Hi, this might be an easy one, I am using fast API to allow users to access custom retrievers. I'd want to be able to cache or reuse a retriever if multiple questions are asked to it. how can I achieve that ?
L
o
3 comments
LLogan M
I think you can set globals on the fastapi app object right? app.retrievers = {...} or something?
oogg
so similar to the persist directory ?
LLogan M
uhhh maybe? Like in this case, you are just storing the retriever in memory, as a global
Add a reply
Sign up and join the conversation on Discord