Find answers from the community

Updated last year

Hi everyone, I'm building a RAG

At a glance
Hi everyone, I'm building a RAG application for complex PDFs and am running into a strange issue where my indexing step is suddenly taking a lot longer than it used to. I am hosting my app on Streamlit community cloud, and indexing still takes a reasonable amount of time there (~45 seconds) whereas it suddenly takes a good couple of minutes+ locally (and shows a lot more progress bars than it used to). The code hasn't changed at all (I also tested this with an earlier version of my code that ran fine locally before), so I'm confused as to what could've caused this. I've tried multiprocessing during my ingestion pipeline to speed things up, but it still doesn't index nearly as fast as it used to. The data I'm using has not changed at all, either. I'm assuming the issue is with my machine or perhaps dependencies, but any ideas would be much appreciated, thanks!
L
a
3 comments
maybe the streamlit cloud machine is just under a heavier load? No idea how those deployments work
hmm, wouldn't that make the Streamlit execution slower?
I'm wondering if this might be caused by other processes taking up CPU %
Add a reply
Sign up and join the conversation on Discord