Find answers from the community

Updated 10 months ago

Hey is it possible to delete/remove/

At a glance
Hey is it possible to delete/remove/disable nltk. I updated to llama-index 0.10.26 and my deployments are failing because of "Resource stopwords not found.". It used to work fine before the update and afaik Im not using any nltk functionalities, at least not directly? Does anyone know a fix for this?
L
M
5 comments
Its not possible, but the nltk resources should be included in the build
pretty surprised to see this, unless you are using some specific feature that isn't bundled (well either that, or the last release missed bundling the resources, not sure)
Are you doing anything weird to install? In a fresh google colab install, the stopwords are bundled properly without any downloading
https://colab.research.google.com/drive/1Gak98LdYYF0V_EhKCb6Veh_wbmSfVaBB?usp=sharing
sorry was a long day yesterday haha
got it fixed by adding th following in my dockerfile:
Plain Text
...
ENV NLTK_DATA="/opt/nltk_data"
...
RUN python -c "import nltk; nltk.download('stopwords', download_dir='/opt/nltk_data'); nltk.download('punkt', download_dir='/opt/nltk_data')"
...
Add a reply
Sign up and join the conversation on Discord