Find answers from the community

Updated 10 months ago

Hey is it possible to delete/remove/

At a glance

Hey is it possible to delete/remove/disable nltk. I updated to llama-index 0.10.26 and my deployments are failing because of "Resource stopwords not found.". It used to work fine before the update and afaik Im not using any nltk functionalities, at least not directly? Does anyone know a fix for this?

5 comments

LLogan M

Its not possible, but the nltk resources should be included in the build

LLogan M

pretty surprised to see this, unless you are using some specific feature that isn't bundled (well either that, or the last release missed bundling the resources, not sure)

LLogan M

Are you doing anything weird to install? In a fresh google colab install, the stopwords are bundled properly without any downloading
https://colab.research.google.com/drive/1Gak98LdYYF0V_EhKCb6Veh_wbmSfVaBB?usp=sharing

MMilkMilker

sorry was a long day yesterday haha

MMilkMilker

got it fixed by adding th following in my dockerfile:

Plain Text

...
ENV NLTK_DATA="/opt/nltk_data"
...
RUN python -c "import nltk; nltk.download('stopwords', download_dir='/opt/nltk_data'); nltk.download('punkt', download_dir='/opt/nltk_data')"
...

Add a reply