i struggled a lot with the dependencies

i struggled a lot with the dependencies on this :/

32 comments

Interesting! Are you using venv or conda?

Personally, this will get you a near-perfect setup every time in a fresh environment

Plain Text

conda create --name llama_index python=3.11
conda activate llama_index
pip install flask llama_index

Or if you already have the python version you need installed

Plain Text

python -m venv venv
source venv/bin/activate
pip install flask llama_index

Generally, I use conda when I need specific python versions, since it simplifies the setup

ssmokeoX

i was using conda, to be honest I am looking at just staying on node with langchain 😬 I have been fighting these dependencies for almost 2 weeks

ssmokeoX

wont be as good but its been a major blocker

ssmokeoX

i will try that though

ssmokeoX

the issue is mostly in production, i can get it running locally fine

ssmokeoX

@Logan M is this from the docker template you set up?

LLogan M

Yea! Using that docker template everything worked perfectly when I tested the docker image

ssmokeoX

@Logan M using that conda env, I got the following in my requirements.txt:

Plain Text

certifi @ file:///private/var/folders/sy/f16zz6x50xz3113nwtb9bvq00000gp/T/abs_fdy66ybhuv/croot/certifi_1669749572520/work/certifi

ssmokeoX

this is failing in prod cuz obviously that doesn't exist, but i am curious how this happens

ssmokeoX

1) Is certifi a requirement? and why would it pull from the local file structure in this scenario?

ssmokeoX

yeah man shit is WHACK lol i am cursed

LLogan M

hahaha is that error from your docker image or?

LLogan M

oh wait

LLogan M

how are you building your requirements.txt?

LLogan M

pip freeze?

ssmokeoX

yeah

LLogan M

yea, pip freeze dumps out waaaay too much haha

You have to kind of figure out which top level packages you need, because each top level package installs it's own stuff

LLogan M

In my demo, my requirements.txt is just flask, llama_index, and langchain

ssmokeoX

the only extra requirement i added there was boto3 :sadcat:

LLogan M

Then I would add boto3 to my example requirements.txt, and let pip figure out the rest 💪

ssmokeoX

haha yeah thats what i did! thats why i feel like im going in circles

ssmokeoX

seems like it should be simple to add a requirement, call pip freeze in the new environment with that reuiqmenet, and move on

ssmokeoX

so even if you are in a new virtual env, pip freeze requirements.txt still pulls out arbitrary dependencies from the rest of the system?

LLogan M

yeaaa not so simple haha There's probably a python library out there that reads all your imports and creates a minimum requirements.txt xD

ssmokeoX

haha pure madness

LLogan M

That's why everyone who uses python is a mad scientist 😉

LLogan M

:good_news:

ssmokeoX

well, i guess im learning things :robotshrug:

LLogan M

Not even that they are arbitrary, but just things that the top level packages installed (like certificates!)

ssmokeoX

seems to be working on the prod server atm, i am in shock haha

Attachment

Screen_Shot_2023-03-10_at_3.04.52_PM.png

ssmokeoX

thanks @Logan M 🙏

LLogan M

Nice!! Congrats! 🎉

Add a reply

Find answers from the community

i struggled a lot with the dependencies