Find answers from the community

Home
Members
lucaswillkill
l
lucaswillkill
Offline, last seen 3 weeks ago
Joined January 26, 2025
hello people, i wonder what is every body's choice of what vector database are, i have been trying milvus, anyone else?
2 comments
E
l
l
lucaswillkill
·

Cuda

ImportError: Could not import vllm python package. Please install it with pip install vllm. /home/alice7/.conda/lib/python3.12/site-packages/torch/cuda/__init__.py:129: UserWarning: CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero. (Triggered internally at ../c10/cuda/CUDAFunctions.cpp:108.) return torch._C._cuda_getDeviceCount() > 0
22 comments
L
l
anyone tried to implement a local rag with ollama and llama-index? i personally found llama-index document is very limited and not very useful
30 comments
l
L
is it just me, or this framework is incredibly bad engineered. every single post i am following has countless troubles and implicit problems, with those absolutely horrendous named packages
1 comment
L
ValueError: Failed to load model from file: /tmp/llama_index/models/llama-2-13b-chat.ggmlv3.q4_0.bin
13 comments
L
l