HI, I've been having trouble getting the persist method to work - I keep getting permission denied errors. i'm able to write text files to the directory just fine, just can't save my vector_store, any suggestions?
from llama_index import SimpleDirectoryReader, VectorStoreIndex
documents = SimpleDirectoryReader(".").load_data() index = VectorStoreIndex.from_documents(documents)
i had this working using the openAI api, but now want to move to using a local model - i see different references in the docs so wasn't sure exactly how to point to the local model. I think I'm supposed to set my service_context to 'local' but it's not clear how I then point it to the specific model. This is what I have now... Advice?
#specify a local model from llama_cpp import llama, Llama from llama_index import ServiceContext llm = Llama(model_path=r'C:\Users\erraballiv\Downloads\llama-2-7b.Q5_K_S.gguf') service_context = ServiceContext.from_defaults(llm='local')