SansV2

Log inLog into community

Find answers from the community

Home

Members

SansV2

Offline, last seen 3 months ago

Joined September 25, 2024

SSansV2

I am currently using GROQ api with llama

I am currently using GROQ api with llama index to rum LLAMA3 70B model. I want to run this model on linux based server. I downloaded the model but dont know how to load it in llama index/groq. I don't want to change the rest of the code besides loading the LLM part. Is it possible to do this?

10 comments

SSansV2

I have a RAG chatbot with memory and I

I have a RAG chatbot with memory and I want to store chat logs so I created chat store like this -

Plain Text

chat_store = SimpleChatStore()

and created memory like this -

Plain Text

memory = ChatMemoryBuffer.from_defaults(
            chat_store=chat_store,
            chat_store_key="user1",
        )

but how can I add new logs every time? I tried to find some insert function but coudn't find it. Also I have to persist chat_store only once and then add data to it right?

12 comments

SSansV2

delete nodes from vector

I am trying to delete nodes from my vector index based on the file from which those nodes are made like i want to delete a specific document nodes. I found this in documentation

Plain Text

delete_ref_doc(ref_doc_id: str, delete_from_docstore: bool = False, **delete_kwargs: Any) -> None

but dont know how to use it or is it even correct way.

38 comments

SSansV2

Hello, I have pretty simple doubt that I

Hello, I have pretty simple doubt that I couldnt figure out how to do it. I am building RAG based chatbot using llama index and I created vector store but now I have to add new docs in that vector store. How can I do that?

7 comments