Find answers from the community

Updated 3 months ago

if i manually add embeddings for a

if i manually add embeddings for a document , will this code make those embeddings again?
And will it save to the storage context?
index = VectorStoreIndex.from_documents(
test_docs, storage_context=storage_context, embed_model=embed_model, show_progress=True
)
W
A
16 comments
Yes it will make embeddings for the test_docs
is there a way to skip that process and still make the index?
It doesn't generate any embeddings, i tested witha smaller batch
However, could you help me with something else?
You can make an index with an empty list also
index= VectorStoreIndex.from_documents([],...)

This way it will create an index but it won't have any content in it
The number of test_docs is a lot different from the number of nodes
Attachment
image.png
is there a way to make them similar?
I want a node to have the same content as a document
Test_docs are of type Document
Which are usually one page per document.


Nodes are created to have uniformity in the text size for readability and other stuff.

If you want you can directly create nodes of your own size and then in place of using from_documents you'll have to use node method.
Typing is taking time, as I'm away from the system at present πŸ˜†
i just use from-node? I do not care if they are non uniform
Add a reply
Sign up and join the conversation on Discord