index.insert()
method there is parameter of type Document
but I don't know how it is splitting my new document. If I want to manually define chunk_size
and chunk_overlap
for new documents inserted then how to do it? Or will it just take those parameters directly from already defined index
?index.insert()
takes in a Document
object and chunk it based on the defined set of values. TextNode
object which is the Parent of Document object. from llama_index.core.schema import TextNode node = TextNode(text="<text_chunk>", id_="<node_id>") # Add this node in your index index.insert_nodes([node])
from llama_index.core import Settings Settings.llm # Your Globally defined llm Settings.chunk_size # defined chunk size