Find answers from the community

s
F
Y
a
P
Updated 2 years ago

How would we go about defining a custom

How would we go about defining a custom method for creating nodes from a given document? Is there some way of defining a custom/alternate TextSplitter (https://github.com/jerryjliu/gpt_index/blob/main/gpt_index/langchain_helpers/text_splitter.py)?
j
M
S
3 comments
this is a WIP! we're working to make that part more modular so you can plug in other text splitters
You can use these as well https://langchain.readthedocs.io/en/latest/reference/modules/text_splitter.html and feed the chunks as individual documents to llama-index
Super! Thank you!
Add a reply
Sign up and join the conversation on Discord