Hi @Logan M I am currently working on a project involving document processing and integration with an LLM. I am unsure about the correct approach for indexing with VectorStoreIndex. Specifically, I am questioning whether the way I am passing the text_splitter transformation is correct. Are there any improvements or best practices you would recommend?
text_splitter = SentenceSplitter(chunk_size=700, chunk_overlap=10)
# Set up LLM
Settings.llm = OpenAI(model="gpt-3.5-turbo")
index = VectorStoreIndex.from_documents(
documents, transformation=[text_splitter]
)