or change downloading default model to be GGUF models TheBloke uplodes

is there a way to define the size of nodes that documents will be chunked into?

Just a quick question, if we create a ServiceContext.from_defaults() function to pass in a different sentencetransformers model, will VectorStoreIndex.from_documents() function create the embedding data using said different model when passing in documents and that ServiceContext object? specifically using chromadb

Yeah from experience using 4bit llama2 70b it's hallucinating pretty badly. Gotta figure out how to prompt better or to finetune it