Find answers from the community

k
kjanko
Offline, last seen 3 months ago
Joined September 25, 2024
k
kjanko
·

Vector index

It won't because the amount of documents found by the search is limited ( and so is the prompt context ) so by design the task that is being solved by the index is finding an answer within a single document in ideal scenario
6 comments
k
L
LangChain seems to have an implementation for it (https://python.langchain.com/en/latest/modules/models/llms/integrations/huggingface_textgen_inference.html) so this will probably get the job done - will try tomorrow
3 comments
k
L