LlamaIndex
Log in

Find answers from the community

Updated 12 months ago

in our current flow we take the topk

At a glance
sshakedbuk
·
in our current flow we take the topk nodes that are returned and then we pass to the llm so I would rank them, is there a built in way to pass all the nodes to the llm and prompt it to rank them based on some context?
L
s
6 comments
LLogan M
you can try rankGPT

https://docs.llamaindex.ai/en/stable/examples/node_postprocessor/rankGPT.html#rankgpt-reranker-demonstration-van-gogh-wiki
sshakedbuk
is there a ts solution?
LLogan M
Ah, sadly not in the TS package (yet)
sshakedbuk
i see cohere is supported, is this not a solution for this? and also really thankful for you answers!
LLogan M
Oh did cohere get added to TS? Yea that would definitely work!
LLogan M
(I work mainly on the python repo, so I lose track of the TS features sometimes lol)
Add a reply
Sign up and join the conversation on Discord