LlamaIndex

Log inLog into community

Find answers from the community

Updated 3 months ago

I have been given access to the Cohere

I have been given access to the Cohere

·

I have been given access to the Cohere reranker through my companies Azure AI studio. I see that I can do inference in LlamaIndex with LLMs in Azure, but can I use the a reranking model in Azure as a node postprocessor, as I would do using from 'llama_index.postprocessor.cohere_rerank import CohereRerank'? I saw a github support inquiry mentioned using 'from llama_index.core.postprocessor import AzureRerank' but it doesn't work. Maybe it was an llm hallucination...

L

S

L

7 comments

Hmm, yea, no azure rerank module exists (yet)

Attachment

you could make one yourself though, the base class is dead simple

we even have a docs page for this

https://docs.llamaindex.ai/en/stable/module_guides/querying/node_postprocessors/#custom-node-postprocessor

Thanks! I was thinking about that. I'll take a look.

Hi @SeaBerg did you make the Cohere reranker through Azure AI studio ?

Not yet. It's on my 'to do' list for getting my proof of concept into production, within the next month or so.

Add a reply

Sign up and join the conversation on Discord