Find answers from the community

Updated 7 months ago

In text

Has anyone succesfully used in-text citations (i.e. CitationQueryEngine) with memory, i.e. an agent or chat engine? I know I can get the source nodes from the result, that is not what I am asking, I am looking for the in-text citations portion.
The only way I can think of is by creating my own Query Pipeline which seems rather complex for this.

2 comments

LLogan M

In text is hard, and tbh relying on the LLM to cite properly is also hard.

You could use the citation query engine with an agent and use return_direct=True on the tool so that the response isn't rewritten

My personal approach for this is to compare the source nodes with the response, and do some fuzzy matching per sentence in each

FFalven

Thanks Logan!

Add a reply