LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

How do I output the prompt before it is

ffrauas
·
How do I output the prompt before it is send to the llm for answer generation? I want to check the format and if everything is correct before sending to llm.
L
f
7 comments
LLogan M
https://docs.llamaindex.ai/en/stable/module_guides/observability/observability.html#simple-llm-inputs-outputs
ffrauas
I added it, but when I run a query it just outputs the response. Where do I have to set it to return the prompt ?
Attachment
image.png
LLogan M
you might have to add it at the start of your script, and restart the notebook
ffrauas
It worked, thanks a lot!

Does this handler also output the messagelist of a chat conversation?
LLogan M
It should, assuming the chat() method is being called 👍
ffrauas
Do you know why the prompt is not being updated?
Attachment
image.png
ffrauas
Nevermind I had to move the update call a bit down. Works now. Thank you
Add a reply
Sign up and join the conversation on Discord