Logging the actual prompt sent to the llm

Question

Hello! Is there a way to log the actual prompt that was sent to the LLM? I.e. including chunks from the vector store etc?

WhiteFang_Jr · Answer

Hey, Yes you can check all using instrumentation module: https://docs.llamaindex.ai/en/stable/examples/instrumentation/instrumentation_observability_rundown/

kristian · Answer

Thank you very much!

Find answers from the community

Logging the actual prompt sent to the llm