Find answers from the community

Updated last year

How can i see what llm sees through the

At a glance

The community member asked how they can see what an LLM (Large Language Model) sees through a framework. Another community member responded that the LLM only sees the context retrieved from the query along with the query itself. They suggested using an observability tool from llamaindex, such as Arize Phoenix, to check each process and step, and see what goes to the LLM and what comes from it.

Useful resources
How can i see what llm sees through the framework?
W
A
2 comments
LLM only sees the context retrieved from the query along with your query.

You can check each process and what happens in each steps along with what goes to LLM and what comes from LLM using one of the observability tool from llamaindex.
https://docs.llamaindex.ai/en/stable/module_guides/observability/observability.html#arize-phoenix
Ok, will check it out
Add a reply
Sign up and join the conversation on Discord