Is there a way to add additional logging

You can check the chunks in the response object

response.soure_nodes

My response is just text, and I'm using agents so I want to see what info they are getting from tools and how they are reasoning about that info

well, no (easy) way to log -- youd have to use an existing callback handler (I would use arize, openllmetry) or write your own

https://docs.llamaindex.ai/en/stable/module_guides/observability/observability.html#partner-one-click-integrations

Okay great thanks!