Thanks for taking the time to look at that. I took another look adding a debugging node postprocessor that just tells me what it pulled from the index.
The
stream_chat
call never retrieves nodes, the
chat
call does. Same agent making the same query in both cases.
------- streaming
INFO:httpx:HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
Thought: The user is asking about main supply routes, which seems like a general question. I need to use a tool to help me answer this question.
Action: oplan
Action Input: {"input": "main supply routes", "type": "object"}
------- non-streaming
INFO:httpx:HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
Thought: The user is asking about the main supply routes. I need to use a tool to help me answer the question.
Action: oplan
Action Input: {'input': 'main supply routes', 'type': 'object'}
Batches: 100%|βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ| 1/1 [00:00<00:00, 11.57it/s]
Retrieved nodes:
+ 1625 character node
+ 821 character node
+ 1927 character node
INFO:httpx:HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
HTTP Request: POST http://cassini:8889/v1/completions "HTTP/1.1 200 OK"
... text for the answer here ...