Find answers from the community

Updated 8 months ago

Simple chat engine and output parsing

Simple chat engine and output parsing doesn't work.
If I do something like

Plain Text

llm = Ollama(
    model="mistral",
)
chat_engine = SimpleChatEngine.from_defaults(
    llm=llm,
    system_prompt=system_prompt,
    output_parser=PydanticOutputParser(output_cls=Choice),
)

The output doesn't get returned in the Pydantic output class. I just get a paragraph from the llm.

3 comments

LLogan M

Right, its a chat engine, it doesn't use a output parser, that kwarg is unused. It. has no instructions to output anything structured

MMarko911__

Is there any way I can do a basic chat with a chat history and ensure structured output ?

MMarko911__

Without using some index or vector store or any data lookup

Add a reply