Does Llamaindex support JSONmode and

At a glance

The community members are discussing whether Llamaindex supports JSONmode and system prompts when using Groq. The original poster asks if there is a way to send a system prompt and turn on JSON mode. In the comments, a community member shares an example of sending a system message, but they are still unsure about the JSONmode functionality. Other community members suggest that JSONmode may not be explicitly supported, but it could potentially be provided as a keyword argument in the API call. However, there is no definitive answer provided.

ppikachu8887867

Does Llamaindex support JSONmode and system prompt, when using Groq?

In the example given, I see this:

Plain Text

llm.complete(prompt)

is there a way to send a system prompt and turn json mode on?

4 comments

ppikachu8887867

Okay, I can send a system message like this:

Plain Text

messages = [
    ChatMessage(
        role="system", content="You are a pirate with a colorful personality"
    ),
    ChatMessage(role="user", content="What is your name"),
]
resp = llm.chat(messages)

But what about JSONmode?

LLogan M

I don't think it's supported, at least explicitly

Probably you can provide it as a kwarg though that gets passed into the api call

LLogan M

llm.complete(..., json=True) or whichever the option is called

LLogan M

(I don't actually know)

Add a reply

Find answers from the community

Does Llamaindex support JSONmode and