Hey all, trying to use Gemini via Vertex api with Llamaindex, getting this error, even though I've commented out all system priompt assignments in the code: "Gemini model don't support system messages". https://docs.llamaindex.ai/en/stable/examples/llm/vertex.html Any thoughts?
Hmm? Do you think it's related to make down tables? I don't think I'm using any tables. I did move my system message content to the actual message but it's just raw text in there. Are others able to use Gemini without issue?
No I moved on to a different model for the moment. My suspicion is that it might be due to the system prompt tag still being sent in the context from llama index regardless of whether you populated or not, which seems like it would be a bug, but Logan said that they had a hard time tracking it down, which made it sound like it was an inconsistent one if so
