Bug DescriptionI'm encountering an issue while trying to access the "achat" interface to chat with the Gemini model (gemini-1.5-flash-002) using Vertex AI. The error message I'm receiving is as follows:
ERROR: Unknown field for GenerationConfig: safety_settings
File "/workspaces/CORTEX/.venv/lib/python3.10/site-packages/llama_index/llms/vertex/base.py", line 384, in achat
generation = await acompletion_with_retry(
File "/workspaces/CORTEX/.venv/lib/python3.10/site-packages/llama_index/llms/vertex/utils.py", line 148, in acompletion_with_retry
return await _completion_with_retry(**kwargs)
I suspect this may be an issue with
llamaindex
, potentially due to a recent Google update that affected some configurations. However, I am unsure of the root cause.
Version Details:- llama-index==0.11.14
- llama-index-llms-vertex==0.3.6
- google-ai-generativelanguage==0.6.4
- google-generativeai==0.5.4
Steps to Reproduce:llm = Vertex(...)
chat = await llm.achat(...)
Error: See above.
Relevant Logs/Tracebacks: No response.