Does llamaindex 🦙 support google Gemini

CCOdXG

Does llamaindex 🦙 support google Gemini api instead of OpenAI api ?

12 comments

LLogan M

yes

LLogan M

https://github.com/run-llama/llama_index/blob/main/docs/examples/llm/gemini.ipynb

CCOdXG

how can i pass the new llm which is the gemini to the query_engin:

from llama_index.core.llms import Gemini
from dotenv import load_dotenv
import os
import pandas as pd
from llama_index.core.query_engine import PandasQueryEngine
from prompts import new_prompt, instruction_str
from llama_index.llms.gemini import Gemini

GOOGLE_API_KEY = "my-api-is-here";
os.environ["GOOGLE_API_KEY"] = GOOGLE_API_KEY

data_path = os.path.join('data', 'data-info.csv');
data_df = pd.read_csv(data_path);

data_query_engin = PandasQueryEngine(df=data_df, verbose=True, instruction_str=instruction_str);
data_query_engin.update_prompts({'pandas_prompt': new_prompt});
data_query_engin.query("what is the second surah and what is about?")

CCOdXG

@Logan M can you help i want to pass the dat_query_engin that i am using gemini to i want to pass llm=llm but i dont know to defind the llm varible to gemini can you help me i did readed the link you send me but so far no progess?

CCOdXG

do you think this will work:
i pass gemini to the llm:

from llama_index.core.llms import Gemini
from dotenv import load_dotenv
import os
import pandas as pd
from llama_index.core.query_engine import PandasQueryEngine
from prompts import new_prompt, instruction_str
from llama_index.llms.gemini import Gemini

GOOGLE_API_KEY = "api-here";
os.environ["GOOGLE_API_KEY"] = GOOGLE_API_KEY
llm = Gemini()

data_path = os.path.join('data', 'data-info.csv');
data_df = pd.read_csv(data_path);

data_query_engin = PandasQueryEngine(df=data_df, verbose=True, instruction_str=instruction_str,llm=llm);
data_query_engin.update_prompts({'pandas_prompt': new_prompt});
data_query_engin.query("what is the second surah and what is about?")

LLogan M

that should work yes. It doesnt?

CCOdXG

yes it saying cant find gemini import:

ImportError: cannot import name 'Gemini' from 'llama_index.core.llms' (/Users/ahmednadiir/Desktop/agency/localEvir/lib/python3.11/site-packages/llama_index/core/llms/__init__.py)

my code:

from llama_index.core.llms import Gemini
from dotenv import load_dotenv
import os
import pandas as pd
from llama_index.core.query_engine import PandasQueryEngine
from prompts import new_prompt, instruction_str
from llama_index.llms.gemini import Gemini

GOOGLE_API_KEY = "api-is-here";
os.environ["GOOGLE_API_KEY"] = GOOGLE_API_KEY
llm = Gemini()

data_path = os.path.join('data', 'data-info.csv');
data_df = pd.read_csv(data_path);

data_query_engin = PandasQueryEngine(df=data_df, verbose=True, instruction_str=instruction_str,llm=llm);
data_query_engin.update_prompts({'pandas_prompt': new_prompt});
data_query_engin.query("what is the second surah and what is about?")

CCOdXG

@Logan M i install it like this install llama-index-llms-gemini and also like this pip install -q llama-index google-generativeai but somehow still getting this error:

ImportError: cannot import name 'Gemini' from 'llama_index.core.llms' (/Users/ahmednadiir/Desktop/agency/localEvir/lib/python3.11/site-packages/llama_index/core/llms/__init__.py)

WWhiteFang_Jr

You will have to comment the first import

WWhiteFang_Jr

That is causing you the import error

WWhiteFang_Jr

Plain Text

from dotenv import load_dotenv
import os
import pandas as pd
from llama_index.core.query_engine import PandasQueryEngine
from prompts import new_prompt, instruction_str
from llama_index.llms.gemini import Gemini

GOOGLE_API_KEY = "api-is-here";
os.environ["GOOGLE_API_KEY"] = GOOGLE_API_KEY
llm = Gemini()

data_path = os.path.join('data', 'data-info.csv');
data_df = pd.read_csv(data_path);

data_query_engin = PandasQueryEngine(df=data_df, verbose=True, instruction_str=instruction_str,llm=llm);
data_query_engin.update_prompts({'pandas_prompt': new_prompt});
data_query_engin.query("what is the second surah and what is about?")

CCOdXG

what a selly misake thannk you so much man you ar legend

Add a reply

Find answers from the community

Does llamaindex 🦙 support google Gemini