Find answers from the community

Home
Members
Steven Tobias
S
Steven Tobias
Offline, last seen 4 months ago
Joined September 25, 2024
Following this tutorial... https://docs.llamaindex.ai/en/stable/examples/index_structs/struct_indices/SQLIndexDemo.html#plug-into-our-retrieverqueryengine

and I see that the llm and service_context are instantiated, but then never used.
Plain Text
llm = OpenAI(temperature=0.1, model="gpt-3.5-turbo")
service_context = ServiceContext.from_defaults(llm=llm)


What do these objects do?
2 comments
L
S
Has anyone run with mistral? Getting some validation errors when I input my own model name in the openai constructor.

Plain Text
model='Mistral-7B-Instruct-v0.1'
llm = OpenAI(api_base=api_base, api_key=api_key, model=model)

returns
Plain Text
ValueError: Unknown model 'Mistral-7B-Instruct-v0.1'. Please provide a valid OpenAI model name in: gpt-4, gpt-4-32k, gpt-4-0613, gpt-4-32k-0613, gpt-4-0314, gpt-4-32k-0314, gpt-3.5-turbo, gpt-3.5-turbo-16k, gpt-3.5-turbo-0613, gpt-3.5-turbo-16k-0613, gpt-3.5-turbo-0301, text-davinci-003, text-davinci-002, gpt-3.5-turbo-instruct, text-ada-001, text-babbage-001, text-curie-001, ada, babbage, curie, davinci, gpt-35-turbo-16k, gpt-35-turbo
21 comments
b
S
r
D