Chat engines

CCesar

Hey guys! Should this example: https://gpt-index.readthedocs.io/en/latest/examples/chat_engine/chat_engine_openai.html, be compatible with version 0.7.6?

14 comments

LLogan M

It should be, but tbh I haven't confirmed yet personally

Is there an error?

LLogan M

We changed the default chat engine to use an OpenAI function calling agent, or alternatively our react agent

CCesar

yeah

Plain Text

  File "/opt/homebrew/lib/python3.11/site-packages/llama_index/indices/base.py", line 368, in as_chat_engine
    raise ValueError(f"Unknown chat mode: {chat_mode}")
ValueError: Unknown chat mode: openai

LLogan M

And you are sure you have 0.7.6? I'll check with a fresh env to confirm

CCesar

this is my code:

Plain Text

from llama_index import VectorStoreIndex, SimpleDirectoryReader, ServiceContext
from llama_index.llms import OpenAI

# Necessary to use the latest OpenAI models that support function calling API
service_context = ServiceContext.from_defaults(llm=OpenAI(model="gpt-3.5-turbo-0613"))
data = SimpleDirectoryReader(input_dir="./data/").load_data()
index = VectorStoreIndex.from_documents(data, service_context=service_context)

chat_engine = index.as_chat_engine(chat_mode="openai", verbose=True)

while True:
    text_input = input("User: ")
    response = chat_engine.chat(text_input)
    print(f'AI Assistant: {response.response}')

LLogan M

Hmmm actually it looks like this was merged in after 0.7.6

LLogan M

But it updated the docs

LLogan M

Oof

CCesar

Plain Text

pip freeze | grep llama-index
llama-index==0.7.6

CCesar

okay

LLogan M

Can you install from source?

pip install --upgrade git+https://github.com/jerryliu/llama_index

CCesar

sure

CCesar

Yeah, it works from the source. Thx

LLogan M

Nice, should have the release on PyPI soon too 🙏

Add a reply

Find answers from the community

Chat engines