got error while running code: ```# pass wandb

got error while running code:

Plain Text

# pass wandb_callback to the service context
callback_manager = CallbackManager([llama_debug, wandb_callback])
service_context = ServiceContext.from_defaults(llm=OpenAI(model="gpt-3.5-turbo-0613", temperature=0), chunk_size=1024, callback_manager=callback_manager)

8 comments

kkapa.ai

Please stand by @andysingal as I search the knowledge base. I normally take about 20 seconds or so. :wave:

kkapa.ai

----------------------
I'm sorry to hear that you're encountering an error. However, without knowing the specific error message, it's difficult to provide a precise solution.

That said, I can provide some general advice based on the code snippet you've shared and the information from the knowledge sources:

Ensure that you have correctly installed the necessary packages. For instance, you should have installed llama-index-llms-openai and llama-index-callbacks-wandb as shown in the Wandb Callback Handler example ().

Make sure that you have correctly set up the WandbCallbackHandler and LlamaDebugHandler. You can refer to the Wandb Callback Handler example () for the correct setup.

Check the model name you're using with OpenAI. The model name should be one of the supported models. In the examples provided, the model used is gpt-4.

Ensure that you have correctly set up the ServiceContext. You can refer to the Service Context Part 7 () for the correct setup.

If you're still encountering issues, please provide the specific error message you're seeing. This will help in providing a more accurate solution.
----------------------
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
----------------------

aandysingal

@kapa.ai got error

Plain Text

ValueError                                Traceback (most recent call last)
<ipython-input-9-376bc39e3fae> in <cell line: 61>()
     59 
     60 # pass wandb_callback to the service context
---> 61 callback_manager = CallbackManager([llama_debug, wandb_callback])
     62 service_context = ServiceContext.from_defaults(llm=OpenAI(model="gpt-3.5-turbo-0613", temperature=0), chunk_size=1024, callback_manager=callback_manager)

/usr/local/lib/python3.10/dist-packages/llama_index/core/callbacks/base.py in __init__(self, handlers)
     63             for existing_handler in handlers:
     64                 if isinstance(existing_handler, type(new_handler)):
---> 65                     raise ValueError(
     66                         "Cannot add two handlers of the same type "
     67                         f"{type(new_handler)} to the callback manager."

ValueError: Cannot add two handlers of the same type <class 'llama_index.callbacks.wandb.base.WandbCallbackHandler'> to the callback manager.

kkapa.ai

Let me check the knowledge base for you. One moment! :books:

kkapa.ai

----------------------
The error message you're seeing is indicating that you're trying to add two handlers of the same type to the CallbackManager. In this case, it seems you're trying to add two WandbCallbackHandler instances.

The CallbackManager in LlamaIndex is designed to manage different types of callback handlers. Each handler type can only be added once. This is why you're seeing a ValueError when you try to add a second WandbCallbackHandler.

To resolve this issue, you should ensure that each handler you add to the CallbackManager is of a unique type. For example, you might have one WandbCallbackHandler and one LlamaDebugHandler, but not two WandbCallbackHandler instances.

Here's an example of how you might set up your CallbackManager with a WandbCallbackHandler and a LlamaDebugHandler:

Plain Text

llama_debug = LlamaDebugHandler(print_trace_on_end=True)

# wandb.init args
run_args = dict(
    project="llamaindex",
)

wandb_callback = WandbCallbackHandler(run_args=run_args)

callback_manager = CallbackManager([llama_debug, wandb_callback])

This code is based on the examples provided in the Wandb Callback Handler example (). If you're still encountering issues, please double-check your code to ensure you're not adding the same handler type more than once.
----------------------
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
----------------------

aandysingal

@kapa.ai is ServiceContext deprecated?

Plain Text

service_context = ServiceContext.from_defaults(llm=OpenAI(model="gpt-3.5-turbo-0613", temperature=0), chunk_size=1024, callback_manager=callback_manager)

error:

Plain Text

lueError                                Traceback (most recent call last)
<ipython-input-9-376bc39e3fae> in <cell line: 61>()
     59 
     60 # pass wandb_callback to the service context
---> 61 callback_manager = CallbackManager([llama_debug, wandb_callback])
     62 service_context = ServiceContext.from_defaults(llm=OpenAI(model="gpt-3.5-turbo-0613", temperature=0), chunk_size=1024, callback_manager=callback_manager)

/usr/local/lib/python3.10/dist-packages/llama_index/core/callbacks/base.py in __init__(self, handlers)
     63             for existing_handler in handlers:
     64                 if isinstance(existing_handler, type(new_handler)):
---> 65                     raise ValueError(
     66                         "Cannot add two handlers of the same type "
     67                         f"{type(new_handler)} to the callback manager."

ValueError: Cannot add two handlers of the same type <class 'llama_index.callbacks.wandb.base.WandbCallbackHandler'> to the callback manager.

kkapa.ai

Let me check the knowledge base for you. One moment! :books:

kkapa.ai

----------------------
Yes, the ServiceContext in LlamaIndex has been deprecated. The preferred way of setting up the same options is now either globally in the Settings object or locally in the APIs that use certain modules.

Here's how you might set up your settings:

Plain Text

from llama_index.embeddings.openai import OpenAIEmbedding
from llama_index.core.node_parser import SentenceSplitter
from llama_index.llms.openai import OpenAI
from llama_index.core import Settings

Settings.llm = OpenAI(model="gpt-3.5-turbo")
Settings.embed_model = OpenAIEmbedding(model="text-embedding-3-small")
Settings.node_parser = SentenceSplitter(chunk_size=512, chunk_overlap=20)
Settings.num_output = 512
Settings.context_window = 3900

This information is based on the LlamaIndex documentation on migrating from ServiceContext to Settings ().

The error you're seeing is unrelated to the deprecation of ServiceContext. It's caused by trying to add two handlers of the same type to the CallbackManager. You should ensure that each handler you add to the CallbackManager is of a unique type.
----------------------
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
----------------------

Add a reply

Find answers from the community

got error while running code: ```# pass wandb_callback to the service contextcallback_man