Find answers from the community

Updated 5 months ago

Arize

At a glance

A community member is new to LlamaIndex and is trying to set up observability using the integrations mentioned in the LlamaIndex documentation. They have tried Phoenix, DeepEval, and Wandb integrations, but all of them are failing. Other community members suggest using the Arize integration, providing installation instructions. However, the Arize integration is also not working for some community members. They discuss different methods of setting up the callback manager, and one community member eventually finds a solution by moving the global handler configuration to the entrypoint of their application.

Useful resources
hello all. I'm new to llama index and trying to get some observability. Is this page up-to-date? https://docs.llamaindex.ai/en/stable/module_guides/observability/observability.html I've tried phoenix, deepeval, and wandb integrations on this page and all are failing. thanks!
L
g
11 comments
With v0.10.x, some may need updating, but I know arize works!
Plain Text
pip install -U "llama-index-callbacks-arize-phoenix>=0.1.2" "openinference-instrumentation-llama-index>=1.0.0" "arize-phoenix>=3.0.3"
Arize is not working here @Logan M you're using the set_global_handler or the from phoenix.trace.llama_index import OpenInferenceTraceCallbackHandler() ?
I'm using the 2nd option and it did not work
I used the global handler and arize's UI
Whats wrong with the open inference thing?
for some reason it's tracing/showing only the embeddings calls, the inference/completion are not shown despite happening on run time
Attachment
Screenshot_2024-02-19_at_20.14.13.png
I tried switching methods of activating the API and in the end it's the same thing under the hood
how did you setup the callback manager? Can you share some code?
Nevermind, you just sparkled me the solution. I had configured within my API route action method for setting the global handler inside the action. I moved to my entrypoint main.py and it worked like a charm!
Nice! πŸ’ͺ
Add a reply
Sign up and join the conversation on Discord