Find answers from the community

Updated 6 months ago

user feedback methods

is portkey the only way to collect user feedback with llamaindex? https://github.com/run-llama/llama_index/blob/8151b02fee851c7d9d9912390902c6e784b15233/docs/docs/examples/llm/portkey.ipynb#L37

i'm surprised there isn't anything for arize/traceloop, nor anything in the create-llama that allows for user feedback. just want to make sure i'm not missing something...
r
k
5 comments
also surprised llamahub comes up with nothing:
Attachment
CleanShot_2024-06-19_at_11.59.262x.png
(i would settle for thumbs up/down to start.)
@kapa.ai is portkey the only way to collect user feedback with llamaindex? https://github.com/run-llama/llama_index/blob/8151b02fee851c7d9d9912390902c6e784b15233/docs/docs/examples/llm/portkey.ipynb#L37

i'm surprised there isn't anything for arize/traceloop, nor anything in the create-llama that allows for user feedback. just want to make sure i'm not missing something...
Let me check the knowledge base for you. One moment! :books:
----------------------
Based on the provided knowledge sources, it appears that Portkey's Feedback API is indeed a method for gathering user feedback in LlamaIndex. The API allows for the collection of weighted feedback from users, which can be used to refine and improve models and applications over time. Here's an example of how to use the Feedback API with Portkey:

Plain Text
import requests
import json

# Endpoint URL
url = "<https://api.portkey.ai/v1/feedback">

# Headers
headers = {
    "x-portkey-api-key": os.environ.get("PORTKEY_API_KEY"),
    "Content-Type": "application/json",
}

# Data
data = {"trace_id": "llamaindex_portkey", "value": 1}

# Making the request
response = requests.post(url, headers=headers, data=json.dumps(data))

# Print the response
print(response.text)

(Source: GitHub ())

However, the knowledge sources do not mention any other methods for collecting user feedback with LlamaIndex, nor do they mention integration with Arize or Traceloop. It's possible that other methods or integrations exist, but they are not covered in the provided sources. For a more comprehensive understanding, you may want to refer to the official LlamaIndex documentation or reach out to the developers directly.
----------------------
Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:
----------------------
Add a reply
Sign up and join the conversation on Discord