Find answers from the community

G
Goku
Offline, last seen 3 months ago
Joined September 25, 2024
G
Goku
·

Docker

Hi Team and , I've done local dev on llama index and it works fine and now wanting to promote this to this. We build a docker image and while trying to run the image we get a regex package error. Has anyone encountered this error before? It only seems to complain about the regex package and it fails at that and the application crashes.
4 comments
L
G
G
Goku
·

Custom LLM

Hello All, from my understanding, the Llama-index Palm2 abstraction uses the google-generative-ai API to talk to Palm2, is there any way can configure to use the Vertex API instead?
20 comments
S
W
V
G
G
Goku
·

Bm25

Hi Team, I successfully integrated a custom llm using the documentation guide. It works well and as expected with the default querying strategy. However, now I need to enhance retrieval and was looking to implement Hybrid search using BM25 and semantic search your guide from the docs. However, it always asks for an Open AI key (not for embedding). Could not load open ai model etc…
Can someone throw in a few suggestions? Thanks.
12 comments
G
L
G
Goku
·

Custom

Hi Team, I’m using the Custom llm class and want to send out a streaming response. Basically we have a custom llm that hosted and I have an API endpoint that I need to call (Using requests in Python) and return a generator response for streaming. It’s a flask endpoint. Do we have any examples/ documentation for this? Thanks.
1 comment
L
G
Goku
·

Thread

1 comment
L