Find answers from the community

Updated 4 months ago

is there a way to use bge large and

At a glance

is there a way to use bge large and anthropic with my existing pinecone index. Its keep using bge small and trying use llama cpp at context service.. also would 10/10 hire logan if i could

5 comments

LLogan M

(LOL Thanks!)

Yea you should be able to! Something like this

Plain Text

from llama_index import ServiceContext, set_global_service_context

service_context = ServiceContext.from_defaults(llm=Anthropic(...), embed_model="local:BAAI/bge-large-en", ...)

set_global_service_context(service_context)

DDangFutures

DUDE THANK YOU was struggling all year

DDangFutures

sorry do i just token limit in the llm

LLogan M

Yea exactly 👍

The embed model is limited to 512 tokens, but that gets handled automatically

DDangFutures

logan the man will hire some day

Add a reply