Find answers from the community

Updated 2 years ago

Hey folks has anoyone tried to use

At a glance
Hey folks, has anoyone tried to use LlamaIndex with petals.dev? They're distributed models are transformer models, but haven't been able to figure out how to get them working in LlamaIndex yet because it's not as simple as specifiying path to a HF model. I have a feeling I'm going to have to write my own custom model. Any thoughts?
A
1 comment
Ha. I got it. It's just a HF model but you can specify the model and tokenizer as an argument to the ctor. Neat.
Add a reply
Sign up and join the conversation on Discord