Find answers from the community

Updated last year

I have llama2 hosted on my own server

At a glance

I have llama2 hosted on my own server with oobabooga. I've been doing requests.post(url, json=parameters) to get a response. How can I do the same in Llamaindex?

3 comments

LLogan M

Probably implement a custom LLM

https://docs.llamaindex.ai/en/stable/module_guides/models/llms/usage_custom.html#example-using-a-custom-llm-model-advanced

MMike

I barely just found that page myself. Thanks! Hope it's the right solution for me

LLogan M

Yea we don't have an official oobabooga integration, so that will be the next best thing 🙂

Add a reply