Find answers from the community

Updated 11 months ago

Hi everyone, how can I use API-URL as a

Hi everyone, how can I use API-URL as a LLM? Normally this is a post requests. How can I work on this instead of huggingface library model calling?
L
A
7 comments
Hi @Logan M, thanks for reaching out. Here in the place of dummy_response I can give my API-URL, right?
I.e dummy_response= 'HTTP://23.34.56:8001/model'
Am I following right?
Exactly, you would make an api request there
requests.post(url) or what ever your api needs
Thanks, will check that..
@Logan M Btw LLM is not required for building service_context right? If we use LLM how it will develop context, if not used how data will looks like?
Add a reply
Sign up and join the conversation on Discord