Find answers from the community

Updated 10 months ago

is there basten intergation langchain

is there basten intergation langchain isnt working for me

import requests

resp = requests.post(
"https://model-nwx4707q.api.baseten.co/production/predict",
headers={"Authorization": "Api-Key YOUR_API_KEY"},
json="MODEL_INPUT",
stream=True
)

for content in resp.iter_content():
print(content.decode("utf-8"), end="", flush=True)

3 comments

LLogan M

there is not, but you could just implement your own LLM class

DDangFutures

@Logan M just follow the example?

LLogan M

yessir, there is an example in the docs here
https://docs.llamaindex.ai/en/stable/module_guides/models/llms/usage_custom.html#example-using-a-custom-llm-model-advanced

Add a reply