Find answers from the community

Updated 6 months ago

is there a way to get this working with

At a glance

The community member posted a question asking if there is a way to get something working with a client library instead. The comments suggest that the community members are discussing using the ollama-python client library to implement the desired functionality. One community member suggests creating a custom LLM (Large Language Model) class to use the ollama client, and another mentions that this would require a pull request to use the client library instead of making HTTP requests. The comments also indicate that the community members are wondering about the differences between the two approaches.

Useful resources
is there a way to get this working with the client library instead?
Attachment
image.png
W
L
L
5 comments
Which client library ?
You can make a custom LLM class where you can implement this using ollama client
That would have to be a PR to use it under the hood instead of http requests
I wonder what the diffrence would be though?
Add a reply
Sign up and join the conversation on Discord