Find answers from the community

Updated 12 months ago

Llm

At a glance

The community member is looking for a dummy large language model (LLM) that fits the llama-index interface. In the comments, another community member suggests using MockLLM from the llama-index library, which repeats the input. Another community member then says they will "monkeypatch" the MockLLM to instead repeat the input and return a key-value response. The original poster thanks the community members for the suggestions.

Does LI have any dummy LLMs that fit the llama-index interface? I'm looking to potentially use one if so
L
n
4 comments
from llama_index.core.lllms import MockLLM
It repeats its input lol
I'll monkeypatch that to instead repeat it, return a key-value response
Add a reply
Sign up and join the conversation on Discord