Find answers from the community

Updated 10 months ago

Are there any dummy/monkey objects I can

Are there any dummy/monkey objects I can use for testing? For example, a dummy vector store for which I can test retrievers on?

15 comments

LLogan M

Are you trying to test accuracy of retrievers? Or just the general operation?

nno_dice

operation.

nno_dice

Like, these are unit tests on their functionality. I'm not evaluating them

nno_dice

Or thats what I intend to use them for.

LLogan M

I would just make an index on the fly, using a mock embedding model and mock llm

Plain Text

from llama_index import ServiceContext, VectorStoreIndex, Document

service_context = ServiceContext.from_defaults(llm=None, embed_model=None)

index = VectorStoreIndex.from_documents([Document.example()], service_context=service_context)

retriever = index.as_retriever()

nodes = retriever.retrieve("query")

LLogan M

(replacing as_retriever() with the retriever you are testing)

nno_dice

Ah that works. Thank you!!!

nno_dice

Wait, does this Document.example() function actually generate dummy/sample docs?

LLogan M

it generates a static document 🙂

LLogan M

Very handy actually haha

nno_dice

That works too