Find answers from the community

M
Marii
Offline, last seen 3 months ago
Joined September 25, 2024
Is it possible to apply a 'MetadataFilters' to index.as_retriever() or retriever.retrieve(), similarly to how you would do it in as_chat_engine(filters=)?
2 comments
M
W
Hi everyone,

I would like to use a model hosted on Huggingface TGI together with LlamaIndex and it's chat engine. Additionally I would like to make use of TGI's constrained generation features.

I assume this is the way to use TGI as LLM?
https://github.com/run-llama/llama_index/issues/9532

In this case where would I pass the grammar parameter to the model / is there a way to pass kwargs into chat engine's chat functions that will reach TGI text_generation method?
1 comment
L