Find answers from the community

Updated 2 months ago

No text

I believe there is a bug in the factory.py when using ResponseMode.NO_TEXT. I have different deployments with different API keys in Azure. This doesn't work unless I add in the llm=llm parameter to the NoText constructor.

5 comments

LLogan M

Feel free to make a pr, but I think this is because llm is a parameter on the base synthesizer class

LLogan M

You can always pass in MockLLM

LLogan M

Otherwise I'll get to it at some point t

AAndrewRessler

Can you explain how the MockLLM helps? I'm already creating a proper LLM with the appropriate api_key and passing it into get_response_synthesizer. THe problem is when it doesn't paas along any llm to NoText.

LLogan M

I meant like setting the global default to be mock llm Settings.llm = MockLLM() as a workaround

Add a reply