Find answers from the community

Updated 3 months ago

Guidance

how I can use Guidance Question Generator with Bedrock ? https://docs.llamaindex.ai/en/latest/examples/output_parsing/guidance_sub_question.html#

4 comments

LLogan M

I dont think so. Guidance only supports LLMs from the guidance package.

LLogan M

Would have to check their docs

JJeff

this implementation is not the option for other LLMs https://github.com/run-llama/llama_index/blob/main/llama_index/question_gen/llm_generators.py ?

LLogan M

Yea, thats what I would use for other llms. It's just asking the LLM to write JSON though, so it can be flaky depending on the LLM you are using.

That module gets used automatically by the sub question query engine if you aren't using OpenAI

Add a reply