Hi all! I'm playing around with
ComposableGraph
and
DecomposeQueryTransform
but am facing some issues:
- When locally running the example notebook here, after querying with
Compare and contrast the airports in Seattle, Houston, and Toronto.
the decomposed query never queries for Toronto - Using a custom reduced version of the above notebook, sometimes the answer for one of the elements in a comparison query is not synthesized even though the node from its corresponding document is retrieved correctly, as can be seen from calling
response.get_formatted_sources
. E.g.: Querying for Compare Boston's, Houston's and Seattle's population
decomposes the query for each city but the synthesized answer says that Boston's population was not in the context, although one of the retrieved nodes contains the text ...and a population of 675,647 as of 2020...
- Using the same custom notebook from 2, querying for
Compare Boston's, and Houston's population
returns the correct answer, whereas querying for Compare Houston's and Boston's population
(flipping the cities names) can't find Boston's population. I haven't been able to reproduce this one again but it might be related to the previous point
Would really appreciate some guidance 🙏