Find answers from the community

Updated 3 months ago

Hi, I'm having an issue with

Hi, I'm having an issue with SummaryExtractor returning node summaries attached to the incorrect nodes. The node to which the summary is incorrectly attached seems to be related to the num_workers value but even at 1 worker, I still get misplaced summaries, my code is:
Plain Text
    pipeline = IngestionPipeline(
        transformations=[
            MyCustomNodeTransformer(),
            SummaryExtractor(
                llm=llm,
                metadata_mode=MetadataMode.NONE,
                prompt_template=SUMMARY_EXTRACT_TEMPLATE,
                num_workers=1,
                summaries=["self"],
            ),
            Settings.embed_model,
        ]
    )

    nodes = pipeline.run(
        show_progress=True,
        nodes=nodes,
        num_workers=1,
    )
L
2 comments
thats weird. There was a bug around v0.10.29 that I fixed for this
what version do you have?
Add a reply
Sign up and join the conversation on Discord