The community member has a query pipeline where each step outputs an intermediate file used as input for the next step. They want to know if there is a way to instruct the pipeline to skip a step and use the available output from a previous run, instead of re-generating the intermediate file. A community member suggests that this may require a custom component and conditional links between two branches of the pipeline.
Hi all, Lets say you have a query pipeline where each step outputs an intermediate file which is used as input for the next step. If you already have one or more of the intermediate files available (for e.g. from a previous failed run), is there a way to instruct the query pipeline to skip that step and just use the available output? Thanks.
