Find answers from the community

Updated 5 months ago

okey, so i have a pipeline with a redis

At a glance

The community member has a pipeline with a Redis cache and wants to know how to remove a specific document from the cache without removing the entire cache. The comments suggest that this is not possible with the current hash-based structure of the cache, as each entry is a hash of the transform step and all input nodes, and there is no way to remove a specific document. The community members discuss potential workarounds, such as ripping apart the run transformations function to return the hash and identify files in the cache, but it's unclear if this would be worth the effort. Ultimately, there is no clear answer provided in the comments.

okey, so i have a pipeline with a redis cache, anyone know how i can remove a document from the cache ? without removing the whole cache ?
L
h
7 comments
Redis cache or redis docstore?

Not really a way to remove a specific document in the hash -- each entry in the cache is hash(transform_step + all input nodes) -> output nodes
With that kind of hash structure, there is no way to "remove" a document
Okey,hmm because it stores a copy of the whole document 😦
Iam using the pipeline to only use the cache then i feed the ”new” nodes i to a seperate chain where i process it
Maybe i can rip apart the run transformations func to return the hash and identify files in the cache that way store them in a seperate hash with file_id has key and hash as value
you definitely could -- I'm not sure if its worth the trouble or not though 🤔 But up to you!
If its worth it, i dont know yet, iam probably just reinventing another wheel…
Add a reply
Sign up and join the conversation on Discord