can we increase the numbers of workers

which dataset generator? I don't believe we've built in multi processing for any of our generators yet

it was the finetune memorize knowledge one

Yeah, I'm pretty sure that doesn't have num_workers argument yet. We def do want to make these dataset generators more efficient in the future tho.