Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
can we increase the numbers of workers
can we increase the numbers of workers
Inactive
0
Follow
D
DangFutures
11 months ago
Β·
can we increase the numbers of workers for the dataset generator
a
D
3 comments
Share
Open in Discord
a
andrei
11 months ago
which dataset generator? I don't believe we've built in multi processing for any of our generators yet
D
DangFutures
11 months ago
it was the finetune memorize knowledge one
a
andrei
11 months ago
Yeah, I'm pretty sure that doesn't have num_workers argument yet. We def do want to make these dataset generators more efficient in the future tho.
Add a reply
Sign up and join the conversation on Discord
Join on Discord