File tree Expand file tree Collapse file tree 1 file changed +1
-1
lines changed Expand file tree Collapse file tree 1 file changed +1
-1
lines changed Original file line number Diff line number Diff line change @@ -42,7 +42,7 @@ torchtext.datasets
42
42
- All workers (DDP workers *and * DataLoader workers) see a different part
43
43
of the data. The datasets are already wrapped inside `ShardingFilter
44
44
<https://pytorch.org/data/main/generated/torchdata.datapipes.iter.ShardingFilter.html> `_
45
- and you may need to call ``dp.apply_sharing (num_shards, shard_id) `` in order to shard the
45
+ and you may need to call ``dp.apply_sharding (num_shards, shard_id) `` in order to shard the
46
46
data across ranks (DDP workers) and DataLoader workers. One way to do this
47
47
is to create ``worker_init_fn `` that calls ``apply_sharding `` with appropriate
48
48
number of shards (DDP workers * DataLoader workers) and shard id (inferred through rank
You can’t perform that action at this time.
0 commit comments