'Strange disk I/O with Pytorch multi workers！

I am using pytorch to train networks. But I find dataloader is very slow even with multi workers. After some debug I find that the disk I/O is kind of strange.

As you can see，I have many worke with python command，but the reading speed is 0？Only the mount.ntfs command have all the reading speed which is far from the full speed(>120M/s). Why? Thanks for help!

enter image description here

linuxpytorchntfsdataloader


Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source

Related Questions