this post was submitted on 16 Aug 2023
1 points (100.0% liked)

Machine Learning

1765 readers
1 users here now

founded 4 years ago
MODERATORS
osipov@lemmy.ml
1
[Solved] PyTorch Lightning is bottlenecked by the CPU (lemmy.ml)
submitted 1 year ago* (last edited 1 year ago) by kernelPanic@lemmy.ml to c/machinelearning@lemmy.ml
0 comments fedilink hide all child comments
 

When I train my PyTorch Lightning model on two GPUs on jupyter lab with strategy="ddp_notebook", only two CPUs are used and their usages are 100%. How can I overcome this CPU bottleneck?

Edit: I tested with PyTorchProfiler and it was because of old ssds used on the server

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here