Machine Learning

When I train my PyTorch Lightning model on two GPUs on jupyter lab with strategy="ddp_notebook", only two CPUs are used and their usages are 100%. How can I overcome this CPU bottleneck?

Edit: I tested with PyTorchProfiler and it was because of old ssds used on the server

Hello Machine Learning Community,

The intention of this post is to replicate a similar tradition from R/machinelearning and to trigger engagement. This post will be created weekly.

What are you reading this week and any thoughts to share?

Hello Machine Learning Community,

The intention of this post is to replicate a similar tradition from R/machinelearning and to trigger engagement. This post will be created weekly.

What are you reading this week and any thoughts to share?

I was looking through papers that combine LLMs and RL and this was pretty fascinating and the citations are perfect for continuing my search.

I'm trying to learning machine learning from a more mathematical/theory side of machine learning just so its easier for me to understand AI/ML papers that are coming out just to keep up with them. I would say that I have a basic understanding of AI/ML but more so on the applied side like in Keras, TF, PyTorch somewhat but I feel like I am lacking on my understanding on the mathematical side of AI/ML. So any books and course recs for that?

This is an effort to get some discussion going.

I remember starting grad school and coming across reddit posts with themes like, "What research area will be hot in the next 10 years?", etc. In retrospect, the comments there were not very informed (talk of graphical models and bayesian non-parametrics). But, the heart of these posts is talking about a research area that you find exciting.

So, tell us what research area is currently exciting to you. Are you starting a new job, project, or graduate program to work on it?

I am looking to replace my old PC, and wondering what other people use.

Do you use your own hardware? If so, what do you have? What do you think gives you the most bang for your buck at the moment?

Do you use the cloud instead? If so, why? Which service(s) do you use?

Thank you!

Interesting article, I wonder how much longer new language models will be detectable like this.