CUDA Out of Memory Error When Training Small Datasets — Here’s What’s Actually Wrong
If you’ve ever stared at a RuntimeError: CUDA out of memory message while training what should be a tiny dataset on your local GPU, you know how frustrating it is. The model isn’t even that big. The dataset fits in a CSV. And yet PyTorch or TensorFlow is telling you it can’t allocate another 2 … Read more