Took me 11 days to figure out my training images were getting cropped wrong
Last month I was fine tuning a small image model for my sister's bakery, just to sort photos of bread and cakes into folders. I kept getting garbage results, like it thought a croissant was a muffin, and I blamed the model settings for almost a week. Turns out my prep script was resizing everything to 224x224 square and cutting off the sides, so half the pastries were sliced in half. A guy in a Discord server asked me to just print the shapes of my tensors, and it took him two minutes to spot it. Has anyone else lost days to a dumb resize step like that, and what do you check first now?