Since it's a domain-specific dataset, and in particular textures, you can do many augmentations to get more out of it… Training at 256×256, that's approximately 27,6k unique patches and with flip/rot augmentations about 221k! (Training random patches works even better.)
Data Augmentation Techniques for Texture-based Model Training
By
–