Locking Colour Swatches

Is there a way to lock the organization of your colour swatches? There’s so many times where I go to grab a colour and shoot it across the board and start digging for it and have to put it back in place.

If not, this would be a great tweak for future releases.

Thanks