These aren't for using - they're just an indicator to show which colors match with the item.
As the other commenters have said, it does filter your wardrobe with the color you pick, however, it's still an experimental feature and I think they have bugs to work out with it.
Hopefully as staff work on the wardrobe, this feature becomes more usable!