For fungi, the color is generally due to pigments excreted into the agar medium; it isn't necessarily present at high concentration in the mycelium, so looking at the colony won't be as effective as looking at the pigment-infused agar.