Among gravel, sands, silt and clay, these grains have different sizes. Except their original materials, do they appear different colours due to different abilities of reflection?
Take a specimen of basalt and compare it with a gabbro. Both are chemical almost identical and basic igneous rocks. Their mineral assemblage consists of pyroxene, plagioclase and some olivine plus magnetite. The fine-grained basalt is dark and the coarse-grained gabbro shows a bright mottled outward appearrance.
Sandstone sensu lato may contain quartz, feldspar and muscovite. All of them have a bright mineral color. A claystone or siltstone although being enriched in muscovite takes a darker rock color. In some cases it may be due to the presence of organic material which also is of minor particle size.
There are exceptions from the rule as you consider "black sands". These sandstones contain often dark mafic minerals such as ilmenite and magnetite. In this sedimentary rocks the preponderance of the black minerals governs the overall rock color.
Take a specimen of basalt and compare it with a gabbro. Both are chemical almost identical and basic igneous rocks. Their mineral assemblage consists of pyroxene, plagioclase and some olivine plus magnetite. The fine-grained basalt is dark and the coarse-grained gabbro shows a bright mottled outward appearrance.
Sandstone sensu lato may contain quartz, feldspar and muscovite. All of them have a bright mineral color. A claystone or siltstone although being enriched in muscovite takes a darker rock color. In some cases it may be due to the presence of organic material which also is of minor particle size.
There are exceptions from the rule as you consider "black sands". These sandstones contain often dark mafic minerals such as ilmenite and magnetite. In this sedimentary rocks the preponderance of the black minerals governs the overall rock color.
With equal mineralogical composition and dry material, what change is Lightness: finer grains absorb less, and therefore they look clearer. In the CIEL*a*b* color space I did not find significant changes in a* or b* values. But if you have different results, I'd like to see them.