Though mostly gray scale images are used to compute roughness. But there are some articles that proposed color values to compute roughness, e.g., two related papers are:
(1)
Article Visual method for measuring the roughness of a grinding piec...
(2)
Estimating Pavement Roughness by Fusing Color and Depth Data Obtained from an Inexpensive RGB-D Sensor.