As dr.Rahim Abdur commented,AFM is a suitable tool measure accurate thickness of graphene.Beside thickness ,you can calculate number of graphene layers
Number of layers = Total thickness obtained from AFM /thickness of single layer of graphene
You can use transmission plot by considering maxima and minima if your substrate is glass. But if your substrate is silicon or else then spectroscopic Ellipsometry technique should be used.