You can just use water. Just make sure the concentration is not high enough. Try betweem 0.1 to 0.5 mg/ml and should work. Disperse it well using sonication for 10 minutes after making up the solution.
You can use distilled water for dispersing GO as it is easily dispersed in water. You can sonicate it somewhere between 20-30min followed by centrifuging at 4000 rpm for 20-30 min to remove any unexfoliated products and use the supernatant for the UV-Vis analysis.
Please refer the following papers for further information.
1) Article Ultraviolet-visible spectroscopy of graphene oxides
2) Article Preparation and characterization of graphene oxide nanosheets