For ground data you need to visit the area of your interest. Also you must have the idea for which specific purpose you want to do ground truthing. Set the target and take all the necessary devices to record the data and validate with Hyperspectral data. This is what I understood from your query.. Thanks
I think USGS Website would be the good solution. Open an account and order your data with map grid and time based on satellite image taken. They will send you those files. Hope, you will receive all required raw image data.