It depends on the purpose. Will you use this pollen as food for bees? If so, you need to dry it in low temperature, to not destroy important organic compounds. Do you need to obtain dry mass at the same time? If so vacuum freeze dryer is the best solution. Another solution would be vacuum drying oven (similar to "regular" dryer but allows drying at low temperatures, like 30-40 OC).
The paper below may help you.
Kind regards,
Michał Filipiak
Article Comparison of methodologies for moisture determination on dr...
If you want to prepare it for SEM then methods of preparation of specimens for SEM is standardized in most publications including fixation and dehydration, critical point drying, mounting in stubs, coating and examination. Can search for "Preparing living pollen material for scanning electron microscopy using 2,2-dimethoxypropane (DMP) and critical-point drying" by Halbritter H (1998).