you can apply either Median Filter (http://de.mathworks.com/help/images/ref/medfilt2.html) or an Anisotropic Diffusion Filter (http://www.mathworks.com/matlabcentral/fileexchange/14995-anisotropic-diffusion--perona---malik-/content/anisodiff_Perona-Malik/anisodiff2D.m), which preserves the edges.
Additionally, if you want a text without holes try some morphological operations like opening