unfortunately there is no simple low pass filter available solely in the x-ray regime.
You may use K-edge filters which exhibit strong attenuation at the high energy side (short wavelength) of the K-edge. However the strong attenuation quickly decreases (transmission increases) when going to higher photon energies further on.
Please specify the energy range (e.g. transmission cut-off) so a proposal can be made.
But thinking on lead glas for x-ray windows used for x-ray cabinets you have high transmission in the visual regime but a strong blocking in the x-ray part of the spectrum.
Please 'google' for 'x-ray lead glass windows' ; you will find a lot of information and a lot of suppliers.
I think in your case (visible transparent, low energy x-rays blocking) you may use any optical glas for your purpose or even transparent polymers. For sufficient thicknesses part of the low energy x-ray regime is blocked anyway.
Again: please specify your wavelengths / photon energy ranges and x-ray blocking factor