it depends a lot on the type of material and phophorus concentration, which method would be useful or your specific problem.
I have measured P in carbonates using ICP-MS and ICP-OES, but also spectrophotometry and ion chromatography might be an option (pretty easy to do for water samples). Since P is effectively monoisotopic quantifying 31P and total P is pretty much the same thing. If P levels are sufficient and the material a polished solid, one could also try electon microprobe analysis or SEM-based EDS.
There are sequential extraction techniques for P e.g. in sedimentary successions that help quantifying P contributions of different phases within a material.
X-ray fluorescence is also a good technique for elemental phosphorus quantification in solids. Solids may be measured after crushing and pressed in a pellet with wax, or fused into a glass disc with lithium borate. Detection limits are tens of ppm for a pellet and about 0.1% for fused borate.
For soluble phase, ICP is a good choice to measure elemental phosphorus, and colorimetry or IC will give phosphate (PO4--) concentrations.
The matrix contains various materials and sulphur is one of them. However, my focus is to quantify phosphorus released from the matrix via a suitable technique except ICP, NMR and Ion-exchange techniques.
Activation analysis might be an option. It's not trivial and you'll need access to either a reactor or an electron linac. But theoretically you can quantify P-31 by measuring Al-28 yield.