I believe that your compound does not have any transition element. Then magnetic behavior may be due to certain defects like F-center, etc. or due to oxygen created defect. Repeat the magnetic experiment and if you get the same result, then it may be claimed as the existence of ferromagnetism in your dielectric ceramics due to the above given reason. Otherwise it may be measurement artifact. Apart from Msat value look for Mr and Hc. If both are significant then you can do switching with both electric and magnetic field. Also check your M-H and P-E data plot and look in for whether they are concave shaped. Good Luck
This kind of material can be good candidate for multiferroic applications. You can find a lot of article related to that subject. More general is done in articles published related to bismuth or yttrium ferrites ( in journals; Applied physics, Applied Physics letters, Ceramics International....)
I agree with Stojanovic, but having these value you cant be sure about your material, its multiferroics or not. As value of Ms what you have observed might be due faulty measurement (i think it is VSM data) thus in addition what Ravi has said, i would say change the instrument too. and record the PE data by making your sample thickness smaller.
Secondly,(rather it should be first),see your sample compositional purity. i doubt ,as you have mention nothing about the kind of material you have used, so it may second due to second impurity phase. verify the structural purity and confirm single phase only after this the above work will be fruitful.