Dear Sheema,
from your question there is not enough detail to know what is that you would like to do.
I assume that your problem is that SVM is a binary classifier which return 0 or 1, and you cannot directly use this kind of output to compute your ROC. If this is the case, one solution can be to take the distance of each of your point to the hyperplane and transform this into a predicted probability by using a binary logistic model. The you can use the predicted probabilities returned by this model to do ROC analysis. I attach an article by Platt for reference. Hope this helps. Costanzo
Costanzo is correct. You will find software to do this in R (which is open source), in particular the kernlabs package by Alexandros Karatzoglou, Alex Smola and Kurt Hornik. See http://cran.r-project.org/web/packages/kernlab/vignettes/kernlab.pdf. This software is very high quality, Smola is a leading researcher in maximum margin methods.
Thank you all. Mr.Costanzo my problem is binary and need to compute ROC for svm applied I am not sure that what should I use svm accuracy or error rate to compute ROC. Mr.Frerek I have done ROC computation on each step /iteration but ROC plot is very non-obvious resembling a stair case ascended.
Dear Sheema,
ROC curve analysis does not use accuracy or error rate. An ROC curve plots sensitivity (y axis) versus 1-specificity (x axis). You have one point for each value that you set as the threshold on your measurement. Your measurement could be the predicted probabilities if you use the approach mentioned above. As Thomas explained above, there are free packages that can help you to do this in R. Or you can use other software like SPSS if you are more familiar with it. I would suggest you do some more reading about ROC curve analysis before going any further. Costanzo
Dear Sheema,
it seems that you are more than half way through. As Constanzo pointed out. ROC plots the false positive rate vs. true positive rate, or sensitivity vs. 1-specificity (which is the same). This is clearly mentioned in the link: http://en.wikipedia.org/wiki/Receiver_operating_characteristic
I recommend you to read this since you might want to interpret your classification results afterwards. A good knowledge about the different performance measurements is crucial.
Because various suggestions have been made according to implementations using R or Matlab, could you tell us which platform you are using?
Hi Sheema,
As it is a fairly old thread, I assume you've already solved the problem. However, if not, you might find it useful to have look at "perfcurve" documntation in Matlab. Hope it helps.
Thank you. Yes it is old one but I still cudn't solve it, as I have older version of matlab 2013. And the perfcurve is in matlab 2014 which I cudnt get till now.
Hi Sheema please find the attached file. Copy and paste the contents into a .m file in Matlab and save it as p.e.r.f.c.u.r.v.e.m. Then you can use it. Hope it helps.
Can you guide me how to adapt this perfcurve for analysis of segmentation method performed on image qualitatively /quantitatively?
Hi Sheema,
I don't totally understand your question, but I suppose having a look at the following links may be of some assistance:
http://au.mathworks.com/matlabcentral/newsreader/view_thread/280317
http://au.mathworks.com/matlabcentral/answers/68138-how-to-do-a-roc-analysis-using-matlab-build-in-svm-not-libsvm
http://stackoverflow.com/questions/20600568/roc-curve-for-a-binary-classifier-in-matlab
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics