Hi,
I am wondering to know if there is any Python or Matlab tools or codes to compare AUCs of two different experiments to investigate their statistical difference (calculating p-value, ...)
Thanks in advance
You can follow this post to get a better idea - http://statistics4everyone.blogspot.com/2017/04/comparison-of-two-tests-in-sensitivity.html
moreover, you can also visit Spatial Efficiency metric (SPAEF) tools which are quite robust - http://space.geus.dk/tools_products/index.html
Amirreza Mahbod Perhaps you are looking for :
sklearn.metrics.roc_auc_score ?
you can use bootstrapping to get confidence intervals.
then compare the bootstrapped histograms.
you could also use a t test to compare mean AUC values but it has assumptions, so beware!
Hi, I would like to create a weight map from a binary image in a way to have more intensity values in the border pixels between the close objects. To make it more clear I need to calculate w(x)...
06 July 2018 491 4 View
Hello, Couple on month ago I uploaded a paper on arXiv and now it has 3 citations. Now, I am planing to update that pre-print since now it is accepted as a conference paper. Basically the new...
04 May 2018 3,509 0 View
Hi, I am trying to construct a multi-layer fibril structure from a single layer in PyMol by translating the layer along the fibril axis. For now, I am able to use the Translate command in PyMol...
02 March 2021 4,569 4 View
I want to do a parameter study of a aixsymmetric cylinder in Abaqus. I want to create several jobs where I get the stresses for 3 different points in my model. These points are defined. I wrote a...
01 March 2021 10,078 1 View
Dear Researchers I am trying to perform a PIL simulation using STM32F4 Discovery board and comunication serial USB TO TTL. During simulation I receive the following timeout error: An error...
01 March 2021 2,327 1 View
Which is suitable for use with Python? MySQL or SQL Server? What is your suggestion?
01 March 2021 3,422 3 View
The following code (see 1st 2 images attached) is used to produce PID controller values that are designed to control the system (G). The code finds the PID controller values (noted as k) by using...
28 February 2021 6,560 14 View
Please, if Gaussian Parameter optimization is possible in this code structure
28 February 2021 278 3 View
I have input and output data set for "ANFIS modeling in MATLAB", and I am getting some negative predicted values of output in testing. However, the predicted values of output in training are...
28 February 2021 3,459 3 View
I wanted to add an extra parameter to the existing Johnson cook equation in the ABAQUS simulation. How to add those extra parameters. Ref: A modified Johnson-Cook material model with strain...
28 February 2021 4,841 3 View
System Description Cuda 11.2 GeForce GTX 1080ti tensorflow version 2.4.1 keras version 2.2.0 python version 3.8 I was getting the below error when I try to run my code on the...
25 February 2021 6,673 2 View
I am required to learn about Flyback converters and I got stuck not knowing to full design of the power supply flyback converter Based USB Charger Model using Simulink, especially the design model...
25 February 2021 5,435 2 View