What tests can i run to see if the distributions of the training set and test set data are similar?

17 June 2020 1 8K Report

I have two datasets from different sources: One is training and the other is the Test dataset. I extract features from the training set images and train the model. The trained model is then used to determine the class label of the test set (same features as that of the training set are extracted with unknown class label).

Alin Plesoianu

Hi,

You can use either the Student's t-test ( https://www.statisticshowto.com/probability-and-statistics/t-test/ ) or the Kolmogorov-Smirnov Test (https://towardsdatascience.com/kolmogorov-smirnov-test-84c92fb4158d ).

You can calculate them easily in R or other statistical software. In R you cand find info here:

Student's t-test: https://stat.ethz.ch/R-manual/R-devel/library/stats/html/t.test.html
Kolmogornov-Smirnov test: https://stat.ethz.ch/R-manual/R-devel/library/stats/html/ks.test.html

Good luck!

Badges
Science topic

More Vasundhara Acharya's questions See All

Please suggest a good text book for "Research Methodology in Life Sciences". Which book would be good for PhD Scholars?

Please provide Book Title and author name

02 March 2021 9,059 3 View

Why are the two terms -research methods/research methodology - used interchangeably?

Two terms - research methodology and research methods - in research methodology books are clearly differentiated. Yet, these terms are loosely used in many research articles; particularly in the...

13 December 2020 6,147 7 View

Is folic acid cytotoxic to human kidney cells ?

My group is interested in folic acid cytotoxicity in human kidney cells. Are there any reports available showing toxic effects of FOLIC ACID as in the case of mice kidneys? Any insights will be...

19 October 2020 2,273 3 View

Would you please be kind to share the possible ways to quantify the amount of mucus in the airway in the picture attached below?

I tried imageJ but ImageJ threshold option could not isolate the color of the airway only.

20 May 2020 8,792 2 View

What might be the reason for High OD of background in TNF alpha ELISA?

My protocol of ELISA is Capture Antibody coating (4 micrograms per ml) incubation overnight. Blocking (1% BSA in PBS) incubation for 1 hour. Sample loading (100 microliters of BAL fluid diluted in...

22 April 2020 3,577 3 View

How to interpret the results obtained from X-ray diffraction (XRD)?

I prepared the gold nanoparticles using plant extract and characterized using XRD. Result displays four prominent diffraction peaks indexed as (111), (200), (220) and (311) miller indices which...

28 June 2019 7,767 10 View

Which software use for making cif file of different materials???

i m doing work on semi conductor alloys i can not find a cif files of some materials..pls help me out.

29 April 2019 5,857 3 View

Can ALE be applied to composite structure in Abaqus CAE. if yes then how can we do it ?

it shows an error 1.adaptive meshing is not supported in any elements in this domain. 2.adaptive meshing contraints can be specified on adaptive mesh domain.

10 March 2019 6,460 1 View

How to solve fractional order algebraic equations?

I wish to know about the existing methods to solve a fractional order algebraic equation. I am not asking about solution of fractional order differential equations. To make things clear, the...

06 March 2019 585 5 View

Can a system with negative Gain Margin and positive Phase Margin be still stable?

I have to design a fractional order PID controller for a maglev plant. The maglev plant is an open-loop unstable system. Its transfer function has two real poles, one on the RHS of s-plane and one...

12 September 2018 6,101 6 View

Dear all, I was wondering if anyone knows whether MGLtools and Autodock can run on Mac OS?

I have tried to download the 64-bit version of MGLtools however, as many times as I have downloaded and uninstall the programs, an error arises that the app needs to be updated. Thank you.

03 March 2021 5,997 2 View

Can we classify HV and LV lines based on line length?

I have dataset which shows the length of power lines. I need to classify the lines based on the line length. Is there a rule to classify the High voltage (HV) and low voltage (LV) lines based on...

03 March 2021 4,116 4 View

I got 02 moderator values defining Johnson-Neyman significance regions. Is it an error?

Hi everyone, I am conducting research for my Master's thesis. I am using PROCESS by Johnson-Neyman to analyze my Moderator model. I test the relationship between Public Service Motivation and...

03 March 2021 2,350 2 View

Do I need to do linear regression before running mediation analysis using PROCESS MACRO by Hayes ?

I just wanted to check if I need to run a linear regression separately if I am using PROCESS MACRO to run mediation analysis. Thank you.

02 March 2021 4,359 3 View

What are the most reliable approaches to extract key continuous frames from a video, with complete automation?

I have an input video, of skin (from a microscope that means it is magnified such that blood capillaries are visible). The idea is to extract 15 sec of continuous frames from a video of 1 min,...

02 March 2021 2,735 2 View

What analysis to choose with a large neste dataset and clearly skewed or kurtotic distributions?

Hello! I have a dataset of n=3000 nested within 8 countries with approximately 200 or 400 responses in each country. I originally planned to perform multilevel modelling with 4 dependent variables...

02 March 2021 6,865 1 View

Do I need to strip the PVDF membrane before staining it with colloidal gold?

Dear Colleagues, After running Western blot on PVDF membrane and detection using ECL, I would like to stain my PVDF with colloidal gold to be able to allign the ECL image with total proteins on...

02 March 2021 7,829 3 View

PACYC PCR not working after several attempts. Would anyone have any suggestions?

So, I have been trying to run a pACYC PCR which will be used later on for a Gibson Assembly. However the PCR is not working. I have already tried gradient PCR and changing extension time; however...

02 March 2021 1,146 2 View

Do you know any MR image dataset?

I would like to research on MR images (0.5T and 3T). Can you please suggest some websites that I can download dataset including both 0.5T and 3T MR images? Thank you.

02 March 2021 7,735 3 View

Can NFL theorem be valid in infinite search space in ML?

NFL theorem is valid for algorithms training in fixed training set. However, the general characteristic of algorithms in expanded or open dataset has not been proved yet. Could you show your...

01 March 2021 1,189 3 View