For example, when I told a researcher that he was doing hypothesis generating when he was testing the effect of a chemical on 200 different variables (i.e., by this I meant that he could only generate hypotheses, not draw conclusions), he replied that he had a large experiment, that he was doing hypothesis testing and that the effect of a chemical on 200 dependent variables represented 200 hypotheses. In my mind it you have 200 hypotheses, you don't have any. On the other hand, if a researcher states that she wants to find out whether increasing independent variable A will increase dependent variable B in a dose related manner, it appears to me that she is doing hypothesis testing. As Tukey used to say when he was asked how many variables can you test in a single experiment, he dais: “If you have two, you have one too many.” Does the difference between hypothesis testing and hypothesis generating finally come back to how many “questions” you ask? 200 is too many, one is OK. What about 3, 8, 15, etc.? How do you decide? Any references of interest on this topic?

Similar questions and discussions