I have just completed a pilot study to assess if a piece of software improved user awareness in a situation. I used 12 people who completed the same pre-post Likert questions, before and after using the software. Since the same group was used pre/post, I used Wilcoxon signed-rank for analysis.
I am now designing a full study in which I would like to assess the effectiveness of the software with a larger cohort. My intention is to split the cohort into control and intervention. Both groups will complete the same pre-test survey of Likert questions and watch a video (related to the topic). The control group will then complete the post-test Likert questions and finish. The intervention group will use the software for various tasks, evaluate it and provide feedback, and complete the same post-test Likert questions.
My questions are:
Does that sound like a sound experiment?
Which statistical analysis methods should I use to assess the effectiveness of the software between groups?