I am working on automated testing, i.e., e-assessments in engineering mechanics at the moment. My interest is mainly in designing complex example-problems that are able to resemble typical paper-pencil exams including the ability to take subsequent errors into account.
My opinion is that we are on a very good way with this work. However, I am not sure about other current developments in that field. My knowledge of the literature on automated testing in STEM disciplines is still quite weak.
So may I ask you which specific publications you would suggest to read or which special journals you would suggest to include in my search?
Thank you very much upfront.
Hi,
You can follow these journals in the beginning.
1. International Journal of STEM Education by
2. Journal for STEM Education Research
Both the journals are from Springer
Another journal, which is very helpful is : Journal of Research in STEM Education
Thank you very much Adrian Twissell
. At the moment our main objective is to find out how a complex engineering problem can be split into smaller parts in order to test it automatically, using Moodle in our case. Such problems typically need 2-3 pages of computational work in a paper-pencil exam, and when correcting, subsequent mistakes are taken into account by the lecturer, meaning that if a certain sub-solution is incorrect the subsequent solutions are re-calculated using that incorrect value of the student. We want to keep this mode even in full e-assessments, so we are searching for ways to automatically check for such subsequent mistakes. One possibility would be "one-way navigation", the other one is the question type STACK available as a plugin in Moodle and utilizing a computer algebra system (Maxima). We are planing to use these questions in self-assessment tests first and then roll the system out to summative exams once it works well. Machine-learning has not been discussed yet but is clearly something we will be looking into, especially when talking about feedback in formative exams.We are preparing an introductory publication explaining our aims and current solutions on that topic at the moment, which will hopefully be available at the beginning of 2020. I am also attending the 3rd STACK conference in April 2020 including proceedings, where we want to publish more findings and also students perception of such automated questions. I will link both papers here as soon as they are available.
By the way, here's what we are doing so far with e-assessments:
Conference Paper E-ASSESSMENT IN ENGINEERING MECHANICS: HOW DOES IT COMPARE T...
- Badges
- Science topic
- Similar topics
- Philosophy
- Philosophy Of Science
- Reasoning