Hi everybody,
we currently have the opportunity to evaluate our modeling languages for the domain of microservice architecture in a master course with roughly 40 participants.
Of course our overall goal is to get insights if the language concepts are comprehensible, understandable and easy/fun to use for the students.
I'm currently thinking about a fitting research design and struggle to find related work / similar designs. I'm pretty sure we are not among the first to evaluate their DSLs.
So far I only found "Usability Evaluation of Domain-Specific Languages" by Barisic et al.
Do you guys know about any available best practices, can give me some hints, or have links to good reads?
Thx for your help!
Jonas
Hi Jonas,
Not exactly about DSL evaluation but I find this paper could be helpful for you to see the settings of a controlled experiment with students.
Do security patterns really help designers?
https://ieeexplore.ieee.org/abstract/document/7194582
Best,
Phu
Thx Phu :)! I've (hopefully) found some interesting papers from UML evaluations and have a meeting with one of our statistics professors. I'll keep u in the loop if I come up with a fancy study design :D
Very interesting study, Jonas. I look forward to learning more from your study design :)
I think this should be of interest:
Conference Paper Usability Evaluation of Domain-Specific Languages: A Systema...
Also, you can look into the Cognitive Dimensions framework:
https://en.wikipedia.org/wiki/Cognitive_dimensions_of_notations
The original article:
Article Usability Analysis of Visual Programming Environments: A 'Co...
A special issue of the Journal of Visual Languages & Computing on ten years of Cognitive Dimensions:
https://www.sciencedirect.com/journal/journal-of-visual-languages-and-computing/vol/17/issue/4
Hi! We have done a preliminary study on intuitive understanding of a modeling language. Conference Paper Intuitive understanding of a modeling language
Maybe some of the referenced literature of Figl el al. might be interesting for you too.
I folks, thanks for all your great advises :) I'll definitely have a look into all your suggestions.