Hello everyone,
I'm currently writing my master thesis in media studies about news presentation through sequential chatbots (not AI-based).
I've made a Messenger chatbot which will present a specific news case I've adapted from a regular newsstory and pre-written everything. The newsstory is presented through a dialogue tree-style, so the user is interactive and have to decide what they want to know more about in the specific news case. The bot will be tested by ten informants who will be interviewed after the user test about usability and understanding of the news case.
So far I've written about various hypertext theories and usabilitiy theories, but I feel something is lacking. Any ideas on what I might add in addition? Since this is a practical-theorical thesis, and I've mainly done other types of assignments in the past, I'm not too familiar with human-computer interaction (HCI) and things like that - is this even relevant from a media science perspective?
Thanks in advance
Hello,
Few comments about the evaluation of the chat bot:
1. You may test the bot with more than 10 participants.
2. Only post test interviewing may not be sufficient rather than you may observe their interaction behaviour or task-based think aloud test to assess the effectiveness (task completion rate, number of attempts), efficiency (navigation error, clicking behaviour, etc.), satisfaction (overall satisfaction score, how easy to to learn it, their interest to use the system in future, etc.)
3. In such the evaluation experiment may be more stronger to provide both the qualitative and qualitative evidence to validate the research objectives.
Regards
It could be interesting to add suggestions to other more or less related stories and validate if they lead to extending the usage time and satisfaction. If the goal is to make users smarter through entertainment, you could also challenge users to hear about what they don't want to hear about to get them out of their filter bubble. See our project on Radiobots if you are interested inn this direction.
Conference Paper Prototyping Radiobots - Automatic Radio Talks Generator Cons...
- Badges
- Science topic
- Similar topics
- Computer Science and Engineering
- Human-Computer Interaction