I wondering if anyone have already experienced user-tests or other user experience evaluation methods to assess georeferenced applications for smartphones in outdoor/real contexts?
There are already studies or research papers that compare experiments conducted open-air and in the laboratory?
I do not fully understand - what exactly do you want to do?
What I understand so far, you want a scientific method to compare geolocation experiments that have been conducted indoor AND outdoor?
What kind of data do you have so far?
I'm trying to evaluate the user experience and usability of a tourist app prototype that allows users to geolocate themselves and to access geo-tagged information. I would like to confront in-lab experiments (where geolacation is simulated but other experimental parameters are in control) with open-air situation to understand experimental variables an bias. Tests are user-personas/senarois and tasks based and the control parameter is the time to perform the tasks themselves supported by thinking aloud method and a final qualitative interview.
There is a rather vivid discussion of lab studies vs. field or in-the-wild studies within HCI and Ubicomp. It concerns mobile and ubicomp technologies particularly. The references below should help identify that body of work. It may not provide you with straightforward answers to your questions but may help you develop your method further.
- Kjeldskov, J., Skov, M. B., Als, B. S., and Høegh, R. T. Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field. In Proc. MobileHCI 2004, Springer (2004), 529--535.
- Yvonne Rogers, Kay Connelly, Lenore Tedesco, William Hazlewood, Andrew Kurtz, Robert E. Hall, Josh Hursey, and Tammy Toscos. 2007. Why it's worth the hassle: the value of in-situ studies when designing Ubicomp. In Proceedings of the 9th international conference on Ubiquitous computing (UbiComp '07), John Krumm, Gregory D. Abowd, Aruna Seneviratne, and Thomas Strang (Eds.). Springer-Verlag, Berlin, Heidelberg, 336-353.
- Jesper Kjeldskov and Mikael B. Skov. 2014. Was it worth the hassle?: ten years of mobile HCI research discussions on lab and field evaluations. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (MobileHCI '14). ACM, New York, NY, USA, 43-52. http://doi.acm.org/10.1145/2628363.2628398
- Penny Hagen, Toni Robertson, Melanie Kan, and Kirsten Sadler. 2005. Emerging research methods for understanding mobile technology use. In Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future (OZCHI '05). Computer-Human Interaction Special Interest Group (CHISIG) of Australia, Narrabundah, Australia, Australia, 1-10.
- Barry Brown, Stuart Reeves, and Scott Sherwood. 2011. Into the wild: challenges and opportunities for field trial methods. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1657-1666. http://doi.acm.org/10.1145/1978942.1979185
- Matthias Korn and Susanne Bødker. 2012. Looking ahead: how field trials can work in iterative and exploratory design of ubicomp systems. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, New York, NY, USA, 21-30. http://doi.acm.org/10.1145/2370216.2370221
- Korn, Matthias & Zander, Pär-Ola (2010). From Workshops to Walkshops: Evaluating Mobile Location-based Applications in Realistic Settings. Workshop on Observing the Mobile User Experience at NordiCHI 2010, October 16-20, Reykjavik, Iceland, 29-32. http://mkorn.binaervarianz.de/pub/nordichi2010-ws.pdf
- Badges
- Science topic
- Similar topics
- Mathematics