Skip to main content
No Access

Mobile websites: usability evaluation and design

Published Online:pp 29-55https://doi.org/10.1504/IJMC.2014.059241

Mobile websites are increasingly gaining popularity and studying their usability has become an intriguing endeavour considering the ergonomic constraints posed by the mobile devices. Mobile application usability studies are mainly focused on the effects of the mobile device employed, the application's design and the user, but less on the conditions of use. The study presented in this paper proposes a model hypothesising on the effects of environmental context on the usability of mobile websites under the lens of multidisciplinary theories. We consider environmental cues as distractions and suggest both direct and moderated effects on the usability of mobile websites. The model is empirically validated through a laboratory experiment that was based on the results of a preliminary study and tested for its predictive capacity against the usability factors: efficiency, effectiveness and perceived satisfaction. Results suggest that environmental distractions have a significant effect on user performance, but not on user satisfaction.

Keywords

mobile context, mobile websites, mobile usability, environmental context, distractions, usability evaluation, mobile website design, mobile website usability.

References

  • 1. Adamczyk, P.D., Bailey, B.P. (2004).‘If not now, when?: the effects of interruption at different moments within task execution’., Proceedings of the 2004 Conference on Human Factors in Computing Systems, Vienna, Austria271-278 Google Scholar
  • 2. Armstrong, B., Fogarty, G., Dingsdag, D., Dimbleby, J. (2005).‘Validation of a computer user satisfaction questionnaire to measure IS success in small business’.Journal of Research and Practice in Information Technology.37,1,27-42 Google Scholar
  • 3. Banbury, S.P., Macken, W.J., Tremblay, S., Jones, D.M. (2001).‘Auditory distraction and short-term memory: phenomena and practical implications’.Human Factors: The Journal of the Human Factors and Ergonomics Society.43,12-29 Google Scholar
  • 4. Beaman, C.P., Jones, D.M. (1998).‘Irrelevant sound disrupts order information in free recall as in serial recall’.QJ Exp Psychol A.51,615-636 Google Scholar
  • 5. Campbell, D.T., Stanley, J.C., Gage, N.L. (1963).Experimental and Quasi-experimental Designs for Research.Chicago:Rand McNally Google Scholar
  • 6. Chae, M., Kim, J. (2004).‘Do size and structure matter to mobile users? An empirical study of the effects of screen size, information structure, and task complexity on user activities with standard web phones’.Behaviour & Information Technology.23,165-181 Google Scholar
  • 7. Chen, L., Nath, R. (2011).‘Impediments to mobile work: an empirical study’.International Journal of Mobile Communications.9,5,522-540 AbstractGoogle Scholar
  • 8. Connelly, S.L., Hasher, L., Zacks, R.T. (1991).‘Age and reading: the impact of distraction’.Psychology and Aging.6,533-541 Google Scholar
  • 9. Coursaris, C., Hassanein, K., Head, M., Bontis, N. (2007).‘The impact of distractions on the usability and the adoption of mobile devices for wireless data services’., Presented at Proceedings of the 15th European Conference on Information Systems (ECIS 2007), St. Gallen, Switzerland1851-1862 Google Scholar
  • 10. Crease, M. (2005).‘Measuring the effect of distractions on mobile users performance’.Measuring Behavior 2005, 5th International Conference on Methods and Techniques in Behavioral Research.The Netherlands:Wageningen Google Scholar
  • 11. Cyr, D., Head, M., Ivanov, A. (2006).‘Design aesthetics leading to m-loyalty in mobile commerce’.Information & Management.43,8,950-963 Google Scholar
  • 12. Frazier, P.A., Tix, A.P., Barron, K.E. (2004).‘Testing moderator and mediator effects in counseling psychology research’.Journal of Counseling Psychology.51,115-134 Google Scholar
  • 13. Harrell, G.D., Hurt, M.D. (1976).‘Buyer behavior under conditions of crowding: an initial framework’.Advances in Consumer Research.3,36-39 Google Scholar
  • 14. Hart, S.G., Staveland, L.E. (1988).‘Development of NASA-TLX (Task Load Index): results of empirical and theoretical research’.Human Mental Workload.1,139-183 Google Scholar
  • 15. Howell, M., Love, S., Turner, M. (2008).‘User characteristics and performance with automated mobile phone systems’.International Journal of Mobile Communications.6,1,1-15 AbstractGoogle Scholar
  • 16. Hughes, R., Jones, D.M. (2001).‘The intrusiveness of sound: laboratory findings and their implications for noise abatement’.Noise and Health.13,55-74 Google Scholar
  • 17. Fdis, I. (1997).9241-11. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs), Part 11: Guidance on Usability Specification and Measures.Technical Report Google Scholar
  • 18. Jones, D. (1990).‘Recent advances in the study of human performance in noise’.Environment International.16,447-458 Google Scholar
  • 19. Kim, H., Kim, J., Yeonsoo, L. (2005).‘An empirical study of use contexts in the mobile internet, focusing on the usability of information architecture’.Information Systems Frontiers.7,2,175-186 Google Scholar
  • 20. Kim, H., Kim, J., Lee, Y., Chae, M., Choi, Y. (2002).‘An empirical study of the use contexts and usability problems in mobile internet’., Proceedings of the 35th Annual Hawaii International Conference on System Sciences (HICSS), Hawaii, USA1767-1776IEEE Google Scholar
  • 21. Kirakowski, J. (1996).‘The software usability measurement inventory: background and usage’.Usability Evaluation in Industry.169-178 Google Scholar
  • 22. Kjeldskov, J., Skov, M.B. (2003).‘Evaluating the usability of a mobile collaborative system: exploring two different laboratory approaches’.Simulation Series.35,134-141 Google Scholar
  • 23. Knez, I., Hygge, S. (2002).‘Irrelevant speech and indoor lighting: effects on cognitive performance and self-reported affect’.Applied Cognitive Psychology.16,709-718 Google Scholar
  • 24. Kondratova, I., Lumsden, J., Langton, N. (2006).‘Multimodal field data entry: performance and usability issues’., Proceedings of the 11th Joint International Conference on Computing and Decision Making in Civil and Building Engineering, Montreal, Que14-16 Google Scholar
  • 25. Lavie, T., Tractinsky, N. (2004).‘Assessing dimensions of perceived visual aesthetics of web sites’.International Journal of Human-Computer Studies.60,3,269-298 Google Scholar
  • 26. Lee, I., Kim, J., Kim, J. (2005).‘Use contexts for the mobile internet: a longitudinal study monitoring actual use of mobile internet services’.International Journal of Human-Computer Interaction.18,3,269-292 Google Scholar
  • 27. Lindgaard, G., Dudek, C. (2003).‘What is this evasive beast we call user satisfaction?’.Interacting with Computers.15,3,429-452 Google Scholar
  • 28. Montgomery, D.C. (1984).Design and Analysis of Experiments., 2nd ed.New York:Wiley Google Scholar
  • 29. Oswald, C.J.P., Tremblay, S., Jones, D.M. (2000).‘Disruption of comprehension by the meaning of irrelevant sound’.Memory.8,345-350 Google Scholar
  • 30. Pomplun, M., Reingold, E.M., Shen, J. (2001).‘Investigating the visual span in comparative search: the effects of task difficulty and divided attention’.Cognition.81,2,57-67 Google Scholar
  • 31. Preece, J. (1994).Human-Computer Interaction.Harlow:Addison-Wesley Google Scholar
  • 32. Roda, C., Thomas, J. (2006).‘Attention aware systems: theories, applications, and research agenda’.Computers in Human Behavior.22,4,557-587 Google Scholar
  • 33. Rubin, J. (1994).Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests.Wiley Google Scholar
  • 34. Schmidt, A., Beigl, M., Gellersen, H.W. (1999).‘There is more to context than location’.Computers & Graphics.23,6,893-901 Google Scholar
  • 35. Schmiedl, G., Seidl, M., Temper, K. (2009).‘Mobile phone web browsing: a study on usage and usability of the mobile web’., MobileHCI ‘09 Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and ServicesBonn, Germany70 Google Scholar
  • 36. Seo, S., Jung, S. (2000).‘Perceived crowding's influence on consumer's shopp.ing behavior’.Korean Journal of Distribution Research.5,23-32 Google Scholar
  • 37. Tamminen, S., Oulasvirta, A., Toiskallio, K., Kankainen, A. (2004).‘Understanding mobile contexts’.Personal and Ubiquitous Computing.8,2,135-143 Google Scholar
  • 38. Tremblay, S., Nicholls, A.P., Parmentier, F.B.R., Jones, D.M. (2005).‘Visual distraction and visuo-spatial memory: a sandwich effect’.Memory.13,357-363 Google Scholar
  • 39. Tsiaousis, A., Giaglis, G.M.‘Evaluating the effects of the environmental context-of-use on mobile website usability’., 2008, 8–9 July, Proceedings of the 7th International Conference on Mobile Business, Barcelona, Spain314-322 Google Scholar
  • 40. Wharton, C., Rieman, J., Lewis, C., Polson, P. (1994).‘The cognitive walkthrough method: a practitioner's guide’.Usability Inspection Methods.105-140 Google Scholar
  • 41. Wharton, C., Rieman, J., Lewis, C., Polson, P. (1994).‘The cognitive walkthrough method: a practitioner's guide’.Usability Inspection Methods., John Wiley & Sons Inc.105-140 Google Scholar
  • 42. Yi, J.S., Choi, Y.S., Jacko, J.A. (2005).‘Context awareness via a single device-attached accelerometer during mobile computing’., Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services, Salzburg, Austria303-306 Google Scholar
  • 43. Zhang, P., Von Dran, G.M. (2001).‘User expectations and rankings of quality factors in different web site domains’.International Journal of Electronic Commerce.6,2,9-33 Google Scholar
  • 44. Ziefle, M. (2002).‘The influence of user expertise and phone complexity on performance, ease of use and learnability of different mobile phones’.Behaviour & Information Technology.21,303-311 Google Scholar

Bibliography

  • 1. Barnard, L., Yi, J.S., Jacko, J.A., Sears, A. (2005).‘An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices’.International Journal of Human-Computer Studies.62,487-520 Google Scholar
  • 2. Bohnenberger, T., Jameson, A., Kruger, A., Butz, A. (2002).‘Location-aware shopping assistance: evaluation of a decision-theoretic approach’.Lecture Notes in Computer Science.2411,155-169 Google Scholar
  • 3. Lumsden, J., Brewster, S. (2003).‘A paradigm shift: alternative interaction techniques for use with mobile & wearable devices’., Proceedings of 13th Annual IBM Centers for Advanced Studies Conference CASCON97-110 Google Scholar
  • 4. Pascoe, J., Ryan, N., Morse, D. (2000).‘Using while moving: HCI issues in fieldwork environments’.ACM Transactions on Computer-Human Interaction (TOCHI).7,417-437 Google Scholar
  • 5. Sawhney, N., Schmandt, C. (2000).‘Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments’.ACM Transactions on Computer-Human Interaction (TOCHI).7,353-383 Google Scholar