Usability evaluation for mobile device: A comparison of laboratory and field tests

Usability testing of mobile devices is an emerging area of research in the field of Human-Computer Interaction. Guidelines had been established as to how usability tests should be conducted. However, there are limitations to the effectiveness of conventional usability tests, especially for mobile devices. Mobile devices typically are used in different situations, but current evaluation method cannot uncover problems in all type of situations. Hence, this study evaluates the effectiveness of conventional laboratory usability tests. It investigated the differences between usability tests on mobile phones conducted in laboratory and real life situation. Significant differences were found, including the frequency and severity of usability problems encountered, the users’ behavior, and subjective responses to the device and the interaction.