Using animation to develop a usability questionnaire: Scale development and psychological measurements.

• We developed a system usability scale based on cartoon animation called A-SUS. • Experiment I indicates that the A-SUS scale has performed well under psychometric properties. • Experiment II indicates that, when compared with the text and graphic version, A-SUS has a better questionnaire experience. This paper describes the development of a cartoon animation system usability scale (A-SUS) based on the established text-based SUS questionnaire. We propose a methodology and design a short graphic interchange format (.GIF) animation for each SUS item. Experimental evaluations confirm that the scale has satisfactory psychometric properties (e.g., structural validity, reliability factor structure, concurrent validity, and sensitivity). A second experiment is used to evaluate and compare the questionnaire experiences associated with the SUS, a pictorial SUS (P-SUS), and the developed A-SUS. The results indicate that A-SUS performs well in terms of recommendations, aesthetics, motivations, and completion time. Compared with the SUS and P-SUS, the animated version is more interesting, and the overall questionnaire experience is better. [ABSTRACT FROM AUTHOR]