Search

Measuring workload accurately is critical for human factors research and applications. However, if the instruments we use to measure workload are burdensome for participants to complete, we may find ourselves in the ironic position of increasing workload simply by measuring it. We present a pair of studies that suggest the NASA-TLX, a widely-used workload metric, increases workload for participants who complete it, and consequently may hurt performance and upwardly bias the estimates it produces. We found that repeated administration of the NASA-TLX increased workload by 18%, and more than doubled the performance decrement on a simple vigilance task. Single-item measures may be a simple way to avoid burdening participants unnecessarily while still obtaining valuable insight into participant cognitive state. In line with the attentional resource theory, we validate a measure that asks participants to ‘think about [their] brain as an engine,’ and to indicate inside a rectangle ‘how much gas [they] h...