U.S. flag

An official website of the United States government, Department of Justice.

Web Surveys by Smartphone and Tablets Effects on Survey Responses Public Opinion Quarterly

NCJ Number
252669
Journal
Public Opinion Quarterly Volume: 81 Issue: 4 Dated: December 2017 Pages: 896-929
Author(s)
Roger Tourangeau; Aaron Maitland; Gonzalo Rivero; Hanyu Sun; Douglas Williams
Date Published
December 2017
Length
34 pages
Annotation
This study involved a field experiment that compared survey responses obtained by smartphones, tablets, and laptop computers, focusing on the potential effects of the different devices on measurement errors.
Abstract
With respondents increasingly completing web surveys on tablet computers and smartphones, several studies have examined the potential effects of the switch from PCs to mobile devices. The studies have looked at a range of outcomes, including completion rates, breakoffs, and item nonresponse. The current study examined whether the differences across devices in screen size (and the related need to scroll to see the entire question or the full set of response options) might moderate the effects of response order, affect the strategy respondents used to decide which of two options was preferable, change the effect of question context, or influence the use of definitions. Research experiments were based on the principle of visual prominencethe idea that respondents are more likely to notice and consider information that is easy to see. The experiments were deliberately designed to maximize the impact of screen size on the results, since the screen size would affect the visual prominence of key information; however, like many of the prior studies that have examined mobile devices, although response order, context, and evaluation strategy affected the answers respondents gave, few device effects emerged. (publisher abstract modified)