Web-based measurement: Effect of completing single or multiple items per webpage

Abstract

The current study was conducted to determine whether participants respond differently to online questionnaires presenting all items on a single webpage versus questionnaires presenting only one item per page, and whether participants prefer one format over the other. Of participants seeking self-help treatment on the Internet (for depression, social phobia, or panic disorder), 710 completed four questionnaires (Beck Depression Inventory, Beck Anxiety Inventory, Quality of Life Index, Montgomery-Åsberg Depression Rating Scale) on the Internet on two occasions. The questionnaires were either presented with one questionnaire on one webpage (e.g., BDI on one webpage) or on multiple webpages (e.g., BDI on 21 webpages with one item each). Results suggest that the four web questionnaires measure the same construct across diagnostic group (depression, social phobia, panic), presentation type (single versus multiple items per page), and order of presentation (which format first). Within each diagnostic group, factor means for all questionnaires were equivalent across presentation method and time. Furthermore, factor means varied as expected across samples (e.g., depressed group scored higher on BDI), providing evidence of construct validity. The majority of participants in each diagnostic group preferred the single item per page format, even though this format required more time. © 2008 Elsevier Ltd. All rights reserved.