Computerized tests and time: Measuring, limiting and providing visual cues for response time in on-line questioning

Sheizaf Rafaeli, Noam Tractinsky

Research output: Contribution to journalArticlepeer-review

Abstract

It is possible and attractive to incorporate time-related measures and techniques in on-line computerized testing systems. However, is it advisable? This study focuses on the measurement of response time, the solicitation of speed, the limitation of allotted time and the provision of on-line visual cues for the passage of time (on-screen hourglass). An experiment was conducted using a standard general knowledge component of a psychometric test; 198 students completed an on-line psychometric test under several time-related experimental conditions. Findings encourage further use of time-related techniques. Positive correlations were found between performance as measured by accuracy in response and speed measures. Time-limiting procedures allowed savings of almost 50% of examinee and examiner’s time, without diminishing score reliability. The reliability of the speed measures is at least as high as the reliability of accuracy measures. Examinees’ stress was not affected, but intersubjective attitudes are a problem for the incorporation of time-related measures. Finally, while accuracy scores are biased by demographics, speed measures seem to be independent of experience in using computers, gender, age and education.

Original languageEnglish
Pages (from-to)335-351
Number of pages17
JournalBehaviour and Information Technology
Volume8
Issue number5
DOIs
StatePublished - Oct 1989
Externally publishedYes

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)
  • General Social Sciences
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Computerized tests and time: Measuring, limiting and providing visual cues for response time in on-line questioning'. Together they form a unique fingerprint.

Cite this