Inter-interviewer variation in oral interview tests

Abstract

Over the last two decades, research has suggested that candidates’ test performances and scores are collaboratively achieved through interviewing/ scoring processes and there could be unfair situations caused by the interinterviewer variation. To investigate a precise picture of the impact of interinterviewer variation, this research examines the variability of interviewer behaviour, its influence on a candidate’s performance and raters’ consequent perceptions of the candidate’s ability on analytical rating scales (for example, pronunciation, grammar, fluency). This paper concludes with suggestions as to how the potential unfairness caused by interviewer variability could be solved.