Exploring performance across two delivery modes for the same L2 speaking test: face-to-face and video-conferencing delivery: a preliminary comparison of test-taker and examiner behaviour

2.50
Hdl Handle:
http://hdl.handle.net/10547/622261
Title:
Exploring performance across two delivery modes for the same L2 speaking test: face-to-face and video-conferencing delivery: a preliminary comparison of test-taker and examiner behaviour
Authors:
Nakatsuhara, Fumiyo; Inoue, Chihiro; Berry, Vivien; Galaczi, Evelina D.
Abstract:
This report presents the results of a preliminary exploration and comparison of test-taker and examiner behaviour across two different delivery modes for an IELTS Speaking test: the standard face-to-face test administration, and test administration using Internetbased video-conferencing technology. The study sought to compare performance features across these two delivery modes with regard to two key areas:  • an analysis of test-takers’ scores and linguistic output on the two modes and their perceptions of the two modes  • an analysis of examiners’ test management and rating behaviours across the two modes, including their perceptions of the two conditions for delivering the speaking test.  Data were collected from 32 test-takers who took two standardised IELTS Speaking tests under face-to-face and internet-based video-conferencing conditions. Four trained examiners also participated in this study. The convergent parallel mixed methods research design included an analysis of interviews with test-takers, as well as their linguistic output (especially types of language functions) and rating scores awarded under the two conditions. Examiners provided written comments justifying the scores they awarded, completed a questionnaire and participated in verbal report sessions to elaborate on their test administration and rating behaviour. Three researchers also observed all test sessions and took field notes.  While the two modes generated similar test score outcomes, there were some differences in functional output and examiner interviewing and rating behaviours. This report concludes with a list of recommendations for further research, including examiner and test-taker training and resolution of technical issues, before any decisions about deploying (or not) a video-conferencing mode of the IELTS Speaking test delivery are made. 
Citation:
Nakatsuhara, F., Inoue, C., Berry, V., Galaczi, E. (2016) 'Exploring performance across two delivery modes for the same L2 speaking test: face-to-face and video-conferencing delivery: a preliminary comparison of test-taker and examiner behaviour'. IELTS Website ( https://www.ielts.org/-/media/research-reports/ielts-partnership-research-paper-1.ashx ): The IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australia.
Publisher:
The IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australia
Issue Date:
10-Nov-2016
URI:
http://hdl.handle.net/10547/622261
Additional Links:
https://www.ielts.org/-/media/research-reports/ielts-partnership-research-paper-1.ashx
Type:
Technical Report
Language:
en
Series/Report no.:
ISSN 2515-1703 2017/1
Sponsors:
The IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australia
Appears in Collections:
English language learning and assessment

Full metadata record

DC FieldValue Language
dc.contributor.authorNakatsuhara, Fumiyoen
dc.contributor.authorInoue, Chihiroen
dc.contributor.authorBerry, Vivienen
dc.contributor.authorGalaczi, Evelina D.en
dc.date.accessioned2017-10-05T10:45:06Z-
dc.date.available2017-10-05T10:45:06Z-
dc.date.issued2016-11-10-
dc.identifier.citationNakatsuhara, F., Inoue, C., Berry, V., Galaczi, E. (2016) 'Exploring performance across two delivery modes for the same L2 speaking test: face-to-face and video-conferencing delivery: a preliminary comparison of test-taker and examiner behaviour'. IELTS Website ( https://www.ielts.org/-/media/research-reports/ielts-partnership-research-paper-1.ashx ): The IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australia.en
dc.identifier.urihttp://hdl.handle.net/10547/622261-
dc.description.abstractThis report presents the results of a preliminary exploration and comparison of test-taker and examiner behaviour across two different delivery modes for an IELTS Speaking test: the standard face-to-face test administration, and test administration using Internetbased video-conferencing technology. The study sought to compare performance features across these two delivery modes with regard to two key areas:  • an analysis of test-takers’ scores and linguistic output on the two modes and their perceptions of the two modes  • an analysis of examiners’ test management and rating behaviours across the two modes, including their perceptions of the two conditions for delivering the speaking test.  Data were collected from 32 test-takers who took two standardised IELTS Speaking tests under face-to-face and internet-based video-conferencing conditions. Four trained examiners also participated in this study. The convergent parallel mixed methods research design included an analysis of interviews with test-takers, as well as their linguistic output (especially types of language functions) and rating scores awarded under the two conditions. Examiners provided written comments justifying the scores they awarded, completed a questionnaire and participated in verbal report sessions to elaborate on their test administration and rating behaviour. Three researchers also observed all test sessions and took field notes.  While the two modes generated similar test score outcomes, there were some differences in functional output and examiner interviewing and rating behaviours. This report concludes with a list of recommendations for further research, including examiner and test-taker training and resolution of technical issues, before any decisions about deploying (or not) a video-conferencing mode of the IELTS Speaking test delivery are made. en
dc.description.sponsorshipThe IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australiaen
dc.language.isoenen
dc.publisherThe IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australiaen
dc.relation.ispartofseriesISSN 2515-1703 2017/1en
dc.relation.urlhttps://www.ielts.org/-/media/research-reports/ielts-partnership-research-paper-1.ashxen
dc.subjectlanguage testingen
dc.subjectlanguage assessmenten
dc.subjectspeakingen
dc.subjectmixed-methods researchen
dc.subjectQ330 English as a second languageen
dc.titleExploring performance across two delivery modes for the same L2 speaking test: face-to-face and video-conferencing delivery: a preliminary comparison of test-taker and examiner behaviouren
dc.typeTechnical Reporten
dc.date.updated2017-10-05T09:42:15Z-
dc.description.noteFile attached is copyright so not able to be passed to the repository to be made public. However as is a report not jounrnal article full text not required for REF so will pass metadata only. RVO 5/10/17-
All Items in UOBREP are protected by copyright, with all rights reserved, unless otherwise indicated.