Researching the cognitive validity of GEPT high-intermediate and advanced reading : an eye tracking an stimulated recall study

2.50
Hdl Handle:
http://hdl.handle.net/10547/621997
Title:
Researching the cognitive validity of GEPT high-intermediate and advanced reading : an eye tracking an stimulated recall study
Authors:
Bax, Stephen; Chan, Sathena Hiu Chong
Abstract:
It is important for any language test to establish its cognitive validity in order to ensure that the test elicits from test takers those cognitive processes which correspond to the processes which they would normally employ in the target real-life context (Weir 2005). This study investigates the cognitive validity of the GEPT Reading Test at two levels. High-intermediate (CEFR B2) and Advanced (CEFR C1), using innovative eye-tracking technology and detailed stimulated recall interviews and surveys. Representative reading items were carefully selected from across all parts of the GEPT High- Intermediate Level Reading Test and the GEPT Advanced Level Reading Test. Taiwanese students (n=24) studying Masters level programmes at British universities were asked to complete the test items on a computer, while the Tobii X2 Eye Tracker was used to track their gaze behaviour during completion of the test items. Immediately after they had completed each individual part, they were asked to report the cognitive process they employed by using a Reading Process Checklist, and a further (n=8) then participated in a detailed stimulated recall interview while viewing video footage of their gaze patterns. Taking into account all these sources of data, it was found that the High-Intermediate section of the GEPT test successfully elicited and tested an appropriate range of lower and higher cognitive processes, as defined in Khalifa and Weir (2009). It was also concluded that the Advanced sections of the test elicited the same set of cognitive processes as the High- Intermediate test, with the addition in the final section of the most difficult of all in Khalifa and Weir's scheme. In summary, it is apparent that the two elements of the GEPT test which were researched in this project were successful in requiring of candidates the range of cognitive processing activity commensurate with High-Intermediate and Advanced reading levels respectively, which is an important element in establishing the cognitive validity of the GEPT test.
Citation:
Bax, S., Chan, S. (2016) 'Researching the cognitive validity of GEPT high-intermediate and advanced reading : an eye tracking an stimulated recall study'. Taipei: Language Training and Testing Center (LTTC).
Publisher:
Language Training and Testing Center (LTTC)
Issue Date:
1-Jul-2016
URI:
http://hdl.handle.net/10547/621997
Additional Links:
https://www.lttc.ntu.edu.tw/lttc-gept-grants/RReport/RG07.pdf
Type:
Technical Report
Language:
en
Sponsors:
This study was funded and suppoted by the Language Training & Testing Center (LTTC) under teh LTTC-GEPT Research Grants Program 2014-2015
Appears in Collections:
English language learning and assessment

Full metadata record

DC FieldValue Language
dc.contributor.authorBax, Stephenen
dc.contributor.authorChan, Sathena Hiu Chongen
dc.date.accessioned2017-01-24T11:34:03Z-
dc.date.available2017-01-24T11:34:03Z-
dc.date.issued2016-07-01-
dc.identifier.citationBax, S., Chan, S. (2016) 'Researching the cognitive validity of GEPT high-intermediate and advanced reading : an eye tracking an stimulated recall study'. Taipei: Language Training and Testing Center (LTTC).en
dc.identifier.urihttp://hdl.handle.net/10547/621997-
dc.description.abstractIt is important for any language test to establish its cognitive validity in order to ensure that the test elicits from test takers those cognitive processes which correspond to the processes which they would normally employ in the target real-life context (Weir 2005). This study investigates the cognitive validity of the GEPT Reading Test at two levels. High-intermediate (CEFR B2) and Advanced (CEFR C1), using innovative eye-tracking technology and detailed stimulated recall interviews and surveys. Representative reading items were carefully selected from across all parts of the GEPT High- Intermediate Level Reading Test and the GEPT Advanced Level Reading Test. Taiwanese students (n=24) studying Masters level programmes at British universities were asked to complete the test items on a computer, while the Tobii X2 Eye Tracker was used to track their gaze behaviour during completion of the test items. Immediately after they had completed each individual part, they were asked to report the cognitive process they employed by using a Reading Process Checklist, and a further (n=8) then participated in a detailed stimulated recall interview while viewing video footage of their gaze patterns. Taking into account all these sources of data, it was found that the High-Intermediate section of the GEPT test successfully elicited and tested an appropriate range of lower and higher cognitive processes, as defined in Khalifa and Weir (2009). It was also concluded that the Advanced sections of the test elicited the same set of cognitive processes as the High- Intermediate test, with the addition in the final section of the most difficult of all in Khalifa and Weir's scheme. In summary, it is apparent that the two elements of the GEPT test which were researched in this project were successful in requiring of candidates the range of cognitive processing activity commensurate with High-Intermediate and Advanced reading levels respectively, which is an important element in establishing the cognitive validity of the GEPT test.en
dc.description.sponsorshipThis study was funded and suppoted by the Language Training & Testing Center (LTTC) under teh LTTC-GEPT Research Grants Program 2014-2015en
dc.language.isoenen
dc.publisherLanguage Training and Testing Center (LTTC)en
dc.relation.urlhttps://www.lttc.ntu.edu.tw/lttc-gept-grants/RReport/RG07.pdfen
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/*
dc.subjectQ110 Applied Linguisticsen
dc.subjecteye-trackingen
dc.subjectreadingen
dc.titleResearching the cognitive validity of GEPT high-intermediate and advanced reading : an eye tracking an stimulated recall studyen
dc.typeTechnical Reporten
dc.date.updated2017-01-24T11:17:37Z-
This item is licensed under a Creative Commons License
Creative Commons
All Items in UOBREP are protected by copyright, with all rights reserved, unless otherwise indicated.