Files in this item
IRT-based classification analysis of an English language reading proficiency subtest
Item metadata
dc.contributor.author | Kaya, Elif | |
dc.contributor.author | O'Grady, Stefan | |
dc.contributor.author | Kalender, Ilker | |
dc.date.accessioned | 2023-03-23T17:34:44Z | |
dc.date.available | 2023-03-23T17:34:44Z | |
dc.date.issued | 2022-10-01 | |
dc.identifier | 280131421 | |
dc.identifier | b3592811-e8b9-4e62-a69e-35cc98d14c62 | |
dc.identifier | 000752770000001 | |
dc.identifier | 85124090032 | |
dc.identifier.citation | Kaya , E , O'Grady , S & Kalender , I 2022 , ' IRT-based classification analysis of an English language reading proficiency subtest ' , Language Testing , vol. 39 , no. 4 , pp. 541-566 . https://doi.org/10.1177/02655322211068847 | en |
dc.identifier.issn | 0265-5322 | |
dc.identifier.other | ORCID: /0000-0003-3810-713X/work/114977526 | |
dc.identifier.uri | https://hdl.handle.net/10023/27255 | |
dc.description.abstract | Language proficiency testing serves an important function of classifying examinees into different categories of ability. However, misclassification is to some extent inevitable and may have important consequences for stakeholders. Recent research suggests that classification efficacy may be enhanced substantially using computerized adaptive testing (CAT). Using real data simulations, the current study investigated the classification performance of CAT on the reading section of an English language proficiency test and made comparisons with the paper-based version of the same test. Classification analysis was carried out to estimate classification accuracy (CA) and classification consistency (CC) by applying different locations and numbers of cutoff points. The results showed that classification was suitable when a single cutoff score was used, particularly for high- and low-ability test takers. Classification performance declined significantly when multiple cutoff points were simultaneously employed. Content analysis also raised important questions about construct coverage in CAT. The results highlight the potential for CAT to serve classification purposes and outline avenues for further research. | |
dc.format.extent | 26 | |
dc.format.extent | 819124 | |
dc.language.iso | eng | |
dc.relation.ispartof | Language Testing | en |
dc.subject | Classification accuracy | en |
dc.subject | Classification consistency | en |
dc.subject | Computerized adaptive testing | en |
dc.subject | Language proficiency | en |
dc.subject | Rudner approach | en |
dc.subject | LB2300 Higher Education | en |
dc.subject | LB1603 Secondary Education. High schools | en |
dc.subject | PE English | en |
dc.subject | AC | en |
dc.subject | MCC | en |
dc.subject.lcc | LB2300 | en |
dc.subject.lcc | LB1603 | en |
dc.subject.lcc | PE | en |
dc.title | IRT-based classification analysis of an English language reading proficiency subtest | en |
dc.type | Journal article | en |
dc.contributor.institution | University of St Andrews. International Education Institute | en |
dc.identifier.doi | 10.1177/02655322211068847 | |
dc.description.status | Peer reviewed | en |
This item appears in the following Collection(s)
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.