Workshop on mixed methods research in language assessment validation studies
Day 1 of this workshop provides a close to centennial (1920-2018) overview of a major concept in (language) testing and assessment, that is, validity. A discussion of the development of the concept over time and the main schools of thoughts on validity will be presented and discussed. Examples of language testing and assessment validation studies that employ componential vs. unitary conceptualisations of validity will be discussed. Argument-based approach as an operationalisation of the unitary conceptualisation of validity for validation studies (evaluation of tests) will be presented and discussed and participants will be asked to compare and then discuss three argument-based frameworks (Bachman, 2005; Bachman & Palmer, 2010 and Chapelle et al., 2008; and Kane, 2013a, 2013b) to test validation.
Day 2: We will focus on the methodological issues in language testing validation studies. An overview of mixed-methods research (MMR) and its development from a compatibility hypothesis will be presented and discussed. The congruence between a unitary and complementarity conceptualisation of validity as multi-faceted and the complementarity purpose of MMR will be particularly highlighted. Sample of validation studies with an MMR orientation will be presented and discussed to show case the above-mentioned congruence between conceptual (ontological) and methodological levels of the validation studies.
More information is available here.