ValiDiS

Competence modelling and assessment: Validation of the test score interpretations of a scientific reasoning test

Abstract

The goal of project ValiDiS is to gather validity evidence for the test score interpretations of a scientific reasoning test for preservice science teachers, which has been developed during KoKoHs I in project Ko-WADiS. In ValiDiS, we will continue the longitudinal panel study which has been started in Ko-WADiS, in order to evaluate the instrument's sensitivity to known-group differences and the impact of covariates on competence development. Furthermore, we will investigate the test's sensitivity to interventions in which scientific reasoning competencies are trained. We will also investigate the predictive validity of our test score interpretations, evaluating the test scores' prognostic qualities on the participants' performance in real-life scientific problem solving situations. In addition to validity, we examine the generalizability towards other empirical science disciplines, testing to what degree the competencies which are assessed with the Ko-WADiS test can be used to solve scientific problems in disciplines such as psychology.

Aims and Research Questions

Our long-term goal is to provide a test instrument which can be used to evaluate academic programs in science teacher education. Only valid test score interpretations enable policymakers to base their decisions on the test results. In ValiDiS, we gather validity evidence from different sources, aiming at the following research questions: (1) To what extent can the performance measures of preservice teachers in the Ko-WADiS test be interpreted as valid indicators for scientific reasoning competencies? (2) To what degree can the competencies which are assessed with the test be generalized to other empirical science disciplines?

Project data