Is “Q-short” a useful approach for psychological assessment? Pitfalls and opportunities of short questionnaires for the measurement of psychological constructs

Chair(s): Christoph J. Kemper (University of Luxembourg, Luxembourg)

Presentations of the Symposium

Assessing personality and situation perception at the same time, in a short time

Matthias Ziegler¹, Kai Horstmann¹, Marko Vetter²; zieglema@hu-berlin.dezieglema@hu-berlin.de
¹Humboldt-Universität zu Berlin, Germany, ²Schuhfried GmbH, Austria

Following the ants: Pros and cons of Ant Colony Optimization (ACO) for short scale development

Anne B. Janssen¹, Martin Schultze², Adrian Grötsch³; a.janssen@jacobs-university.dea.janssen@jacobs-university.de
¹Jacobs University Bremen, Germany, ²Freie Universität Berlin, Germany, ³Technische Universität Braunschweig, Germany

Best practices in short scale development: Comparing state-of-the-art methods using simulated and empirical data

Peter M. Kruyen¹, Constanze Beierlein², Beatrice Rammstedt²; p.m.kruyen@gmail.comp.m.kruyen@gmail.com
¹Radboud University Nijmegen, The Netherlands, ²GESIS Leibniz Institute for the Social Sciences, Germany

On the effect of item positions in tests

Chair(s): Karl Schweizer (Goethe University Frankfurt, Germany), Siegbert Reiß (Goethe University Frankfurt, Germany)

Presentations of the Symposium

The impact of the position effect on the factorial structure of the Culture Fair Test (CFT)

Stefan J. Troche¹, Felicitas L. Wagner², Karl Schweizer³, Thomas H. Rammsayer²; Stefan.Troche@uni-wh.deStefan.Troche@uni-wh.de
¹Private Universität Witten/Herdecke, Germany, ²University of Bern, Switzerland, ³Goethe-University Frankfurt, Germany

The position effect in a Rasch-homogenous test: A fixed-links modeling approach

Philipp Thomas¹, Thomas H. Rammsayer¹, Karl Schweizer², Stefan J. Troche³; philipp.thomas@psy.unibe.chphilipp.thomas@psy.unibe.ch
¹University of Bern, Switzerland, ²Goethe University Frankfurt, Germany, ³Private Universität Witten/Herdecke, Germany

Predictors of an individual decrease in test performance during the PISA assessments

Johannes Hartig¹, Janine Buchholz¹, Dries Debeer², Rianne Janssen²; hartig@dipf.dehartig@dipf.de
¹DIPF, Germany, ²KU Leuven, Belgium

Modeling response omissions in tests using a tree-based IRT approach

Dries Debeer, Rianne Janssen; Rianne.Janssen@ppw.kuleuven.beRianne.Janssen@ppw.kuleuven.be
KU Leuven, Belgium

On the search for the best possible representation of the item-position effect: A simulation study based on APM

Florian Zeller, Siegbert Reiss, Karl Schweizer; Florian.zeller@outlook.comFlorian.zeller@outlook.com
Goethe University Frankfurt, Germany

Recent methodological developments for testing measurement invariance

Chair(s): Carolin Strobl (Universität Zürich, Switzerland)

Presentations of the Symposium

Detecting violations of measurement invariance in item response theory

Carolin Strobl¹, Julia Kopf², Basil Abou El-Komboz², Achim Zeileis³; carolin.strobl@uzh.chcarolin.strobl@uzh.ch
¹Universität Zürich, Switzerland, ²LMU München, Germany, ³Universität Innsbruck, Austria

Score-based tests of measurement invariance with respect to continuous and ordinal variables

Achim Zeileis¹, Edgar C. Merkle², Ting Wang²; Achim.Zeileis@uibk.ac.atAchim.Zeileis@uibk.ac.at
¹Universität Innsbruck, Austria, ²University of Missouri, USA

Exact versus approximate measurement invariance. Theoretical overview and empirical examples

Jan Cieciuch, Eldad Davidov, René Algesheimer; jancieciuch@gazeta.pljancieciuch@gazeta.pl
Universität Zürich, Switzerland

Differential item functioning in cognitive diagnosis models

Michel Philipp¹, Carolin Strobl¹, Achim Zeileis²; m.philipp@psychologie.uzh.chm.philipp@psychologie.uzh.ch
¹Universität Zürich, Switzerland, ²Universität Innsbruck, Austria

Cross-cultural assessment

Chair(s): Fons van de Vijver (Tilburg University, The Netherlands)

Presentations of the Symposium

Controlling for culture-specific response bias using ipsatization and response style indicators: Family orientation in fourteen cultures and two generations

Boris Mayer; boris.mayer@psy.unibe.chboris.mayer@psy.unibe.ch
University of Bern, Switzerland

The qualitative assessment of bias: Contributions of cognitive interviewing methodology to the bias definition

Isabel Benítez Baena¹, Fons van de Vijver², José-Luis Padilla García³; ibenitez@ugr.esibenitez@ugr.es
¹University of Granada, Spain, Tilburg University, The Netherland, ²Tilburg University, The Netherlands, ³University of Granada, Spain

The internal structure of the guilt and shame domain across cultures

Johnny Fontaine; Johnny.Fontaine@UGent.beJohnny.Fontaine@UGent.be
Ghent University, Belgium

Extreme response style in attitudinal and behavioral questions

Jia He¹, Isabel Benítez Baena², Byron Adams¹, Fons van de Vijver¹; Fons.vandeVijver@uvt.nlFons.vandeVijver@uvt.nl
¹Tilburg University, The Netherlands, ²University of Granada, Spain, Tilburg University, The Netherland

On the validity of objective personality tests: What do they measure?

Chair(s): Tuulia M. Ortner (University of Salzburg, Austria)

Presentations of the Symposium

Economic games as objective personality measures – Stability, reliability, and validity

Simona Maltese¹, Anna Baumert¹, Thomas Schlösser², Manfred Schmitt¹; maltese@uni-landau.demaltese@uni-landau.de
¹University of Koblenz-Landau, Germany, ²University of Cologne, Germany

An objective task-based personality test for assessing risk propensity: Analyzing feedback and convergent validity of the PTR

Victor Rubio, David Aguado, Marta Antúnez, José Santacreu; victor.rubio@uam.esvictor.rubio@uam.es
University Autonoma Madrid, Spain

Is it a "test"? Psychometric criteria of the Balloon Analogue Risk Task

Tuulia M. Ortner¹, Michael Eid², Tobias Koch²; tuulia.ortner@sbg.ac.attuulia.ortner@sbg.ac.at
¹University of Salzburg, Austria, ²Free University of Berlin, Germany

Neuroimaging implicit and explicit assessment

Belinda Pletzer, Tuulia M. Ortner; belinda.pletzer@sbg.ac.atbelinda.pletzer@sbg.ac.at
University of Salzburg, Austria

The assessment of 21st century skills

Chair(s): Samuel Greiff (University of Luxembourg, Lucembourg)

Discussant(s): Arthur C. Graesser (University of Memphis, USA)

Presentations of the Symposium

Simulation-based assessment of ICT skills

Frank Goldhammer¹, Lena Engelhardt², Johannes Naumann³, Andreas Frey⁴, Katja Hartig³, Holger Horz³, Kathrin Kuchta³, Franziska Wenzel⁴; goldhammer@dipf.degoldhammer@dipf.de
¹DIPF and ZIB, Germany, ²DIPF, Germany, ³Goethe-University Frankfurt, Germany, ⁴University of Jena, Germany

Processes and predictors of digital reading literacy: What we can and cannot learn from large-scale assessments

Johannes Naumann¹, Frank Goldhammer², Ladislao Salmerón³; j.naumann@em.uni-frankfurt.dej.naumann@em.uni-frankfurt.de
¹Goethe-University Frankfurt, Germany, ²DIPF and ZIB, Germany, ³University of Valencia, Spain

The role of complex problem solving in university success

Matthias Stadler¹, Nicolas Becker², Christoph Niepel¹, Samuel Greiff¹; matthias.stadler@uni.lumatthias.stadler@uni.lu
¹University of Luxembourg, Luxembourg, ²University of Saarbrucken, Germany