Using Vignette Testing to Measure Student Science Teachers’ Professional Competencies

Dorothee Brovelli^1, , Katrin Bölsterli¹, Markus Rehm² and Markus Wilhelm¹

¹Science Education, University of Teacher Education Lucerne, Switzerland

²Department of Chemistry & Didactics, University of Education Heidelberg, Germany

Cite this paper:
Dorothee Brovelli, Katrin Bölsterli, Markus Rehm and Markus Wilhelm. Using Vignette Testing to Measure Student Science Teachers’ Professional Competencies. American Journal of Educational Research. 2014; 2(7):555-558. doi: 10.12691/education-2-7-20

Abstract

Instruments to measure teachers’ professional competencies with good context validity have been discussed before. We propose a measuring instrument based on vignette testing that analyzes professional competencies for science education using extended teaching contexts. It assesses pedagogical content knowledge (PCK) and compares it to pedagogical knowledge (PK). The test consists of text vignettes that describe authentically complex teaching situations in biology, chemistry and physics and then asks open-ended questions. It is analyzed by means of content analysis, thereby integrating quantitative and qualitative methods. The evaluation of the instrument is indicative of a valid measurement instrument and has shown promising potential for assessing competencies. We used the vignette test to compare the competencies of students in different training programs and with different educational backgrounds with the objective of improving science teacher education. The testing format developed in this study proved to be able to assess teachers’ professional competencies validly in their situational context of teaching. Results show a significant increase in competencies among science teacher students in the course of their training. The results of the control group (science students not pursuing a career in teaching) are remarkably poorer. Moreover, differences were identified when comparing the vignette based competency profiles of science teacher students and teacher students of other subjects, the latter scoring significantly lower in PCK. In addition, we compared competencies of students from different teacher training programs and found differences for students trained in interdisciplinary approaches (combining the disciplines biology, chemistry and physics) and students in separate-discipline approaches.

Keywords:
vignette test professional competencies science education teacher training

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]	Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., Klusmann, U., Krauss, S., Neubrand, M. and Tsai, Y.-M. (2010). Teachers' mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47, 133-180.
[2]	Brovelli, D., Bölsterli, K., Rehm, M. and Wilhelm, M. (2013). Erfassen professioneller Kompetenzen für den naturwissenschaftlichen Unterricht-ein Vignettentest mit authentisch komplexen Unterrichtssituationen und offenem Antwortformat. Unterrichtswissenschaft, 41, 306-329.
[3]	Jeffries C. and Maeder D. (2011). Comparing vignette instruction and assessment tasks to classroom observations and reflections. The Teacher Educator, 46, 161-175.
[4]	Kersting, N., Givvin, K., Sotelo, F. and Stigler, J. (2010). Teachers’ Analyses of Classroom Video Predict Student Learning of mathematics: Further Explorations of a Novel Measure of Teacher Knowledge. Journal of Teacher Education, 61, 172-181.
[5]	Mayring, P. (2000). Qualitative content analysis. Forum: Qualitative Social Research, 1 (2).
[6]	Oser, F., Heinzer, S. and Salzmann, P. (2010). Die Messung der Qualität von professionellen Kompetenzprofilen von Lehrpersonen mit Hilfe der Einschätzung von Filmvignetten. Unterrichtswissenschaft, 38, 5-28.
[7]	Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57, 1-21.
[8]	Riese, J. and Reinhold, P. (2012). Die professionelle Kompetenz angehender Physiklehrkräfte in verschiedenen Ausbildungsformen. Zeitschrift für Erziehungswissenschaft, 15, 111-143.
[9]	Stecher, B., Le, V., Hamilton, L., Ryan, G., Robyn, A. and Lockwood, J. (2006). Using structured classroom vignettes to measure instructional practices in mathematics. Educational Evaluation and Policy Analysis, 28, 101-130.
[10]	Voss, T., Kunter, M. and Baumert, J. (2011). Assessing teacher candidates' general pedagogical/psychological knowledge: Test construction and validation. Journal of Educational Psychology, 103, 952-969.