Pre-service teachers’ experiences with a digital examination design: The inter-relation between continuity and change in an institutional context

  • Erik Adalberon Universitetet i Agder
  • Trond Eiliv Hauge Universitetet i Oslo
  • Roger Säljö Göteborgs universitet
##plugins.pubIds.doi.readerDisplayName##: https://doi.org/10.5617/adno.6864

Sammendrag

Abstract
This article reports a study of a full-scale digital examination in a five-year master program of teacher education in Norway. The innovative design involves observing a video case based on an authentic classroom situation and analysing the case in light of educational theory and subject content knowledge. All parts of this format are to be solved on a computer with Internet access. The study is centred on the pre-service teachers’ experiences of this open-ended and unfamiliar testing format. More specifically, the intention has been to analyse (a) what kinds of preparations they engaged in; (b) how they solved tasks during the examination; (c) their reflections on this mode of examination. Interviews with 11 informants have been conducted, and the content is summarized in three selected cases, and finally across the interview sample. The results indicate that innovations like this are interpreted and approached against the background of pre-service teachers’ expectations, and the open format engaged the pre-service teachers to draw upon a wide range of resources both when preparing and solving the tasks. It is, however, timely to question whether the introduction of the examination format, based on faculty interest and intentions, will have the intended impact on evaluation procedures in an established learning culture.

Keywords: digital examinations, Higher education, teacher education, video,

Lærerstudenters erfaringer med et digitalisert eksaminasjons-design: Den gjensidige relasjonen mellom kontinuitet og forandring i en institusjonell kontekst

Sammendrag
I denne artikkelen rapporteres en studie av en fullskala digital eksamen som har blitt benyttet i et femårig masterprogram i norsk lærerutdanning. Det innovative designet er en firetimers nettbasert og digital eksamen basert på observasjon av en video case fra en autentisk klasseromssituasjon, og en analyse på bakgrunn av pedagogisk og fagdidaktisk teori. Hele eksamenen besvares via en datamaskin med nettilgang. Studien er rettet mot studentenes erfaringer med denne åpne og ukjente eksamensformen. Mer spesifikt er intensjonen å analysere a) hva slags forberedelser de gjorde, b) hvordan de løste eksamensoppgavene under selve eksamen, og c) refleksjonene de hadde etter en slik eksamensform. Intervjuer med elleve informanter ble gjennomført, og innholdet oppsummert i tre case-studier samt en tematisk studie på tvers av utvalget. Resultatene tyder på at slike innovasjoner blir tolket og bearbeidet på bakgrunn av studentenes forventninger, og at de benyttet en rekke ulike ressurser for forberedelsene til og gjennomføringen av eksamen. Det er imidlertid betimelig å stille spørsmål om innføringen av et slikt eksamensformat, basert på fakultetets interesser og intensjoner, vil ha den ønskede påvirkningen på vurderingsprosedyrer i en etablert læringskultur

Nøkkelord: eksamen, høyere utdanning, lærerutdanning, video, digital eksamen

Referanser

Admiraal, W., Hoeksma, M., van de Kamp, M.-T., & van Duin, G. (2011). Assessment of teacher competence using video portfolios: Reliability, construct validity, and consequential validity. Teaching and Teacher Education, 27(6), 1019–1028. doi:http://dx.doi.org/10.1016/j.tate.2011.04.002

Allern, M., & Engelsen, K. S. (2008). Mapper i digitale læringskontekstar–erfaringar og perspektiv frå høgre utdanning [Portfolios in digital learning contexts – experiences and perspectives from higher education]. Tromsø: Norgesuniversitetets skriftserie.

Blomberg, G., Renkl, A., Sherin, M., Borko, H., & Seidel, T. (2013). Five research-based heuristics for using video in pre-service teacher education. Journal for Educational Research Online, 5(1), 90–114.

Blomberg, G., Sherin, M., Renkl, A., Glogger, I., & Seidel, T. (2014). Understanding video as a tool for teacher education: Investigating instructional strategies to promote reflection. Instructional Science, 42(3), 443–463.

Borko, H. (2016). Methodological contributions to video-based studies of classroom teaching and learning: A commentary. ZDM, 48(1-2), 213–218.

Boud, D., Dawson, P., Bearman, M., Bennett, S., Joughin, G., & Molloy, E. (2018). Reframing assessment research: Through a practice perspective. Studies in Higher Education, 43(7), 1107–1118. doi:10.1080/03075079.2016.1202913

Boulet, J. R. (2008). Summative assessment in medicine: The promise of simulation for high-stakes evaluation. Academic Emergency Medicine, 15(11), 1017–1024.

Christ, T., Arya, P., & Chiu, M. M. (2017). Video use in teacher education: An international survey of practices. Teaching and Teacher Education, 63, 22–35.

Chung, R. R. (2008). Beyond assessment: Performance assessments in teacher education. Teacher Education Quarterly, 35(1), 7–28.

Court, S., & Bamber, V. (2009). Against the grain: E-assessment in the physical sciences. In V. Bamber, M. Saunders, & P. Trowler (Eds.), Enhancing learning, teaching, assessment and curriculum in higher education theory, cases, practices (pp. 40–46). Maidenhead, England: Open University Press.

Darling-Hammond, L. (2016). Research on teaching and teacher education and its influences on policy and practice. Educational Researcher, 45(2), 83–91.

Darling-Hammond, L. (2014). Strengthening clinical preparation: The holy grail of teacher education. Peabody Journal of Education, 89(4), 547–561.

Den Nasjonale forskningsetiske komité. (2006). Forskningsetiske retningslinjer for samfunnsvitenskap, humaniora, juss og teologi [Guidelines for research ethics in the social sciences, humanities, law and theology]. Oslo: Forskningsetiske Komiteer.

Eraut, M. (1994). Developing professional knowledge and competence. Oxon, Routledge.

Fadde, P., & Sullivan, P. (2013). Using interactive video to develop preservice teachers’ classroom awareness. Contemporary Issues in Technology and Teacher Education, 13(2), 156–174.

Flott, E. A., & Linden, L. (2016). The clinical learning environment in nursing education: A concept analysis. Journal of Advanced Nursing, 72(3), 501–513. doi:10.1111/jan.12861

Gipps, C. (1999). Socio-cultural aspects of assessment. Review of Research in Education, 24, 355–392.

Golafshani, N. (2003). Understanding reliability and validity in qualitative research. The Qualitative Report, 8(4), 597–606.

Goldman, R., Pea, R., Barron, B., & Derry, S. J. (2006). Video research in the learning sciences. New York, NY: Routledge.

Grossman, P. (2005). Research on pedagogical approaches in teacher education. In M. Cochran-Smith & K. Zeichner (Eds.), Studying teacher education: The report of the AERA panel on research and teacher education (pp. 425–476). Mahwah, NJ: Erlbaum.

Hanson, N. R. (1958). The logic of discovery. The Journal of Philosophy, 55(25), 1073–1089.

Helle, L., & Säljö, R. (2012). Collaborating with digital tools and peers in medical education: Cases and simulations as interventions in learning. Instructional Science, 40(5), 737–744.

Hew, K. F., & Brush, T. (2007). Integrating technology into K-12 teaching and learning: Current knowledge gaps and recommendations for future research. Educational Technology Research and Development, 55(3), 223–252.

Hulsman, R. L., Mollema, E. D., Hoos, A. M., De Haes, J. C. J. M., & Donnison-Speijer, J. D. (2004). Assessment of medical communication skills by computer: Assessment method and student experiences. Medical Education, 38(8), 813–824. doi:10.1111/j.1365-2929.2004.01900.x

Hodkinson, P., Biesta, G., & James, D. (2007). Understanding learning cultures. Educational Review, 59(4), 415–427.

Ivanic, R., Edwards, R., Barton, D., Martin-Jones, M., Fowler, Z., Hughes, B., … Smith, J. (2009). Improving learning in college: Rethinking literacie across the curriculum. New York, NY: Routledge.

James, D., & Biesta, G. (2007). Improving learning cultures in further education. Oxon: Routledge.

King, E., & Boyatt, R. (2015). Exploring factors that influence adoption of e-learning within higher education. British Journal of Educational Technology, 46(6), 1272–1280.

Knight, P. (2002). Summative assessment in higher education: Practices in disarray. Studies in Higher Education, 27(3), 275–286.

Knight, S., Shum, S. B., & Littleton, K. (2014). Epistemology, assessment, pedagogy: Where learning meets analytics in the middle space. Journal of Learning Analytics, 1(2), 23–47.

Korthagen, F. A. (2017). Inconvenient truths about teacher learning: Towards professional development 3.0. Teachers and Teaching, 23(4), 387–405. doi:10.1080/13540602.2016.1211523

Krumsvik, R., & Smith, K. (2009). Videopapers – An attempt to narrow the notorious gap between theory and practice in teacher education. Technology, Pedagogy and Education, 18(3), 269–278. doi:10.1080/14759390903255544

Kvale, S. (2007). Doing interviews. London: Sage.

Laurillard, D., Oliver, M., Wasson, B., & Hoppe, U. (2009). Implementing technology-enhanced learning. In Technology-enhanced learning (pp. 289–306). New York, NY: Springer.

Lawless, K. A., & Pellegrino, J. W. (2007). Professional development in integrating technology into teaching and learning: Knowns, unknowns, and ways to pursue better questions and answers. Review of Educational Research, 77(4), 575–614.

Levin, B. B. (1995). Using the case method in teacher education: The role of discussion and experience in teachers' thinking about cases. Teaching and Teacher Education, 11(1), 63–79.

Ludvigsen, S., & Hoel, T. (2002). Et utdanningssystem i endring: IKT og læring [An educational system in change: ICT and learning]. Oslo: Gyldendal akademisk.

Lund, A., & Engelien, K. (2015). Oppgaver og vurdering i digitale omgivelser [Tasks and assessment in digital surroundings]. In A. Lund, U.

Rindal, & R. Jakhelln (Eds.), Veier til fremragende lærerutdanning [Roads to excellent teacher education] (pp. 136–147). Oslo: Universitetsforlaget.

Masats, D., & Dooly, M. (2011). Rethinking the use of video in teacher education: A holistic approach. Teaching and Teacher Education, 27(7), 1151–1162. doi:http://dx.doi.org/10.1016/j.tate.2011.04.004

McIntyre, D. J., & Pape, S. L. (1993). Using video protocols to enhance teacher reflective thinking. The Teacher Educator 28(3), 2–10.

Ottenbreit-Leftwich, A. T., Brush, T. A., Strycker, J., Gronseth, S., Roman, T., Abaci, S., … Plucker, J. (2012). Preparation versus practice: How do teacher education programs and practicing teachers align in their use of technology to support teaching and learning? Computers & Education, 59(2), 399–411.

Pape, S. L., & McIntyre, D. J. (1993). Student reactions to using video cases for evaluation of early field experiences. Paper presented at the Summer workshop of the association of teacher educators, Pittsburg, PA.

Petersson, E., Lantz-Andersson, A., & Säljö, R. (2013). Virtual labs as context for learning–Continuities and contingencies in student activities. In E. Christiansen, L. Kuure, A. Mørch, & B. Lindström (Eds.), Problem-based learning for the 21st Century. New practices and learning environments (pp. 161–189). Aalborg: Aalborg University Press.

Plöger, W., Scholl, D., & Seifert, A. (2018). Bridging the gap between theory and practice – The effective use of videos to assist the acquisition and application of pedagogical knowledge in pre-service teacher education. Studies in Educational Evaluation, 58, 197–204. doi:https://doi.org/10.1016/j.stueduc.2017.12.009

Polly, D., Mims, C., Shepherd, C. E., & Inan, F. (2010). Evidence of impact: Transforming teacher education with preparing tomorrow's teachers to teach with technology (PT3) grants. Teaching and Teacher Education, 26(4), 863–870.

Prior, P. (2006). A sociocultural theory of writing. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 54–66). New York, NY: The Guilford Press

ProTed. (2011). The ProTed Centre vision and aims. Oslo: Department of Teacher Education and School Research, University of Oslo.

Raaheim, A., Mathiassen, K., Moen, V., Lona, I., Gynnild, V., Bunæs, B. R., & Hasle, E. T. (2018). Digital assessment – How does it challenge local practices and national law? A Norwegian case study. European Journal of Higher Education, 1–13. doi:10.1080/21568235.2018.1541420

Santagata, R., & Guarino, J. (2011). Using video to teach future teachers to learn from teaching. ZDM, 43(1), 133–145.

Schneider, J. (2018). Marching forward, marching in circles: A history of problems and dilemmas in teacher preparation. Journal of Teacher Education, 69(4), 330–340. doi:10.1177/0022487117742904

Schoenfeld, A. H. (2007). The complexities of assessing teacher knowledge. Measurement: Interdisciplinary Research and Perspectives, 5(2-3), 198–204. doi:10.1080/15366360701492880

Stürmer, K., & Seidel, T. (2015). Assessing professional vision in teacher candidates. Zeitschrift für Psychologie, 223(1), 54–63. doi:10.1027/2151-2604/a000200

Säljö, R. (2001). Læring i praksis: et sosiokulturelt perspektiv [Learning in practice: a sociocultural perspective]. Oslo: Cappelen akademisk.

Tripp, T. R., & Rich, P. J. (2012). The influence of video analysis on the process of teacher change. Teaching and Teacher Education, 28(5), 728–739.

Voogt, J., Knezek, G., Cox, M., Knezek, D., & ten Brummelhuis, A. (2013). Under which conditions does ICT have a positive effect on teaching and learning? A call to action. Journal of Computer Assisted Learning, 29(1), 4–14.

Vygotsky, L. S. (1978). Mind in society. Cambridge, MA: Harvard University Press.

Wiens, P. D., Hessberg, K., LoCasale-Crouch, J., & DeCoster, J. (2013). Using a standardized video-based assessment in a university teacher education program to examine preservice teachers knowledge related to effective teaching. Teaching and Teacher Education, 33(0), 24–33. doi:http://dx.doi.org/10.1016/j.tate.2013.01.010

Publisert
2019-11-20
Seksjon
Artikler