Critical Thinking Assessments in Three African Countries, 2015-2019

McCowan, Tristan and Schendel, Rebecca and Rolleston, Caine and Tolmie, Andy and Omingo, Mary and Adu-Yeboah, Christine and Tabulawa, Richard (2021). Critical Thinking Assessments in Three African Countries, 2015-2019. [Data Collection]. Colchester, Essex: UK Data Service. 10.5255/UKDA-SN-854036

New understanding of the ways in which higher education contributes to economic and human development has strengthened the justification for investment in higher education in lower-income contexts in recent years. This, in turn, has prompted a wave of reform and revitalisation efforts within African higher education systems. One of the primary assumptions motivating such reforms is that higher education encourages the ability to think critically about problems and to use evidence when making decisions. However, there is evidence to suggest that the assumption that students improve their critical thinking skills as a result of university study may not be valid in many African contexts. Concern about the capacity of graduates from African universities to demonstrate 'high skills', such as critical thinking, has prompted a growing recognition of the need for pedagogical change within many African higher education institutions. A problem for higher education policy in the region, however, is that this renewed interest in the importance of teaching and learning is supported by limited empirical evidence, as there has been little analysis of the effectiveness of pedagogical practice within African universities. Although there is a substantial body of literature investigating the ways in which academic experiences at university can positively influence the development of student critical thinking skills, much of the current evidence rests on research conducted in other cultural contexts, particularly the USA, UK, Australia and, to a limited extent, East Asia. There are, therefore, concerns about how applicable such findings may be to African university contexts.
This project aims to expand the existing evidence base around how pedagogical practices affect the development of critical thinking at African higher education institutions by investigating the impact of locally-generated pedagogical interventions on student critical thinking ability in Kenya, Ghana and Botswana. The study follows a mixed methods design, comprising a longitudinal study of student outcomes and a qualitative investigation of how institutions are able to encourage processes of pedagogical change. In each country context, our institutional sample will consist of six faculties: three which have been purposively selected due to their attempts at pedagogical reform, and three 'matched' faculties which have similar characteristics to the intervention faculties but have not yet attempted any pedagogical interventions. Within each faculty, a random sample of 100 incoming students will complete a critical thinking assessment (adapted for use in the study contexts) at the beginning of their first year and again at the end of their second year at university. Gains in assessment scores will be compared between faculties, in order to investigate whether students enrolled in the intervention faculties demonstrate more progress than students enrolled in faculties which have not attempted any pedagogical reform. Additional analysis will investigate which pedagogical practices have the strongest impact on improvements in critical thinking ability. Parallel to the longitudinal study, in-depth qualitative case studies will be conducted within the 'intervention' Faculties, in order to gain insight into the intervention implementation process. The results of the project will provide potentially generalisable evidence of the effectiveness of pedagogical interventions currently being implemented within African universities.

Data description (abstract)

The study adopted a mixed methods design, comprising a longitudinal study of student outcomes and a qualitative investigation of how institutions are able to encourage processes of pedagogical change. The quantitative data are made available here.
The study used a quasi-experimental approach, involving naturally occurring cases of novel intervention. In order to assess the impact of these interventions on critical thinking, we compared these interventions to other cases which, as far as possible, differed only in the absence of such intervention (i.e. a prospective cohort design with comparison over time between intervention cases and matched controls).
After the second assessment, gains in scores on the critical thinking assessment were compared, in order to investigate whether students enrolled in the ‘intervention’ faculties demonstrated more progress than students enrolled in faculties which had not attempted any pedagogical reform. Additional analysis of the quantitative results helped us to determine which pedagogical practices had the strongest impact on improvements in critical thinking ability and investigate the possibility of differential impact across students.

Downloads

Altmetric