EBE Great Teaching Evidence Review
In June 2020 Evidence Based Education published their Great Teaching Toolkit. It provided evidence-based insights and focused on areas of practice with potential to improve student learning and outcomes.
The review identified four priorities for teachers who want to help their student learn more:
- Understand the content they are teaching and how it is learnt
2. Create a supportive environment for learning
3. Manage the classroom to maximise the opportunity to learn
4. Present content, activities and interactions that activate their students’ thinking
We know activating students’ thinking is crucial despite the term “thinking” appearing to be purposely avoided in Ofsted’s Inspection framework while “knowledge” is mentioned eight times. However, the EBE Great Teaching Evidence Review is unequivocal on the importance of thinking hard stating:
“In many ways, Dimension 4 represents the heart of great teaching: getting students to think hard about the material you want them to learn. It may also be the hardest part of the job to learn, …”.
Bjork’s Desirable Difficulties
The need for students to think hard has become associated with the work of cognitive psychologists Elizabeth and Robert Bjork. They coined the term ‘desirable difficulties’, the concept that there are ways of learning that may feel less effective and lead to more errors during the learning process, but that lead to better performance in the long term. As they explained:
“Conditions of learning that make performance improve rapidly often fail to support long-term retention and transfer, whereas conditions that create challenges and slow the rate of apparent learning often optimize long-term retention and transfer.” Bjork, E. L., & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning.
Many aspects of the Bjorks’ work are being used in classrooms such as interleaving, spacing and retrieval practice. etc However a less well-known aspect of their work is the generation effect. The generation effect refers to the long- term benefit of generating an answer, solution, or procedure versus being presented that answer, solution, or procedure. The Bjorks’ argue:
“Basically, any time that you, as a learner, look up an answer or have somebody tell or show you something that you could, drawing on current cues and your past knowledge, generate instead, you rob yourself of a powerful learning opportunity.”.
Piaget: assimilation and accommodation
Advances in cognitive science have often been seen as challenging earlier theories of learning from Piaget and Vygotsky, yet there is greater synergy than many suggest. The Bjorks’ desirable difficulties echoes aspects of Piaget’s ideas. Piaget through his work on cognitive development introduced the idea of schema. He described schema as: “a cohesive, repeatable action sequence possessing component actions that are tightly interconnected and governed by a core meaning” (Piaget,1952, p. 7) . In developing schema Piaget identified two processes: assimilation and accommodation.
Assimilation is the process by which new knowledge is placed into existing knowledge schemas. For example, pupils may expect poems to rhyme so when they encounter a rhyming poem, they assimilate it in their existing schema as it fits. Accommodation by contrast is the process when existing knowledge has to be adapted to new knowledge. For example, students meet a poem for the first time that doesn’t rhyme and have to draw upon other features to classify the text. Accommodation creates an imbalance, demanding that we think hard as new information does not seamlessly integrate with existing mental schema. As schemas are challenged students have a sense of disequilibrium before accommodation takes place and equilibrium is restored. The key is to seek productive challenges evoking a state of disequilibrium but can be reconciled and assimilated with time.
Vygotsky: Zone of Proximal Development and More Knowledgeable Other
Similarly, in the Bjorks’ work we can see the trace of “zone of proximal development,” (zpd) a concept first proposed in the 1930s by the Russian psychologist Lev Vygotsky. Vygotsky defined the zpd as “the distance between the actual developmental level as determined by individual problem solving and the level of potential development as determined through problem solving under adult guidance or in collaboration with more capable peers” (Vygotsky, 1978, p. 86) . Zones of proximal development have upper and lower boundaries. If we push students to think beyond the upper limit of their zone of proximal development, they are likely to experience frustration and disengagement. However, teach them below the lower limit and it is unlikely they will think hard. The challenge is to find the sweet spot, but this is complicated when you have a class of 30 students who may all have a different ZPD; we will return to ways of approaching this challenge later.
Learning versus performance and poor proxies for learning
In their paper “Learning versus Performance” , Nicholas C. Soderstrom and Robert A. Bjork clarify the distinction between the two. Performance is “what can be observed and measured during instruction or training”. Learning, by contrast, can take place after performance but also improvements in performance can fail to yield significant learning. Furthermore:
“performance is often fleeting and, consequently, a highly imperfect index of learning does not appear to be appreciated by learners or instructors who frequently misinterpret short-term performance as a guide to long-term learning.”
A high performing class may not be an environment where learning is sticking. This recalls Professor Robert Coe’s Poor Proxies for learning from his 2013 paper ‘Improving Education: A Triumph of Hope Over Experience’and how we might confuse learning with the veneer of performance:
It’s worth pointing out the above proxies may be desirable and can lead to learning. Who doesn’t want engaged, interested and motivated students? However, there is no guarantee that engaged students are learning rather than performing. We can envisage a situation where students are completing lots of written work but are not being challenged so learning doesn’t stick but is washed away. Coe claims: “Learning happens when people have to think hard” while at the same time recognising the statement is “over-simplistic, vague…”. While Soderstrom and Bjork claim: “Conditions that induce the most errors during acquisition are often the very conditions that lead to the most learning!” One can envisage why a class displaying some of poor proxies for learning might reassure whereas a class committing errors could be misjudged in the moment.
CASE: long and far transfer
If we accept the distinction between learning and performance, then Soderstrom and R Bjork claim:
“The major goal of instruction—whether in the classroom or in the field—is, or at least should be, to equip the learner with the type of knowledge or skills that are durable (i.e., capable of sustaining long periods of disuse) and flexible (i.e., capable of being applied in different contexts) “.
The need for durability recalls Sweller’s CLT and has become the bedrock of Ofsted’s Inspection Framework which claims:
“Learning can be defined as an alteration in long-term memory. If nothing has altered in long-term memory, nothing has been learned.”.
Sonderstrom and Bjork’s goal is more subtle with the inclusion of durable and flexible skills and knowledge. What is the goal of knowledge? Knowledge can be a goal in itself, but we also need to develop a relationship with the knowledge we acquire. Can we evaluate the knowledge we have? Is it flexible and can we apply it in different moments, settings and situations? Are we willing to review and reflect upon our knowledge? Sonderstrom and Bjork seem to suggest we should seek educational programmes that are durable with results that are long lasting and flexible so they can be applied in different contexts. It just so happens that such a programme exists.
The ‘Cognitive acceleration’ programmes (CA) were developed by Michael Shayer and Philip Adey at King’s College London. Cognitive acceleration would evolve over time and become known as Let’s Think www.letsthink.org.uk The aim of the CA programmes was the promotion of higher-level thinking in students. Research carried out over 25 years at King’s College London demonstrated students who experienced a (CA) programme scored higher than matched control groups:
- on measures of cognitive development immediately at the end of the programme and subsequently;
- in the subject matter of the programme (e.g. science, maths) up to three years after the end of the programme;
- also, in subjects remote from the subject context up to three years after the end of the programme. For example, students who followed Let’s Think over two years in a science context when they were 12-13 years old, went on to score significantly higher grades in an English examination taken when they were 16.
CASE has been proved to raise students’ attainment significantly in at least 20 international trials – see Let’s Think in Science (CASE) efficacy
CASE lessons had a learning sequence called the pillars.
Central to the pillars was the concept of cognitive conflict. Shayer and Adey defined cognitive conflict as:
“The term used to describe an event or observation which the student finds puzzling and discordant with previous experience or understanding. All perceptions are interpreted through the learners’ present conceptual framework. Where conceptualisation fails to make sense of an experience, cognitive conflict can lead to constructive mental work by students to accommodate their conceptual framework to the new type of thinking necessary.”
Conflict needed to be carefully judged by the teacher or curriculum developer to be within a context which is somewhat familiar to the student and while making a real cognitive demand on the student, not be so far ahead as to be incomprehensible.
The Concepts in Secondary Mathematics and Science Survey
When considering how we support pupils to think hard we need to consider their present level of understanding of a particular topic. The Concepts in Secondary Mathematics and Science Project (CSMS) was established in (1974-80) and looked at the problems involved in educating the whole ability range of students in comprehensive schools. Surveying 14000 students from 45 schools it found:
- In the population as a whole, fewer than 30 percent of 16 year-olds were showing the use of early formal operations.
- The range of thinking within any one age group was far wider than had been previously realised. The CSMS data showed that there is likely a 12 year gap between the most able and least able children in the first year of secondary education. In mixed ability schools, the most able 12 years olds were operating at the level of average 18 years olds and the least able at the level of average 6 years-olds.
In Towards a Science of Science Teaching , Shayer and Adey explained the methods and results of the research programme. It gave an account of testing instruments (Science Reasoning Tasks) which teachers could use to assess the cognitive levels of their students and gave details of a curriculum analysis taxonomy for analysing the level of difficulty of any science activity. The book showed that there were significant areas of mismatch in terms of the cognitive demands of the curricula.
Towards a Science of Science Teaching highlighted the importance of identifying the emerging thinking schemas needed for successful learning, reviewing pupils understanding of the schema at different stages of development and considering how best to prepare them for new learning in the identified schemas.
Let’s Think in English: thinking hard with support
What should pupils think hard about in English?
Let’s Think in English (LTE) was closely modelled on Shayer and Adey’s Cognitive Acceleration in Science Education (CASE). The LTE lessons stimulate schemas or reasoning patterns which underpin deeper understanding of texts. LTE seeks to develop five forms of reasoning with pupils:
Classification: exploring genre, text type, character type, form.
Frames or reference: considering perspectives, contexts and re-presenting texts for different purposes.
Symbolic representation: identifying and understanding the shift from literal to figurative in texts, character, setting or considering objects that stand for more than it is.
Intentions and consequences: the methods, techniques, and choices a writer has made to achieve their intent.
Narrative sequencing: considering the chronology, pace, emphasis, narrator of a text.
In LTE we seek to develop pupils’ ability to reason in English. Reasoning is identifying patterns in new sources of information and we seek to develop pupils’ ability to apply the five schemas to texts. Over time pupils see links between texts as they become increasing aware of the structures of the text as well as the content. Once they become aware of how experts – accomplished writers – structure texts they can start to incorporate and imitate these structures into their own writing.
By identifying the underpinning schemas that support understanding of texts we can start to identify progression within them and evaluate pupils’ understanding at different stages of development. If we take narrative sequencing we would expect a year 2 pupil to be able to sequence events into a chronological order. They would have an awareness of narrative structure and expectations of a beginning, middle and end to a story. As pupils progress into upper KS2 they can order a set of events along a variety of relevant criteria including non-chronological and may question the order of events if there is inconsistency. The awareness of plot may have progressed towards understandings of models of narrative like the story mountain and they should have greater awareness of complex narrative techniques like flashbacks or foreshadowing. Whereas by KS3 they may be able to provide an account of the implicit order of the events in a text and recognise the merits of the narrative sequence selected while appreciating or evaluating alternatives.
Identifying the schemas to be developed, considering progression within them and appreciating pupils’ typical stages of development ensures pupils’ thinking is directed appropriately and teachers can design suitable challenges for their classes. The Great Teaching Toolkit recognises the importance of this under its first sub-heading:
Structuring and preparing to think hard
Structuring is an important concept when considering how we support pupils to think hard. Pupils require a platform of understanding before they can embark on a difficult challenge. In Let’s Think in English pupils develop understanding of the texts through two important stages: concrete preparation and social construction before they undertake the most challenging stage of the lesson: cognitive conflict.
One can see how this sequence prepares pupils for the demand of cognitive conflict in our KS3 lesson The Bridge. The lesson uses a short narrative to explore the characters’ moral responsibility for events, establishes the concept of a fable, before asking the students to consider the importance of characters’ motives. You can review the lesson plan at: https://www.letsthinkinenglish.org/sample-lessons/
The lesson sequence starts with concrete preparation as pupils clarify what a civil war is and who the America Civil War was between. This is not something pupils think hard about as they either know or don’t know. If a pupil knows they are invited to explain to the class, if not the teacher explains. Next pupils read the text:
When we want pupils to think hard we need clarity as the Great Teaching Toolkit highlights in the second section:
The task pupils undertake individually at the start of social construction is to rank the five characters in terms of who they think is most to least responsible for the woman’s death. This is a challenging task; teachers who undertake the same task come to different conclusions and have differing reasons for their order. To support pupils, we need to clarify information that may seem obvious but is crucial: who are the five characters in the text. If we recall the ranges of cognition the CSMS project found, then after reading this text some pupils will immediately be able to recall all five characters while others will struggle. Trying to recall the five characters is an unnecessary distraction from their thinking which can be avoided by recapping and providing them with a sheet with the characters’ listed.
The benefits of thinking hard together
In the social construction phase of the lesson pupils develop their understanding of the text. In this instance, they consider individually who was responsible for the woman’s death, working from most responsible to least responsible. This task requires pupils to think hard but it is a manageable difficulty as pupils have impulsive reactions to the text: “The woman is most responsible because she cheated”, “The husband is the least responsible as he wasn’t there.”
However, pupils are required to think harder when they are asked to share their responses with their peers and come to an agreed order. Now individual thoughts are exposed to scrutiny and must be justified. Pupils have to make their thinking visible and accessible to another and may have to defend their choices. Justification is best found in the text so pupils may still argue the woman is to blame because she cheated but may also identify the importance of “took a lover” as it indicates she instigated the affair. They might support their opinion the lover is responsible as “he refused” to give her the money with “refused” indicating he had the money and therefore a choice. Pupils understanding is developed further and they are provoked to re-evaluate once more as they share their agreed order with other groups in whole class feedback. Can their order stand up to the scrutiny of the whole class? Can they recognise the merits of alternative ways of considering responsibility? Is their knowledge flexible? Will they adapt based on new insights? Is it durable? Can they justify their order when faced with an alternative viewpoint?
Teachers’ support in focusing thinking
The teacher supports the pupils in these exchanges by highlighting important details the class might miss: “Was $100 a lot of money in the 1860s? Does that influence your order?” or challenging pupils to provide more robust reasoning: “Your group are arguing the solider is not the most responsible despite shooting the woman as his actions might be necessary. Can you explain further?”. The teacher also supports the pupils to ensure they are not distracted by unfounded speculation or misconceptions stepping in when necessary: “Is there anything in the text to suggest the husband and the solider are the same person? No? I agree so let’s stick to the text” or “Do you think it is likely that the woman would be allowed to swim across the river if she’s not allowed to cross it by foot?”. The teacher must support the pupils to keep their attention focused on aspects and enquiries regarding the text that are most fruitful without constraining their personal responses. The teacher supports pupils to think by as the Great Teaching Toolkit suggests: “using questions and dialogue to promote elaboration and connected, flexible thinking among learners.” but the teacher’s feedback also supports pupils to focus their attention on relevant details or possibilities.
Going beyond assimilation to accommodation
The social construction stage encourages pupils to think hard but the demand is typically manageable for individuals. All pupils can attempt to rank the characters although there is variance in the levels of justification. Typically, there is a convergence of thoughts with a common Year 7 order for responsibility: The woman, the soldier, the lover, the boatman and the husband. While the ranking activity in The Bridge allows for various possibilities which encourage pupils to think hard usually a class consensus is agreed after whole-class feedback.
For cognitive conflict the demand is increased as pupils must be presented with something puzzling or discordant with their initial impressions. The challenge is raised as they are asked to have empathy with the characters and consider good or acceptable reasons for the characters’ actions. Pupils are encouraged to review their first impulsive conclusions and work through the challenge of considering the opposite standpoint. When considering why the woman might make her choices pupils start to consider the time the text is set and its relevance.
Thinking moves beyond the impulsive and passionate responses that are typical of the ranking activity to a more deliberate and difficult consideration as they seek to accommodate a new way of reviewing the characters. If individuals were asked to undertake this task it would prove too difficult for many as they struggle to reverse their initial thoughts but working in a small group their zone of proximal development expands as they hear the insights of their peers and grapple with and build upon the ideas shared. Some of the possible motivations and reasons for the woman’s behaviour are listed below and are shared with the class after whole-class feedback as a point of comparison. The list is not exhaustive and there may be other possibilities the class may offer but no one pupil would provide all the possible reasons listed below.
Thinking hard collectively rather than individual responses
The teacher’s role is to control the pace of learning and to support all pupils to appreciate and actively engage with the responses given. Rather than asking: “Do we agree the war might help us to understand why the woman behaved as she did?” we ask more directed questions such as “X suggested we might understand the woman’s behaviour better when we consider the impact of the war. What do you think about that idea?”. The teacher is monitoring the room looking for indications of when the ideas being shared are beyond the understanding of the majority of the class. When this happens, the teacher can invite the pupils to return to their groups to consider their peers’ thoughts and provide time for them to appreciate the points shared. The group provides a safe space when thinking is hard and allows pupils to rehearse and share ideas. When pupils are thinking hard, teachers should consider their feedback carefully including whether or not praise supports the process or not (See blog post: In praise of neutrality). The Great Teaching Toolkit highlights the importance of feedback:
The suggestion is that feedback is largely from teacher to pupil. Yet feedback between pupils is important too and should be developed and fostered slowly building pupil efficacy and interdependence rather than over-reliance on the teacher.
Cycles of thinking: metacognition and conscious awareness
Let’s Think in English makes pupils consciously aware of their thought processes and supports them to critically evaluate their ideas. Developing awareness of thinking is not merely thinking hard but also reflecting upon the thoughts you have and how they were developed. Once more we can support pupils individually as suggested in the Great Teaching Toolkit:
But there is also merit in considering how as a class we arrive at interpretations and understanding. In The Bridge lesson, after considering good or acceptable reason for the characters’ actions groups are invited to discuss adaptations to the text to make it more entertaining without changing the plot. They consider back stories, narrative perspectives, dialogue etc and discuss where they might add these adaptations to the text and their impact. This is followed by metacognition as pupils reflect upon how their understanding of the text has changed throughout the lesson. Is their ranking still the same now? If so, why? If not, what has changed? When explaining how their ideas evolved, they often reference the input of another pupil as they recall their learning journey. Pupils plan for future learning as they evaluate what they have learnt during the lesson.
Learning and performance and the need for bridging
When we ask pupils to think hard it is likely performance might diminish in the short term. Learning is a continuum and pupils need support to think hard regularly not as a one-off activity and to revisit their learning. This is implied in the fifth recommendation from the Great Teaching Toolkit:
The Let’s Think in English lessons are taught fortnightly, so pupils are regularly provided with opportunities to think hard and reflect upon their learning. Importantly after the LTE lessons pupils are given opportunities for bridging: applying their learning in another setting. This links back to the idea of durable and flexible knowledge as suggested by the Bjorks. After an LTE lesson, teachers identify opportunities for pupils to build links with their LTE lesson. Following The Bridge lesson this might be comparing the sparse description with a section of a class novel and considering the writer’s contrasting choices. It may be reminding pupils of the process they undertook when deciding who was responsible in The Bridge before they draft an argument on another topic. Thinking needs to be practised but also activated to become fluent and secure. With time, pupils bridge from LTE lessons to other lessons unprompted, suggesting links and parallels.
Thinking hard: Pupil and Teacher
Philip Adey sounded a note of caution in his paper: “A model for the professional development of teachers of thinking”in July 2005:
“As with any approach to the teaching of thinking, the teachers need to have an understanding of the underlying principles and almost always need to re-engineer their classroom methods. I suggest that any approach to the teaching of thinking which offers a ‘quick fix’, or a set of simple tactics that a teacher can follow from printed material alone is underestimating the subtlety of the pedagogy required to enhance students’ thinking. In common with other programmes for teaching thinking, cognitive acceleration requires teachers to inspect their own assumptions about the nature of teaching and learning, and gradually to come to terms with quite new approaches in the classroom.”
As the Great Teaching Toolkit suggested, getting pupils to think hard “… may also be the hardest part of the job to learn.”. As I explained in the blog post: “The Mirror: Effective Professional Development” teachers need to be supported to think hard in order to support their pupils to do the same. Through a commitment to supporting teachers’ learning rather than immediate performance they can develop the knowledge, skills and expertise to support their pupils’ thinking.
References: Piaget, J., & Cook, M. T. (1952). The origins of intelligence in children. New York, NY: International University Press.  Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.  Soderstrom, Nicholas & Bjork, Robert. (2015). Learning Versus Performance: An Integrative Review. Perspectives on psychological science : a journal of the Association for Psychological Science. 10. 176-199. 10.1177/1745691615569000.  Adey & Shayer (1994, 97, 2001) Really Raising Standards (Routledge)  Towards a science of science teaching by Michael Shayer and Philip Adey. London: Heine‐mann Educational Books, 1981  Adey, Philip. (2006). A model for the professional development of teachers of thinking. Thinking Skills and Creativity. 1. 49-56. 10.1016/j.tsc.2005.07.002.