You can’t measure learning?

Dave Cormier says we live in a world obsessed with measurement. This is true, many have seen the potential for monetization in measurement, and that has led to a lot of meaningless measurement dressed as utility. But part of the reason why that has worked is that, in a world of uncertainty, many find measurements comforting. Rhizomatic thinking with its hefty dose of uncertainty is not exactly mainstream. Dave maintains that learning is a non-count noun (Speakers of other languages do speak of “learnings” might dispute that). But his key point is that you cant measure learning, even that you shouldn’t. I’ll take the bait.

You can measure learning, and we all do, and we need to. We are measurers, assessors. Not necessarily bean counters, but evaluators. You skim this post to gauge the reading time, and judge according to previous assessments you have made, perhaps unconsciously, of your capacity to engage with and process blogs in this space. You wonder to what extent you can engage with D and G to get under the skin of this rhizo thing. You quietly assess the different posts and messages to try to get a hold on what you should filter in or filter out. Managing participation in a cMOOC with the firehose full on requires continuous assessment of everything against your own subjective rubric, and not least your own progress: of course it is ipsative, we are all free to be subjective. But we do  assess our learning, and we do that competently, and regularly, making decisions on the basis of the results. Every fork in the path, every opening rabbit hole involves a micro-assessment, sometimes analytical, sometimes intuitive, sometimes the decision is to simply jump, but it is a decision. These are formative, sometimes transformative, assessments.

What is resisted is external measurement. We detest that. Because we feel that only we ourselves are capable of assessing our own learning meaningfully or legitimately. This is not negotiable from a rhizomatic perspective. Others cannot see the whole picture, lack the information to take those decisions for us. If they do, or when they do, it feels like an aggression, a judgement that fails to do justice to our learning, or our learning process. Summative assessment aims to encapsulate and package the learning, the transformation we have lived through, for external consumption. But in free range learning, the idea of an external summative decision is anathema.

At this point there comes a coyote moment.

Learning is rhizomatic. We can influence the growth of the plant, we can attempt to build channels and free spaces for it, and sometimes simplifications, potted rhizomes, will work (as Dave Cormier readily points out) but the kudzu keeps growing.

And in the end the rhizome takes us out beyond the edge of the cliff. Deep down in the warm earth we are free to muse and explore and root, we are even free to make privileged spaces in our classrooms and institutions for learning to take place, but at some point, the transmissionists ask as to prove it, to provide evidence. We have no framework for evidence, no structure, no scaffolding. The very notion of evidence is questionable. But we seem to be avoiding the question. Is there no possible framework for conversation about our rhizomes (not about the notion of the rhizome, but specific rhizomes, named rabbitholes)?

There are a whole load of things we can measure, ipsatively, formatively. We can develop rituals and conversations that enrich our growth, expand our curriculum, our community. The beacons we light, our campfire on the beach may attract others, and the idea may spread. But at some point we will have to address the fact that the notion of the rhizome is largely incompatible with formal learning. We can create privileged spaces. I have done what could be termed rhizomatic projects in formal education spaces and seen substantial transformation, but moving from the small success to widespread change is immensely challenging. There is a lot of inertia.

Some might say the idea of the rhizome is like kudzu grass, slowly undermining the foundations of formal learning. I would love to believe this, but I think that current conservative narratives, folk pedagogies around education, are extremely resilient. Models and examples will help, but formal funded education has to show evidences to parents, politicians and employers. We can’t avoid the need to measure “learning”, and as I have suggested I think we know how to measure, but we do need to reframe what kind of evidence is legitimate, and what kind of “learning” is valued.

Those are however political issues. But then learning, and education always have been political issues.

Post script:

Evidence is mostly understood as static, for the most part evidence is a dead letter from the past of the individual. Could new ways of providing evidence be structured around dialogue?



8 thoughts on “You can’t measure learning?

  1. Thanks, Nick – such an important conversation! I’m not prepared to equate assessment with measurement (measurement seems to me something non-subjective; it is measuring against a stick, a meter, a standard), but I do agree that we need to make learning VISIBLE: to students as they learn, to teachers as we help them learn, to administrators who watch over the process, to all the people who care about the outcomes (families, employers, the “public” etc.). But the evidence I want to show is not necessarily measurement data. Instead, I want to show student WORK, directly. That would be a lot to show, but I would settle for RANDOM instances to make it manageable (not the best, not the worst, let the magic power of randomness sort that out): if there are 1000 students in a school, show evidence for 10 or 100 of them at random in the form of learning portfolios. That is something I would far prefer to the results of standardized tests… and in my classes, I don’t give tests, but the students do all have writing to share and show! 🙂
    Project Nominations: a special post for #Rhizo15

    • Thanks Laura, assessment shouldn’t equal measurement, but the differences get elided. Measurement is seen as objective, assessment becuase more fluid, more subjective, therefore more questionable. Maybe the actual issue is with words. I like the word VISIBLE, but I wonder if COMPREHENSIBLE is not the word we need.

  2. I am guilty of resisting external measurement for some of the very reasons you mention. It is probably in my interest to find a way to provide evidences but it is so much more fun to enjoy the journey with my students.

  3. There is so much I like about this Nick. Most of all, I love this post because it challenges me to think, to clarify, to reassess. It sets the bar high. It will take some time to craft a reply. Maybe a few years…

  4. Hi Nick – love this post and it made my mind jump between a thousand diff things. I kept starting a blogpost to respond and stopping as my mind shifted to sthg else.
    I am definitely one who resists external measures of learning. And yet you’re right that at some point we are asked for evidence (and i think this may be sthg Dave is asking us but i never know for sure). Just today was thinking how do i explain to my colleagues what i ak learning in rhizo15 and what i did for #et4buddy? Showing evidence is different from counting tho so i now have an idea of a hilarious post about counting!

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s