Adaptive Assessment and the Purposes of Educational Technology (AERA, Part 3)

Roy Pea has long-studied educational technology and, in this interchange with Larry Cuban hosted by Tapped In, reminds us that:

A second caution is replacing flesh with silicon. The point here about technology is to augment physical, hands-on learning, face-to-face encounters, not to replace it, and yet, certainly, there may be places that come to feel that interactive programs, simulations, teleconferencing, travels in cyberspace, are cheaper, more effective, and easier to conduct than the real thing. Let’s watch out for that. (The Pros and Cons of Technology in the Classroom, 1998)

That said, as I listened to him talk about adaptive technologies that monitor and respond to student progress (ala Khan Academy), I became increasingly concerned. Captured in these tweets, here are some of the “benefits” that Pea described, without much in the way of critique, posted in reverse chronological order:

Troy HicksTroy Hicks ? @hickstro

Being an #edtech advocate, I am becoming concerned about the focus on collection of student metadata, both implicit and explicit. #AERA2012

Roy Pea: adaptive systems create large scale testbeds to do experiments in comparative pedagogy; expand social networks for learn #AERA2012

Roy Pea: Expand learner access to data in relation to others creating a networked systems of learners in adaptive learning systems #AERA2012

Roy Pea: expand data gathering outside of school contexts; give access of data to learners themselves (performance dashboards)#AERA2012
Roy Pea: learner perceptions and motions (& emotions); capturing uses of written language; expanding our sense-making techniques#AERA2012
Roy Pea: By expanding profile metadata, greater context of learner’s history of learning, capturing learner perceptible aspects#AERA2012
Roy Pea: How can adaptive technologies become trusted resources for students, teachers, and policy-makers? #AERA2012

The idea of a “school of one,” while appealing on one level to anyone who has ever talked about differentiated instruction is, ultimately, terrifying to me. Not because it will eliminate the teacher, per se, although teachers do become more like technicians in this model where they work to support students without really teaching anyone anything directly, or engaging in more substantive conversations in small groups or as a class. While it could be beneficial for students in many ways, my fear is that the implementation of adaptive assessment will inherently isolate students from one another and, as Leigh Graves Wolf reminded me of in a tweet (or three), will create data sets that are ultimately intended to evaluate (and, arguably) punish teachers. This idea of adaptive assessment ties with another popular ed tech trend, one that is perhaps seen as more “progressive,” but in effect is really not much more so, much like many recent edtech fads. For instance, as Ira Socol noted earlier this year, the concept of “flipping” the classroom is very problematic:

But the “Flipped Classroom” is worse than ‘typical homework’ – it literally shifts the explanatory part of school away from the educators and to the home, however disconnected that home might be, however un-educated parents might be, however non-English speaking that home might be, however chaotic that home might be. So, kids with built in advantages get help with the understanding, and kids without come to school the next day clueless. (Changing Gears 2012: rejecting the “flip”)

So, to hear Pea and other distinguished educational technologists talk about adaptive technologies in this manner was, at best, disconcerting. At worst, it is terrifying to think that our children will be measured by computers, as the recent hullabaloo over computer-based writing assessment reminds us. As the CCSS assessments come online, literally, my sincere hope is that teachers continue to question not only their validity as a measurement tool, but also the unintended consequences of such assessments on their students, curriculum, and instruction.

Footnote: Of course, we are all now familiar with the TED-Ed initiative to “flip” videos on their site, and this could be another interesting twist in the conversation. At least with TED, teachers are still in control of the learning process since they create their own versions for the flip.

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.