Notes from Kathy Yancey’s Keynote: 21st Century Literacies

Today, Kathy Yancey gave the keynote and the MCTE 2007 Fall Conference in Lansing, MI. Here are notes from the session.

Yancey began by asking us to think about what literacy is and a five minute discussion among the audience began the session.

  • An image of tectonic plates from the public domain with the idea of continental drift.
  • Themes:
    • Choice of technologies depending on rhetorical situation
    • Networked in a way that we have not been before
    • Intrapersonal Knowledge and Reflection in order to navigate this territory
  • Much of what we know today began over one hundred years ago
    • When my grandmother learned to write, she learned cursive first and that was a mark of personality
    • Learning to read was important, but writing would empower people in ways that would cause problems
    • Donald Graves didn’t know that there was writing, only handwriting
    • The testing industry was focused on scales for handwriting — testing students was a part of testing teachers
    • The form trumps the content, and this has continued throughout the 20th century
  • Now, we see literacy as an interaction of practices and technologies
    • We understand these practices better now because computers have shown us what is avaialable
    • There were also changes in literatur (Jane Austen — print to TV to film to DVD extended version)
    • We are able to understand Pride and Prejudice in completely different ways; hypertext allows us to find things easier
    • All the versions of Jane Austen are good, and we can understand her in many other ways, in print and on many screens

    The history of literacy continues to change, and more and more work is available in digital forms

    • With new literacies today, we think in “new circulations” (print, email, text, etc.)
    • Be aware of Ed08
  • While computers have come in schools, we have been using technology to mimic old literacies practices
    • Conversation embedded within a word document, between student and teacher
    • Adaptability and assumptions are a part of how we begin to work with these literacies — we do not teach them in schools.
    • This is the difference between credentials and expertise; they have the expertise in newer literacies, and I have the credentials

    Texts and technologies work in different ways

    • Social technologies succeed when they fit in with the social lives of those who engage with the technology
    • Literacy practices continue to move online
      • Adobe now allows people to mark up what used to be solidified in a PDF file by marking it with post-it style notes and other tools
    • Characters on TV are now blogging, so in addition to watching the TV show you need to stay connected that way, too
  • Partnership for 21st Century Skills
    • Core subjects with 21st century themes
    • Creativity
    • Critical Thinking and Problem Solving
    • Collaboration (how do we fit this into school in ways that really matter?)
  • Knowledge Frameworks
  • Ken Burns, The War
    • He went directly to those inthe war rather than relying on “experts”
    • Getting these personal experiences will become more of the norm
    • Museum of African American History Museum is starting a virtual mueseum, inspired by MySpace
  • It will not be all digital, we will also be in both/and (print/digital)
    • We will need new assessment practices to discuss what is working and what is not
    • How does the description of a traditional essay assessment compare to that of a digital portfolio?
    • Prensky’s digital natives — we are going to have to learn from one another
  • Production of knowledge as well as consumption of sources, too
    • Digital conversion class — allowing students to only find information from blogs that they could trust
      • By looking at blogs, students were relying on the association of older literacies to find credibility in a source, but in blogs that does not work all the same way
      • Because blogs are informal, that does not mean that “average joes and joann” are prodcuing stuff; they are authored by working professional
      • This is a challenge that we need to take up as we consider 21st century literacies
    • More and more information will be tailored to us and delivered in a personalized way; the incentive to discover things on your own is lessened
      • There are dangers and we need to bring this into the classroom in a critical and informed way
      • Pandora
        • Works to define language for music and selects other songs that are similar to what you are looking for
        • This is online and free, available to all our students and not just the ones who have an iPod
      • Mapping
      • Fundamental to literacies in the 21st century
        • You can see who is networked and figure out ways to help them get networked my creating maps
        • To the extent that we leave all of this outside our classrooms, we make our children more vulnerable than eve
        • We have got to start teaching some of this — evaluating information and people
    • How can we think about teaching and learning in networks?
      • Policy — what policy would we need to change at all levels so this work counts?
      • Professional Development — what can we provide so that the curriculum includes the technology in their learning?
      • Assessment — yesterday’s assessments will not support or reward the new types of learning
      • 21st century literacies are now

Bridging the Computerized Scoring Divide?

Last month, TechCruch featured a story on a new web-based tutoring service, PrepMe. I was contacted by Calvin Truong, PrepMe’s Operations Manager about writing a post on the service here in my blog. From the TechCrunch review, it sounds like a different take on the model of submitting a piece of writing only to have it graded by a computer, a model that many, including Nancy Patterson (in this month’s Language Arts Journal of Michigan) and  Maja Wilson, have been critical of:

Prepme is one online test prep company coming out of the University of Chicago’s business incubator. Founded in 2001, the company offers test preparation for the SAT, PSAT, and ACT, using an adaptive algorithm to customize the preparation course for each student.

Unlike Kaplan’s online offering, Prepme doesn’t calculate the best lesson plan once, but continuously as you work your way through the material. Their system keeps track of what questions you get right and wrong, working you harder on the types of questions you miss.

Additionally, customers can connect electronically, using real time chat, with high scoring college students who serve as tutors.

Source: TechCrunch, “Starts-Ups Change How Students Study for Tests,” 9/1/07

When Calvin wrote to me, he wondered if I would blog about PrepMe here. I replied with some initial concerns:

Prepme does seem like an innovative service that takes advantage of computerized scoring while still adding the element of human judgment. Most of the outright computerized scoring systems out there really worry me as a writing teacher (as well as turnitin.com), so this is a clear departure that blends technology and pedagogy…

… although I do think that your service is innovative, I am still concerned about writing items that seem to support computerize scoring, as many of the professional organizations that I belong to have statements that expressly condemn computerized scoring.

NOTE: After some closer reading, I should note that the writing itself appears to be scored by the tutors, while multiple choice items that are like those encountered on the ACT, SAT, and other tests are the ones being computer graded.

To continue the conversation, Calvin wrote back immediately, and with his permission, I share parts of that response here:

About your concerns, I completely understand, and I think we’re pretty in-sync on both points. We’re working on a few initiatives that would speak more generally to trends in education, and since we’re only grading multiple choice tests and hand grading essays to enable detailed feedback it seems we’re on the same page. I would expect there is much less resistance in using technology to automate grading multiple choice exams since this minimizes human error, but perhaps I’m mistaken on this.

As to the interesting trends that may be worth writing about, there are two that we’re working on that may be of interest. The first is our work with the State Dept of Education in Maine, and the second is more generally about what’s happening in online education.

Maine recently enacted legislation that required the SAT to graduate from high school. We’ve committed to a 3 year program with the Dept of Education where we provide free test prep to every public high school student in the state. Here’s a press release from the Maine DoE website: http://www.maine.gov/education/edletrs/2007/ilet/07ilet072.htm. This initiative is interesting in and of itself, and may provide fodder for an interesting discussion. As far as we can tell they’re doing it to not have to invest tremendous resources to create their own state standardized test and to also drive students to consider applying to college. It’s an interesting social experiment and we’re proud to be a part of it.

Another approach might be to talk about the general trend in online education of trying to find the sweet spot between scalability, quality, and cost. We believe that using technology to give you scale while having high quality services with tutors from top universities, at a significant cost advantage is the way to go. In the pre-college market, having tutors at top universities is a quality win because these are exactly the sorts of students that our users want to be and exactly the sorts of students that our parents want their children to be, and this fosters great relationships online. There is some inherent cost in this approach but we believe it’s worth it.

Clearly there are others out there that disagree — some go for the no-compromise in quality, 1-on-1, in person is the only way to go but that has tremendous cost and little scalability. Other companies are trying the low cost online model with outsourced tutors and we believe this sacrifices too much quality in favor of cost.

It may be interesting to consider the implications of this because what is commercially viable may not actually be what is the most pedagogically pure.

All in all, it was an eye-opening discussion and gives me hope that hybrid models of online grading with humans sharing their insights could be a way to go. In my initial training as an online instructor for our state’s virtual high school, it seemed as though we relied more on the multiple choice items and writing that was highly scripted, almost not requiring a human response (even though I was grading it). As we ask students to write and share their writing online, this is not the best model of them composing digital texts per se, but it is a model that we could consider using in our own classrooms to foster peer response on traditional texts in digital environments.

Also, it points to the need in our field to more fully analyze this phenomenon and come up with alternatives that we feel are viable. I am not an expert in the topic of computerized writing assessment, yet am becoming more familiar with the field. A search in Google Scholar for “computer based writing assessment” didn’t yield anything since 2003 (in the first ten pages of hits). The most recent an comprehensive article that I saw was Goldberg, Russel, and Cook’s “The effect of computers on student writing: A meta-analysis of studies from 1992 to 2002,” originally published in the Journal of Technology, Learning, and Assessment. (An article in the current issue, found after I accessed the JTLA website, “Toward More Substantively Meaningful Automated Essay Scoring,” looks interesting, too).

So, I thank Calvin for beginning this conversation, and giving me something more to think about as I evaluate my students’ writing this week (all of it submitted digitally, incidentally) and consider what else might help them become better writers in the future. I also hope that you — as teachers of writing — share your thoughts both in comments here and by emailing Calvin as well.