20 Years Gradeless: Having My Cake and Eating It Too

The divide between teaching and learning and traditional assessment is real. Many of us think about the relationships we could develop and the authentic learning students could engage in if only we removed could grades. I’m here to tell you how the gradeless classroom can be more than an “if only…” fantasy. Instead of being a desert that remains just out of our reach, my journey shows how you can discard the grades and skip right to the good stuff.

First, let me tell you about an intermediate level programming course I teach at Northwestern University. Here is how the course works:

  • You select an exercise and send me a working solution.
  • I critique your solution and return it to you.
  • You revise and resubmit your solution.
  • We repeat this cycle until I have no more critiques.
  • You repeat this process until the course ends.

I do not grade your solutions. Either a solution is fine, or it needs more work.

At the end of the term, your grade is based on three factors:

  • Progress: How far did you get? How many different kinds of problems did you do? How difficult were these problems? How many different topics and skills did you explore?
  • Quality: How good is your code by the end of the course? What level of critiques are you getting?
  • Effort: How often and how steadily did you submit, including revisions? How hard did you push yourself from your personal starting point?

I call this critique-based assessment. It’s been my solution for how to go gradeless since 1997. It’s the model for all the online software courses I have designed and delivered for a company I work with. Twenty years without handing out and arguing about grades. How has this turned out for me and my students?

For my students…

It’s no big deal.  This continues to surprise me. This is unlike any other course they take at Northwestern, and yet no student has said the class should switch back to the traditional graded model. No one has complained about lack of transparency in grading. What they (correctly) tell other students about is the importance of continuous resubmissions. For my students, “one and done” is never enough.

Gradeless doesn’t mean being in the dark about your progress. Northwestern requires final grades. My students care about those grades. They complain about teachers who are slow to return graded quizzes and homework assignments. How do I get around this problem? Technology! I developed a web application to store submissions and critiques. At any time, students can view a summary of what they’ve done so far: what they’ve submitted, what’s been completed, and how long since their last submission. They can also see how their statistics compare with the rest of the class.

student view of submission statistics

Students no longer send me “how am I doing” emails because they know where they stand. Some ask “what should I focus on to improve?” That’s a question I’m happy to answer.

For me…

My interactions with students are centered around content and revision. I never worry about whether a submission is a 7 or an 8. I just discuss what needs to be fixed. This means no more arguments with students about points. Instead, students and I have worthwhile discussion about their feedback. I never feel like I am throwing feedback into the wind. Students don’t need to agree with every piece of my feedback, but they do need to give it a shot and show me the result. I never worry about being too abstract because my I link the feedback to specific examples in the student’s submission.

I have a more complete grasp of what my students do and do not understand. When I first began this process, I wrote down a dozen critiques I expected I would need. These critiques focused on general standards for good code, such as clarity of names, modularity, and documentation. But once I started critiquing actual submissions, I found that I needed to add a dozen repeating critiques. By the fall 2016 semester I had re-used over 500 distinct critiques for submissions from 86 different students.

I don’t often grade, but when I do it’s fast and fair. Until the end of the term, I don’t think about grades at all. When it comes time for grades, thanks to technology, I have a complete history of all submissions and feedback. I know who has submitted what, the amount of topics each student covered, and the summaries each critique received.

summary

With this mix of details and summaries, assigning grades takes approximately an hour, even with 80 students and several thousand submissions. The process seems more equitable than traditional grades, and students seem to agree. I receive, at most, two to three post-course grade queries from students. During the last term I received no questions about final grades at all.

About that cake…

Teaching without grades is my cake. Every day I engage with students about how to improve their programming skills, and I never have to derail those conversations with tangents about who has what grade and why. Fortunately, I have found a way for my students and the university to have their grades while I have my cake.

Christopher Riesbeck is an Associate Professor in Electrical Engineering and Computer Science at Northwestern University, with a courtesy appointment in the Learning Sciences. He has a PhD in Computer Science from Stanford University.

4 thoughts on “20 Years Gradeless: Having My Cake and Eating It Too

  1. Great post, you are doing what I’m aiming for. I really like the model you got going.

    I know “what” I want to do (feedback conversation instead of grades) and I know “why” I want to make that switch (maximize learning, develop my student’s grit and growth mindset), now I’m trying to figure out the” how” I’m going to do it.
    You article brings me much closer to that “how”. I just have to figure out a way to give feedback faster and have a simple system of keeping documentation (some sort of a portfolio).
    Thanks again, very helpful, looking forward to eat my cake soon too!
    Alex

    Liked by 2 people

  2. Thanks for the comments. While the online system I have now makes the feedback cycle very short, I began this process in 1997 with nothing more than email, a folder for each student, standardized subject lines for each exercise, and a Windows utility for text clippings. That got the conversation going, and students adapted very quickly.

    Liked by 1 person

  3. What online program do you use for this? Is it accessible to HS? Can it be replicated for a science classroom? When you started what were the text clippings? Were they pieces of the student work that needed to be “fixed”? Thanks for this.

    Like

  4. I use a custom web-application I developed and run on a server at Northwestern. I’m happy to share the source with anyone up to managing a Java web server. The feedback interface is designed for line-oriented text documents such as program code. But the key ideas can be done with off-the-shelf tools. Create a set of challenges, grouped by skills and difficulty. The more the better. When giving feedback, use a text file of frequently used comments, or check out the various clipboard managers for Windows and Macs. Tally progress with a custom spreadsheet.

    I created a small proof-of-concept gradeless done/not done spreadsheet. After giving feedback to the student, add a line to the Submissions tab with the new status for that exercise. This simple example uses 0 for not started, 1 for in process, 2 for done. You’d almost certainly want to add a date column. The Tallies tab summarizes where each student is at for each exercise. Minus the name column, this could be posted daily or weekly for students.

    https://docs.google.com/spreadsheets/d/1RJkePxgXp52_XW3z66a6U_LH9jkJPVqb_RkPFWtnHqc/edit#gid=196450705

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s