Nuggets III: Problem Design Friday, Nov 20 2009 

I have to make this one quick because I have a cold and am trying to pack up my life and move uptown. But I wanted to finish my little “Nuggets” series with a thought inspired by Catherine Twomey-Fosnot and Maarten Dolk’s awesome Young Mathematicians at Work books. Twomey-Fosnot runs Math in the City, a math education think tank and professional development center run out of City College. She is writing a new book about algebra with the research mathematician Bill Jacob. I’m excited.

Anyway, people often talk like it’s a choice between developing students’ understanding of concepts and developing their technical ability. My experience is that everybody agrees that the two goals support each other, but there are major differences when push comes to shove in terms of where people believe the emphasis belongs. Maybe you all saw everything clearly from the jump, but I feel I spent a lot of years locked in this dichotomous framework. (Partly because of some experience with curricula like IMP that do a very good job with one of the goals and not the other.) What Young Mathematicians at Work did for me was to abolish the framework.

Nugget: You can develop conceptual understanding and technical ability (for example, computational ability) with the exact same lesson. The secret is to embed the technical instruction in the design of the problems you assign.

It’s necessary to take great care in designing the problems so that they support the development of skills over time. According to Fosnot (and I’ll take her word for it), very few American curricula have given adequate care to the sequence of problems and how it supports this development. My own consciousness was definitely raised by reading Young Mathematicians at Work about the extent to which (for example) the choice of the numbers matters.

For example, consider the following pair of questions:

At Sweet Virgo Desserts, a small chocolate cake costs $7.00. An apple dumpling costs $3.50.

1) How many chocolate cakes can you get for $49?

2) How many apple dumplings can you get for $49?

In 2007, a few months after reading Young Mathematicians at Work, I gave this pair of problems to a classroom of very-weak-skilled 6th graders, who would have balked at #2 (“you want me to divide by a decimal without a calculator?!”) if it had come first. They answered it easily and without any help after being asked and answering #1 first.

The two problems are formally identical. The only difference is the numbers. The important thing is not that #2 is harder; it’s that the way the numbers are chosen makes #1 a hint for #2. It’s also a hint with an applicability far beyond this problem: if n is hard to divide by, would 2n be easier? Pretty soon, the same class was using the technique to solve straight division problems accurately in their heads. (I’ve unfortunately lost the followup worksheet so I can’t tell you what problems; but they were things like 60 / 7.5 and 15 / 1.25.) This is a piece of computational technique; and teaching it this way supported the development of the students’ conceptual understanding of division at the same time that their proficiency with certain division computations was improving. The goals don’t have to be addressed separately.

Maybe you all think this is obvious. But I’m still constantly hearing folks (most recently, a college professor, a former high school principal, and the parent of a mathematically precocious 7-year-old) say things like “but at some point, they just have to memorize those times tables.” Meaning, “all this talk about understanding is really wonderful but you have to admit that there are some things you just have to bang into your head.” I used to be plagued by doubts of this form. Now I’m not. Yeah, you have to learn the times tables, but there’s never a reason to bang something into your head. Can’t remember 6×7? Great, do you know 6×6? How are they related? You go thru that a few times and not only will you remember 6×7 but you’ll be building the groundwork so that later it’ll seem intuitive that 6(x+1) = 6x+6.

Nuggets II addendum: more probelms… Saturday, Nov 14 2009 

This is a followup to my last post. I promised some more problems in which there is an initial pattern that’s wrong. Here is one more. It is not nearly as good as the points-on-a-circle problem I discussed before, for reasons I’ll say below. But I’m brainstorming here, and hope you’ll join me, so anything’s better than nothing. (And actually I think it’s a cool problem in its own way.) Thanks Kate, jd2718, and Gilbert for contributing ideas so far.

The problem involves seeking a simple formula that produces prime numbers only. As you probably know, in spite of centuries of research no such formula is known to this day. There is some fun history around this. For example, Fermat believed that 2^k + 1 was prime whenever k was a power of 2. It is prime for k=1, 2, 4, 8 and 16. However for k=32, the number is 4,294,967,297 which was found by Euler to be equal to 641 * 6,700,417. Now, even in the age of computers, no other prime of the form 2^k + 1 has yet been found. Of course, I’d avoid putting kids in the position of having to calculate 4,294,967,297 or to show that it’s not prime.

Anyway, the idea is to get a class engaged in a search for such a formula. My idea for how the lesson goes would be to try out some examples with them to show them what is being sought. Like, maybe 4n + 3 which equals 3, 7, 11 for n = 0, 1, 2 but then fails for n = 3, or, starting with p_1 = 2 and then recursively doubling and adding 1 which gives you 2, 5, 11, 23, 47 and then the next one fails. (A closed form for this last one would be
3*2^n – 1 for n = 0, 1, 2, 3, 4.) This second formula is a good replacement for Fermat’s conjecture, because it gives you 5 primes before it fails, just like Fermat’s conjecture, but the primes are a reasonable size and the one that fails (95) is obviously not prime. Anyway, once they understand what’s being sought, the problem is to find such a formula. They will totally fail and they have no tools that will help them, so don’t let them stew too long. Then, show them a very pretty creation of Euler’s:
n^2 – n + 41. This quadratic polynomial is (amazingly) prime for n=0, 1, 2, …, 40. So there’ll be some initial excitement as this one seems to answer the question. But actually, it can’t possibly answer it. And the class may be able to see that the n=41 case will fail without actually doing the calculation. Even if the calculation is needed, it can still lead to a cool conversation.

Now this isn’t as rich as the points-on-a-circle problem because the inordinate primality of n^2-n+41 is sort of a mathematical accident; there isn’t a rich story behind it (at least not one I’ve ever heard), so once the pattern is noticed and then broken there’s nowhere to go. But it does at least give students some experience of the fact that if a rule holds for small cases, it doesn’t mean it always holds. And the breakdown at n=41 is accessible to reasoning alone, without calculating. So it’s a win for the power of mathematical reasoning over raw pattern-noticing.

Other ideas in this vein? (Problems where there is a “obvious” or “apparent” pattern or conclusion that is actually wrong?)

Nuggets II: Proof Friday, Nov 13 2009 

Paul Lockhart has a lot to say. He was a research mathematician, and now he teaches kids. His essay A Mathematician’s Lament is a passionate screed against stultifying math education. (Which Lockhart sees as typical math education.) I am not alone among lovers of mathematics in saying that when I read it I experienced many, many moments of “Yesss!!! EXACTLY.” (Well, actually, “worrrd!” I was a teenager in the nineties; don’t laugh at me.) Another math lover with the same reaction was Keith Devlin, NPR’s Math Guy, who devoted his column in the MAA’s website to it in March 2008. This year, the essay was expanded into a very short book and published by Bellevue Literary Press (with a foreword by Devlin). Keith Devlin thinks everyone in math education should read it and I think I do too.

(This is not a 100% endorsement of Lockhart’s whole point of view. There were several moments in the book I found dismissive of the hard work that thousands of teachers are putting in across the country to try to teach math in a passionate way inside the constraints of traditional schooling. But the man is angry, and with good reason, so there you go.)

Anyway, amid all the things Lockhart talks about, one jumped out at me and clicked into place in my mind.

Nugget: The impulse toward rigorous proof comes about when your intuition fails you. If your intuition is never given a chance to fail you, it’s hard to see the point of proof.

From A Mathematician’s Lament (p. 72 of the book version):

“Rigorous formal proof only becomes important when there is a crisis – when you discover that your imaginary objects behave in a counterintuitive way; when there is a paradox of some kind.”

THIS IS SO TRUE. And it’s IMPORTANT. I think the issue wouldn’t be so pressing if mathematical argumentation were more intrinsically part of every math class, at every level, going back to little kids, as it should be. But in the absence of this, what happens is that when kids reach a point in their mathematical education where they are asked to prove things, they find
a) that they have no idea how to accomplish what is being asked of them, and
b) that they don’t really get why they’re being asked to do it in the first place.
The way out of this is to give them a crisis. We need to give them problems where the obvious pattern is not the real pattern. What you see is not the whole story! Then, there is a reason to prove something.

The way it typically goes is that all of a sudden in high school geometry, you’re being asked to prove something that’s just as visually obvious as the given information. Clearly it’s a pointless question. Meanwhile, you can’t do it, because everything true about the diagram seems equally true to you. The art of proof is about taking things that you’re sure of and touching them, prodding them, turning them around, pushing them against each other, until you become sure of more things, and continuing like so until you become convinced of the thing to be proved. To do it you need to feel it. When you do it well, your gut is giving you a reading on what you’re sure of and what you’re not sure of. (With students and teachers I work with, I’ve taken to calling this gut readout “your internal compass for rigor.”) But in a typical geometry proof, the thing to be proved feels just as true as the givens. You’re being told you know one and not the other, but this is not a difference you can feel. There is no internal compass for rigor to guide your path.

This is a situation exacerbated by everything that’s happened before geometry class. Every time you noticed a pattern, it was the right pattern, unless it was demonstrably wrong. For example, maybe you got a chance to experience the following awesomeness:
1+3 = 4
1+3+5 = 9
1+3+5+7 = 16
1+3+5+7+9 = 25
BLAM! The sums of consecutive odds are squares!
Now this observation is very cool when you first notice it. But where is this going? A lot of the time, it stops at the observation. The teacher gives the class a chance to see a pattern, they see it, that’s cool for 1.5 seconds, and then that’s it. Everybody moves on. The kids in such a class are being trained not to understand the need for proof. Even the teacher is acting like seeing is believing, so why, when you later get to geometry, are you suddenly being asked to “prove” things you can obviously see?

It’s much better if after the initial “aha” moment, there’s some sort of quest for an explanation. Lockhart describes such a quest, for an explanation of this exact pattern, in the book version of his essay, on pp. 106-117. But something is still missing if the only kinds of experience the students have fit this (see a pattern) – (explain it) – (see another pattern) – (explain it) cycle. The students are never getting a chance to see the wrong pattern.

I visited Paul Lockhart’s class at St. Ann’s School, where he teaches, a few weeks ago. At one point he said to his class (I’m paraphrasing because I don’t remember exactly) – “One thing that will happen this year is that your intuition will suggest something is true, and then you’ll look for a way to establish its truth, and find it, and refine it into a solid argument. That’ll be a good exercize. But far better for your mathematical development will be when your intuition will suggest something to you, and it’s wrong. You’re dead wrong. And then you see that you need a richer understanding of what’s going on.” So, a propos of this, I’m making a case that we give our kids lots of chances to have their intuition be wrong. The earlier the better. Nothing will develop the internal compass for rigor more powerfully.

Sensing a danger of being misunderstood, let me get concrete. I’m not talking about doing anything to undermine students’ trust in their reasoning. Cultivating a student’s trust in her own reasoning is what I believe math education is most centrally about. This is not about telling students they’re wrong, it’s about giving them a crisis. I’m talking about giving them problems that suggest one pattern on the surface when really something else is going on. In this way, students’ own reasoning is what puts their intuition in check.

I’m about to tell you the best problem I know like this. Tomorrow I’ll put up some more (though they’re not as good.) I’m hoping that some of you will add to the list of problems. They’re of vital importance and, though they’re easy to come by at the level of active mathematical research, I’ve encountered very few at the K-12 level. We need a repository!

The best one I know I learned from Bob and Ellen Kaplan’s book Out of the Labyrinth, which I wrote about last week.

Take a circle. Put 2 points on the circumference and connect them with a line. Into how many regions is the circle divided? Two.

Now add a 3rd point on the circumference and connect it with lines to the other two. How many regions now? Four: the points make a triangle so the interior of the triangle is one region and another one between the circle and each edge.

Add a 4th point and connect it with the other three. How many regions? Eight. Count ‘em.

A 5th point? Sixteen. If you’ve never seen this problem, you should be drawing right now because you don’t want to miss the full glory of this.

Alright, I see where you’re going, you say. Does it fit the case with only one point? Oh yeah, that’s just one region. Pretty neat, but what’s the big deal?

Draw the 6th point. Connect it to the others and count the regions. How many? Thirty-tw… Thirty-ONE? What? Did I count wrong?

No, you didn’t. That power of two thing you saw, a bulls-eye for the first five cases, is a miss on the sixth. (And a tantalizingly near miss, at that.) What’s really going on here?

Now if you want to look it up, it’s discussed in Out of the Labyrinth, pp. 71-74. But I recommend, if you’ve never seen this problem before, that you try it out yourself. What’s the maximum number of regions you will get with 7 points? With n points? And why?

The beauty of this problem is that the wrongness of the initial “obvious” pattern gives the search for the truth much more urgency. And, more importantly for the present conversation, it gives the student a reason to care about proof. I can stand up here and say “you’ve given me the first five cases, but you haven’t proved it” till I turn blue, but if you’ve never seen something work five times and then fail later, there’s some level on which you don’t believe me.

So this is what I’m advocating: let’s give students problems where there’s a superficial pattern that’s not the real deal. The need for mathematical argumentation is going to spring from these problems like corn from the Iowa soil. (Forgive the corny metaphor; I’m just excited.)

And folks: what other problems like this do you know?

Nuggets I Friday, Nov 6 2009 

The following is the first of what I hope will be three posts about thought-provoking books about math teaching, each accompanied by a treasured insight I got out of reading it. All three books (Bob and Ellen Kaplan’s Out of the Labyrinth; Paul Lockhart’s A Mathematician’s Lament; Catherine Twomey Fosnot and Maarten Dolk’s Young Mathematicians at Work) have a lot going on. If you read (or have read) any of them, I’m confident you’ll have (or have had) all kinds of thoughts totally unrelated to the ones I’m about to share. But the thoughts I am highlighting have all felt very exciting to me and that’s why I’m sharing them. It was like something clicked into place and answered a question that had been loitering inchoately in my mind.

Out of the Labyrinth: Setting Mathematics Free
by Robert and Ellen Kaplan

I’ve written about my appreciation for this book elsewhere. So without further ado -

Nugget: Mathematics is a vital interplay between the general/abstract and the specific/concrete. Without generality and abstraction, mathematics lacks power and grandeur. But without specifics, mathematics lacks life.

From Out of the Labyrinth:
“The spirits of Hilbert and Ramanujan lean over our efforts: the one ever lifting us up toward the form of the whole, the other dipping down again and again to catch at the invigorating singular…. This stirred soup is a spiral nebula, exceptional in each of its stars.” (p.157)

(To explicate the cultural reference: Ramanujan and Hilbert were both early twentieth century mathematicians. They represent opposite poles of the spectrum from general to particular. Hilbert was the grand theorist, among other projects attempting to find a formal system that could unify the entire edifice of mathematics. Ramanujan was a delighter in the details. In a famous anecdote, when his friend G. H. Hardy remarked that he had arrived in a taxi whose number was 1729 and that this seemed a dull number, Ramanujan exclaimed, “No Hardy! It is a very interesting number. It is the smallest number expressible as the sum of two cubes in two different ways.”)

Everybody talks about the need to make math concrete for students, but what clicked into place for me when I read Out of the Labyrinth is that mathematicians at every level have literally the same need. What counts as concrete is different at different levels but this is the only difference. A problem is not compelling if you can’t feel it, if you can’t turn it and prod it in your mind. It’s not that at some level of mathematical development you cease to need the problems to be real. It’s that as you deal with and get to know a mathematical object, at any level of abstraction, through its interactions with things that are already real for you, it becomes real. Then questions about it can become interesting.

Students learning algebra for the first time often experience equations containing variables as a sort of hazy, insubstantial thing. The methods for manipulating the equations seem arbitrary, and there is nothing satisfying about solving them because they barely seem to exist in the first place. I had the good fortune to encounter variables for the very first time in a context that made them extremely real, so I never had this experience. But I remember that haziness, that alienating lack of substance, from my first encounter with the definition of a group. “What is this pointless object that kicks all the substance out of the rich terrain of Number and leaves a hollow shell?” I remember thinking.

This is funny to me now since my subsequent mathematical education has made groups just as concrete as numbers. I now experience the symmetric groups on 3 and 4 elements as familiar little toys. The point is that this was a process. Groups did not begin to feel real to me until I saw how they explained and unified things I could already touch: numbers, the symmetry of shapes, motions in space. A long, slow process of solving problems, cultivating techniques, and most importantly investigating interactions and connections between things I already understood, made concrete objects out of what had first to me literally felt like thin air.

The philosophical lesson I draw from this is that a powerful way to look at teaching mathematics is that it is a process of cultivating this sense of concreteness in more and more abstract objects. The process begins in the concrete details of a problem – that’s what gives it life. Then it pulls upward, beginning to perceive the ethereal layer above the details that tie them together with other details. Then you try to hold both layers at the same time, and perceive their relation, until the concreteness of the details seep into the ethereal layer and it gains fleshy substance. Then you can move higher still. (First number, then variable, then function, then operator, for example, over the course of a decade.)

More concretely, a math lesson has to start from a problem that feels real and tangible for the students; but this doesn’t have to mean “real-life”. It just means that they need to be able to hold the problem, touch it, manipulate it in the mind. This depends on their mathematical development. If it’s a calculus class and the precalculus class did its job, the graph of y=sin x is a real, tangible thing. So a provocative question about the graph of y = sin x is more compelling than a routine question about a car’s speed.

Conversely, a problem that does not feel concrete lacks life, and concreteness grows slowly. We should beware of problems which require us to teach something before the problem can be posed. The lesson must begin with an interesting question about a tangible reality. The reality can be pysical, social, or purely mathematical. It just has to be real.

Required Reading for Math Teachers II Sunday, Nov 1 2009 

I’m excited and grateful about the positive response to Required Reading I. Therefore I’m a tiny bit trepidatious about my followup since it’s probably going to be a little more controversial. Be that as it may, I think it’s really, vitally important, so here goes:

Praise for Intelligence

Carol Dweck is a developmental psychologist who has made a career of studying how people’s beliefs about their traits influence their performance. She’s written a lot of good stuff but I want to call your attention to this article published in American Educator in 1999. The article summarizes research conducted by Dweck and others, most critically a study she and Claudia Mueller published in 1998 in the Journal of Personality and Social Psychology, 75 33-52 entitled “Intelligence praise can undermine motivation and performance.” I could not find the full text of the study online but the American Educator article summarizes the methodology and results.

Take-home lesson: Praise kids for what they have control over. Do not praise them for what they do not have control over. In particular, do not communicate to them that they’re smart, gifted, talented, intelligent, or the like, when they do something easily.

Telling kids they’re smart or gifted when they do something easily communicates to them that people will stop thinking they’re smart if they ever break a sweat. They become fundamentally afraid of struggle. This inhibits them from growing.

In the research Dweck presents, she and her colleagues took fifth graders and divided them into three experimental groups. All the students were given a set of puzzles that was designed to be “challenging but easy enough for all of them to do quite well.” Afterward, children in the three groups were told the following things:
Group 1: “Wow, you got x number correct. That’s a really good score. You must be smart at this.”
Group 2: “Wow, you got x number correct. That’s a really good score. You must have worked hard.”
Group 3: “Wow, you got x number correct. That’s a really good score.”

Afterward, the students were asked questions: how did they like the task? Would they like to take the problems home to practice? How smart did they feel? The three groups responded similarly to each other.

Next, all three groups were given a harder set of problems, on which they didn’t do as well. Then they were asked again how they liked it, would they like to take home the problems, and how smart did they feel? Lo and behold, the students who had been told “you must be smart at this” now did not feel smart at all, did not enjoy the task, and did not want to take the problems home. The students who had been told “you must have worked hard,” in contrast, enjoyed the task as much or more than the easier one. The third group had results between the other two.

Finally, the three groups were given a third set of problems similar in difficulty to the original set. The “you must be smart” group did the worst, and significantly worse than they had done on the original set. The “you must have worked hard” group did the best, and significantly better than they had done on the original set.

I think these results speak for themselves. If you think you are smart because you succeed with ease, you have a devastating and totally unavoidable conclusion to draw the minute you do not succeed with ease: you are not actually smart. There is nothing left to do but to desperately hide your struggle and hope no one finds you out. This is rough on your performance as well as your psyche. Meanwhile, if you find that your effort, your diligence, better yet your perseverance in the face of setbacks are what get the teacher excited about you, then a real challenge (meaning something you’re doubtful you can do) is actually an opportunity to enact your value. Dweck and Mueller also did some more experiments, fleshing out these details, that I won’t go into – the American Educator article (linked to above) is worth your read. But I have one thing to add. (Actually I have an unbelievably huge amount to add, but I had to limit it somehow.)

I take this research result to have very strong implications about how we should talk with kids about their performance. However, I take it to have no implications at all about what kinds of work they should be doing. For example, I think it challenges us to be very careful around the idea of “giftedness.” I would not mind if the whole idea of “mathematical giftedness” was given a rest for a good long while. But that doesn’t mean I don’t think children who love math shouldn’t get the opportunity to explore this love.

For example, if you are the parent or teacher of a kid who loves math and is breezing through her schoolwork, please please please give her opportunities to study mathematics that she finds exciting and challenging. But don’t tell her this is because she’s “gifted.” That puts her in Dweck’s experimental group 1 (“you must be smart at this”) and so sets her up to become freaked out and alienated from mathematics when the going gets rough. Tell her it’s because she’s excited by it. Praise her not when she flies through something easily but when she sticks with a problem past the point where she was ready to give up. Highlight her own sense of accomplishment when she does something that was really hard for her – “I was so proud when you did that because your patience paid off. I bet you’re proud too, huh?” Acknowledge resourcefulness – “I like how you looked for a new way to see it when your old way wasn’t working.” And show her that you value her enjoyment of the experience of doing math. When she first sees a pattern, she will be excited about it. When she figures out how to solve a new kind of problem, she will feel powerful. When she first sees a connection between disparate-looking objects, she will be in awe. These are the experiences that motivate a lifelong relationship to mathematics, so when she has them, let her know you value that. “Tell me what it was like when you saw that pattern.” If her enjoyment of math is bound up with being “gifted” it is fragile; so train her to enjoy math for its own sake.

Required Reading for Math Teachers I Saturday, Oct 24 2009 

Last week I promised I’d write about something worthwhile this time, so as promised: one of the most worthwhile things I’ve ever read. This piece is not typically seen as “math education research,” but I think it’s of vital importance for us.

Clever Hans

You don’t have to read the whole original book by Oskar Pfungst; there are plenty of good summaries of the research online (for instance here and here). This amazing story gets talked about in comparative psychology but I think it has special significance – often missed – for math educators.

Take-home lesson: never underestimate your ability to fool yourself into believing your students understand something when really what they are doing is watching you. To force them to engage the material it is often necessary to restrict their access to you or systematically confound the signals they get from you.

I think this is a central issue for modern math teachers. We need to explicitly develop ways of question-posing and interacting with our classes and individual students that hide or disguise our intentions for how they are supposed to respond. This needs to be part of the core training of math teachers, much more than it already is.

Clever Hans was a horse owned by Wilhelm von Osten, a high school teacher in Germany around the turn of the twentieth century. von Osten attempted to teach several animals basic arithmetic and German. The other animals failed but Hans, a Russian stallion, seemed to get it. He indicated answers by tapping his front right hoof. He was able to produce correct answers to a shocking array of questions including the four basic operations, some square roots, calculating days of the month, spelling words, etc. He was regularly displayed by von Osten in public. His feats caused an international stir. Nobody who hadn’t seen it could believe it (von Osten must be cueing the horse somehow, right?), but skeptics were converted when they saw and interacted with the horse themselves. A commission convened by the German board of education found in 1904 that no trickery was involved. von Osten didn’t even have to be present.

Psychologist Oskar Pfungst solved the puzzle: no trickery was involved, to be sure. But if the questioner didn’t know the answer to the question, then Hans couldn’t answer it. (For example, if Pfungst whispered one number to it, and von Osten another, and then asked for their sum, Hans would answer incorrectly.) What was going on was that whoever asked the question was cueing the horse totally subconsciously by tiny imperceptible body movements when the answer was reached. The horse took these movements as an indication to stop tapping that hoof.

Once Pfungst became aware of these movements, and trained himself to control them in himself, he was able to cause the horse to answer a question with any answer he desired. For example, he could say “tap 14″ but then cause the horse to tap 8 by using the body language he had found. Later, in laboratory experiments, he assumed the role of the horse, and “read the mind” of his subjects. He would instruct them to think of a number, and then begin tapping his hand. If he saw the characteristic body language indicating the “right answer” had been arrived at, he would stop tapping. The subjects were amazed by his ability to guess their number and had no idea they were sending tiny signals.

In comparative psychology they’ve taken the lesson of this story, and they’re diligent about preventing the “Clever Hans effect” from intefering with their experiments. In math education we still need to. If a horse can have all of Germany and beyond believing that it can extract square roots, when what it’s really doing is taking subconscious cues from its trainer, think of what human children can do.

This is not idle speculation, but a very real dynamic that shows up at least occasionally, in one form or another, in almost every math class I have ever watched or taught. It can happen at two levels:

1) Some students are committed Clever Hanses.
2) The whole class becomes Clever Hans.

To some students, getting cues from the teacher rather than thinking about the math has become such an ingrained habit that it is their entire modus operandi when doing math with an expert around (teacher, tutor, parent, peer, etc.). They usually have lost faith in their ability to have math actually make sense to them, and this cueing has become their sole survival strategy. They regularly fail tests and have come to accept this, but they would rather fake you out than admit ignorance – understandable, since they often carry a feeling of stupidity arising from their lost faith, and admitting ignorance would mean exposing this supposed stupidity. So they watch you and produce the right answers more often than not. Not with any sense of trickery or getting over on anyone – often, they’re barely conscious of the game. But it’s how they survive.

Most of us have had students like this in our class whether or not we recognized it. I’ve worked with several such students as a private tutor and this context puts their habit into very stark light. The first day I meet such a student, the very first problem I have them work on, they’ll make a guess quickly and watch my reaction to see if they’re on the right track. I’ve trained myself to respond noncommittally to everything:
“Is it 1/3?”
“Why do you say so?” (Even if 1/3 is correct.)
“Oh, no no, 1/4?”
“Why do you say so?”
I also often hide my face when posing a problem, or (even better) move out of my student’s visual field. These are not the only moves in this situation, but something similarly radical is needed: such a student will never engage the math itself unless all recourse to his or her standby survival method has been methodically denied. I believe that a necessary part of the repertoire of every math teacher is a set of moves designed to hide or confound the cues we send. The above are just a few suggestions.

In Pfungst’s research, when Hans was fitted with blinders and posed a question by a questioner outside his visual field, he made strenuous efforts to see the questioner. Similarly, when we begin to work on not telegraphing the answer we are hoping for – developing a good poker face, for example, or responding with “what makes you say so?” whether the proffered answer is right or wrong – students who are committed Clever Hanses will make every effort to get the answer out of us anyway. They will ask questions, make guesses, keep the game going till we let something slip. One of the lessons of the story is that it’s virtually impossible not to let something slip. Pfungst found that people communicated answers with minute physical signals they weren’t aware of. Even people who were made aware had trouble not sending them. So when working with a committed Clever Hans you can’t just trust yourself not to give up the goods. It’s often necessary to physically vacate the space between the student and the problem. When working with an individual kid this can even mean leaving the room.

Now even kids who are not in the situation described above, who have not come to rely solely on observation of the expert, can be drawn into a Clever Hans game if the teacher is telegraphing the answers too intensely. In most classrooms, for example, the question “Is this enough information to solve the problem?” does not receive a straight answer. Since this question is not usually asked when there is enough information, it is generally safe to conclude that the aswer is “no.” Furthermore, this conclusion is a lot less work than actually thinking about the problem. The teacher obviously wants to hear “no” so let’s say it and be done with it.

Similarly, any yes-or-no question posed by a teacher to a class is a setup for a Clever Hans game. It is a lot less work to guess one answer blindly (or wait for someone else to do so) than to actually think about the question. The teacher’s response to that one blind guess gives away the game and the class moves on with the question “answered,” but the very real possibility that no one in the room actually thought about it.

With this in mind I believe it’s a very productive exercize to scrutinize our lessons (working with the whole class, a group, or an individual) with the question “how far was it possible to get by just following my lead?” It’s especially powerful to videotape class and then watch the videotape with this question in mind – you see a lot more that way. It’s also worthwhile to observe other teachers with this same question in mind, because the dynamic is much easier to recognize from the outside than in the heat of it.

I have one other suggestion related to all this: it helps to be legitimately open to students’ thought processes whether or not they initially sound like what we had in mind. This is something I’ve had to work on. I have throughout my career been repeatedly surprised by the discovery that nearly every time a student offers an idea authentically (i.e. not as just a random guess), it makes some sort of sense. Maybe not complete sense, and maybe it’s not at all where I was headed. But if I can curb my initial reaction of “this kid is totally confused” long enough to actually take in the train of thought, there is almost uniformly some worthwhile reasoning inside it. Then even if I need to say “we’re going to stick to the topic,” I can do so after acknowledging the reasoning. The connection to Clever Hans is that if we want them actually thinking, we have to make sure our questions are legit. This gets communicated by acknowleging people for treating them as legit. If the only answers we acknowledge are ones that fit our preexisting image for what the answer is supposed to be, this communicates that the question wasn’t authentic, and it’s probably easier to try to guess what the teacher is up to than to engage it authentically.

To summarize: the lesson of Clever Hans is of central importance for our profession. We want our students thinking about math, not watching us for cues. But it is natural to subconsciously cue them as to what we want to hear. So a necessary part of becoming a math teacher is developing techniques to deny access to or confound these cues. Vacating the students’ visual field while they work is one important method. Another is responding the same way (e.g. “why do you say so?”) whether we believe the student is on the right track or not. But all of us need to be thinking about this.

Concrete vs. Abstract II Friday, Oct 16 2009 

This is a followup to last week’s post on “The Advantage of Abstract Examples in Learning Math” by Kaminski et. al. I promise that next week I’ll write about some research that actually has something worthwhile to say. But I just wanted a complete dismemberment of this article to be available to all as soon as possible.

I gave you the back story last week. Here’s my quick summary:

The study authors claim to find that introducing math concepts through abstract representations did a better job than introducing them in a concrete way in causing students to be able to generalize the concepts to a new situation. However:

* The study authors confuse the ability to produce correct calculations with the understanding of the concepts taught; and more importantly,
* The study authors used a lesson that was poorly adapted to concrete situations.

I conclude that their results don’t have the scope they claim. At most, they show that throwing in distracting information can make math harder to learn, but we already knew that. A better conclusion is that if you’re going to use concrete examples to teach something, be real about it. Don’t present a concrete setting and then dive straight into formal properties; use the setting to bring out the properties by having students think naturally about the setting.

The details:

First of all, the study authors declare in the online supporting material that “in the present research, study participants learned the concept of a commutative mathematical group of order three.” If that doesn’t mean anything to you, don’t worry, I’ll explain it very clearly in a moment. But this sentence already suggests an important flaw in the study design that I actually think is a flaw in a lot of curriculum design, so I’ll highlight it:

“The commutative group of order 3″ is a math object you learn about in a first course on abstract algebra. The “training” the authors used to introduce the idea to the students basically describe the group’s formal definition. (I’ll show you exactly what they do below.) But the students’ learning was assessed by a test that measured the ability to do computations inside the group. The thing taught and the thing tested were not the same at all. I say this is a flaw in a lot of curriculum design: we want students to have a deep understanding of mathematical objects, like fractions. But they’re often just tested on their ability to produce correct computational answers. Knowing how to add 1/2 and 1/3 is not the same as knowing what 1/2 and 1/3 are. Lots of kids never really learn the meaning of the objects (or even register that this is the important part about learning math) because they know they are only going to be accountable for the computational technique. The irony is that in the end, this makes the computational technique much harder to learn. But we set them up for this as long as the only things we ever test them on are the computations.

Now the bigger problem with the study is how the “training” used was inappropriate to concrete situations. But before I can show you this you have to understand something about the concepts and skills supposedly being taught. So, that explanation I promised (skip the next section if you already know this stuff). I am actually going to use one of the “concrete” situations from the study! But I am writing the “training” a little differently.

You know how tennis balls come 3 to a container? Suppose you work in a tennis ball factory packing balls. Every time you get 3, you can pack them away into a container and send it down the assembly line.

So, suppose in front of you is 1 tennis ball, and then along the conveyer belt come 2 more. You pack them away, send them along, and then you have – none!

How about if you have 0 balls, and 1 comes along? Then of course you can’t do anything because you don’t have enough for a container. So you’re stuck with 1.

Or if you have 1 ball, and 1 comes along? Again, you don’t have enough for a container, so you’ve now got 2. But if 1 more comes along, it and the 2 make 3, you can pack them up and send them along, and so now you’ve got 0 again.

Or – this is “the hard one” – you have 2 balls, and 2 come along. You pack up a container, send it along, and you’re left with 1 ball.

I think you’ve probably got the gist by now. This is an alternative arithmetic in which the numbers never go above 2 because every time you get 3 balls you just pack them up and send them along. So, 1+1=2 like normal, but 1+2 = 0 and 2+2 = 1.

Okay, that’s it. You can now do arithmetic in the “commutative group of order 3.” You can probably out-perform all of the study subjects in Kaminski et al.’s study on the tests they took at the end.

Compare this to the training set in the exact same “concrete situation” from the study (this is found in the online supplemental materials):

“A tennis ball manufacturing company is having trouble with their ball-making machine. Instead of producing batches of three balls to fill a container, it is producing batches of zero, one or two balls represented as {no balls}, {1 ball}, and {2 balls}. Consequently two or more batches need to be produced to fill a container. In doing so, the number of extra balls produced needs to be determined.

“Rules for finding the number of extra tennis balls:

“Rule 1. The order of the batches doesn’t matter. The number of extra balls will be the same. For example, if this batch {no balls} is made first and then this {1 ball}, then this much {1 ball} is extra. The same thing happens if this batch {1 ball} is made first and then this {no balls}. We will have this much {1 ball} extra.

“Rule 2. If this batch {no balls} is made with any other single batch, the other amount is always extra. Here are a couple of examples: If this {no balls} and this {1 ball} are made, then this {1 ball} is extra. If this {no balls} and this {no balls} are made, then {no balls} is extra.

“Rule 3. If {1 ball} and {2 balls} are produced, then one container can be filled and {no balls} is extra.

“Rule 4. If {1 ball} and {1 ball} are produced, then we cannot fill a container. So, {2 balls} is extra.

“Rule 5. If {2 balls} and {2 balls} are made, then one container can be filled and {1 ball} is extra.

“Rule 6. If more than two batches are produced, the order in which they are made doesn’t matter. The extra will be the same. For example, if {1 ball} and {no balls} and then {2 balls} are made, then {no balls} is extra. The same amount is extra if {no balls} and {2 balls} and then {1 ball}.”

Now if you actually have an abstract algebra background, you see what they’re going for here. Rule 1 is saying the group operation is commutative, rule 2 is saying that {no balls} is an identity, rule 6 is sort of a bastardization of the associative property, rule 3 declares that {1 ball} and {2 balls} are inverses, and the other two rules are examples of arithmetic in the group.

But my point is what they’re not going for. They’re not making use of the concrete situation to help the reader understand what’s going on. In fact, the very first “rule” leaves the reader with the sense that we might as well stop imagining tennis balls right now. If we were really talking about tennis balls, I wouldn’t have to tell you that the order in which they come doesn’t affect how many you have. Everybody knows this. The excessive formalism divorces the story from any concrete reality.

Rule 2 makes the divorce deeper. If we were really talking about tennis balls, I wouldn’t call {no balls} a “batch.” So by the time you come to rule 3 (when finally, if barely, the concrete situation is referred to in a sensible way – “one container can be filled…”) you have already completely given up on the idea that what they are talking about has anything to do with reality as you know it.

So here’s the lesson: if you’re thinking about using a concrete example to introduce a math idea, don’t worry. The results of the study don’t really mean “it’s better to leave the apples etc. in the real world” as the NYT writeup asserted. The safe conclusion is this: don’t be phony about it. If you are going to use taxi meters to develop linear functions, use the kids’ knowledge of how that situation actually works to bring out the math ideas. If you’re using temperature to explain negative numbers, use it with examples that actually make sense when you think about temperature. (For example, you can use temperature to explain why 5 – 7 is -2 but not why 5 – -7 = 12.) Being excessively formal about something that’s supposedly concrete reality makes the kids stop listening to their own logical reasoning and common sense and start just trying to guess what you’re up to.

Concrete vs. Abstract Saturday, Oct 3 2009 

I spent the whole day reading other people’s blogs psyching myself up to do this, so now I only have a few minutes to do it, so this one’ll be short.

In April 2008 the NY Times published a little article announcing a study by researchers at Ohio State University claiming to find that “it might be better to let the apples, oranges and locomotives stay in the real world and, in the classroom, to focus on abstract equations.” The study was published in no less a forum than Science Magazine. Knowing that something must be terribly wrong, I found myself inexorably drawn to read the Science article for myself.

“The Advantage of Abstract Examples in Learning Math”
by Jennifer Kaminski, Vladimir Sloutsky, and Andrew Heckler
Science 25, April 2008, Vol. 320. no. 5875, pp. 454-455

The article summarizes the author’s findings that when they taught a certain mathematical concept through concrete examples, students did not do a good job applying the concept in a novel situation, but when they taught it through an abstract representation, the students successfully transferred the concept to a new situation. They concluded that “If a goal of teaching mathematics is to produce knowledge that students can apply to multiple situations, then presenting mathematical concepts through generic instantiations, such as traditional symbolic notation, may be more effective than a series of ‘good examples.’” (p.455)

The bad news is that the actual details of the study design are not found in the article. The good news is that they are found in a supplemental thingydoo on the Science website. The bad news the article costs $15 to download. The good news is that the supplemental materials don’t cost anything. Even better, since I paid for and printed out everything and it’s next to me right now, you can benefit from what I found out without even leaving this site.

If you’re a math teacher you already know there must be something rank in here somewhere. The authors are actually claiming to have scientifically shown that it’s better to introduce a math idea in a way totally disconnected from reality than to base the idea on anything the students already understand about the universe. Well, a look thru the online support material makes the rankness available to all:

First of all, when the authors say they gave students abstract training in one condition and concrete training in a different condition, what they mean is that in both conditions, the students stared at words on a computer screen. In the abstract condition, the words went like this:

“On an archaeological expedition, tablets were found with inscriptions of statements in a symbolic language. The statements involve these three symbols: {circle} {diamond} {flag} and follow specific rules.

“Rules for combining symbols.

“Rule 1. The order of the two symbols on the left does not change the result.

For example {diamond}, {flag} -> {diamond}

is the same thing as {flag}, {diamond} -> {diamond}

…”

In one of the three concrete conditions (the other two were similar), the words went like this:

“A pizzeria takes orders for one, two or three slices represented on individual cards as {1/3 of a pizza}, {2/3 of a pizza}, and {3/3 of a pizza}.  Multiple orders are placed at a time; and the cook systematically burns a portion of each group order.  Antonio needs help to determine how much pizza is burned.  There is never more than 1 whole pizza burned.  So the burned amount will always be {1/3}, {2/3} or {3/3}.

“Rules for finding how much pizza is burned stated by Antonio:

“Rule 1.  What I order first or second doesn’t matter.  The same amount gets burned.  For example, if I order this {3/3} first and then this {1/3}, then this much {1/3} is given to us burned.  The same thing happens if I order this {1/3} first and then this {3/3}.  We get this much {1/3} burned.”

In other words, the instruction in the two conditions was substantively identical, except that in the “concrete” situation there was some additional distracting information.

But the whole point of using concrete examples in teaching math is to connect the mathematical structure to a comprehensible reality in the students’ world, and this was not done at all, in either condition.  So the question that the study authors, and the NYT article, addressed themselves to (“Is it better to use concrete or abstract teaching methods?”) wasn’t answered.  The question that got answered was “Do people learn better when you don’t throw in distracting info?”  (Oh, you mean they do?  You’re kidding, right?)

I’ve already made myself late but I want to tell you more detail just to have it on record, so I’ll post again soon.

Alright, here goes… Friday, Oct 2 2009 

This blog is a math education research digest.  I’ll post weekly about something I read – a study about teaching, learning, cognition; a book or article about pedagogy; anything that provoked my thinking about math education.  My hope is that people will find it thought-provoking and useful for reflection, and possibly also useful as a source of information about research.