The value of grades

An interesting discussion of different ways to scale grades using algorithms over at Worthwhile Canadian Initiative.  The comments are at least as interesting as the post.  In the comments, the value of grades emerges as a central concern.

Grades have two main uses:

1. Social
2. Pedagogical

Both are important, but it's very clear that the main social use of grades--as a socially visible and efficacious mark which sets apart the "smart" kids from the not-so-smart ones--is predicated upon the sound functioning of the main pedagogical use--as a form of critical feedback that lets a student know relatively how s/he's performing. Grade inflation is driven by the democratization of the university and the concomitant rise of the social importance of grades. Since a university-level education is now regarded as a sine qua non for a decent job, and since universities use high-school grades as an admissions test (i.e., to make invidious distinctions between students), it's no surprise that enormous pressure is placed on teachers to give higher marks. Similarly, since university students now presume (rather unimaginatively, in my opinion) that a graduate degree is the key to social success, and since graduate schools look at university grades as an admissions test, university students correctly deduce that good grades are key to their social success. And since grades are presented with little context, enormous pressure can be brought to bear on teachers, since it hardly matters how a student gets good grades. The succesful wheedler can expect a level of social success (status and salary) equivalent to that of the class genius.

Students believe that this equation represents the world perfectly.  They are not entirely wrong.

With that in mind, the crucial context that makes it possible to put grades to any use is the relative expectations that presumably animate the teacher's instruction. I always think of this context as having three layers:

1. The student's performance vis-à-vis his/her peers in this particular course (during this semester, with these students)
2. The student's performance vis-à-vis other cohorts taking more of less the same course (i.e., compared to all students who've taken this course with me)
3. The student's performance vis-à-vis the universe of students who have ever taken, are now taking, or will take a course more or less equivalent to this one, in any institution and with any instructor.

Comparing students only among their immediate peers can give a false impression of their performance, since cohorts and classes can and do differ in relative strength. Some groups should skew higher or lower, because the groups are stronger or weaker than other groups. I find this kind of contextualizing to be very difficult, and while algorithms can be helpful as a method, they are no substitute for the judgment that decides which of them to use or whether to use them at all.

There are several universities in the US at which students are given feedback but no grades. Hampshire College, for example, provides no grades: at the end of each course, the teacher and the student both draft a 300-400 word narrative discussing the student's performance. These narratives form the body of the student's "transcript." These transcripts are made available to the entire student body as well as to other institutions at the student's request.  I took two courses at Hampshire, and I found the students to be engaged, engaging, and highly motivated. (Since I attended a different school, which did give grades, my teachers gave me a grade, but I can tell you that the narratives they wrote are far more precious to me. I still have them.)

Even though they still publish evaluations of each student's performance, such institutions obviously have a strong position on the social value of grades. An interesting thought experiment that really pushes the distinction between social and pedagogical uses to its limit is to imagine a university that gives grades, but does not publish them. Students are told what grades they have received, but the records are then destroyed, so that no one can "prove" anything. The students' transcripts are simply the lists of the courses they've taken. Anyone could say he'd gotten an A, but only he and his teacher know for sure, and no on can prove anything. Wouldn't teachers and students then simply regard the grades are a rather autistic and reductive form of feedback? Would giving grades be worth the trouble? Would teaching per se be easier or harder? Relative performance would still need to be graded, in the strict sense of the word, but since the social value of the grade has been eliminated, the only value left is its pedagogical value. So what IS the pedagogical value of a grade?

Social attitudes usually reflect social conditions (not moral preferences)

It turns out that personal finance isn't so "personal."  Much of it has to do with prevailing attitudes toward financial conditions.  Bank of America CEO Kenneth Lewis recently worried in public [WSJ; behind firewall] about people who might walk away from their mortgages now their homes are worth less than their loan balance.

Calculated Risk puts up some scary numbers, which indicate the potentially seismic consequences of large-scale shifts in social attitudes. How scary?  How does TWO TRILLION strike you?

If every upside down homeowner resorted to "jingle mail" (mailing the keys to the lender), the losses for the lenders could be staggering. Assuming a 15% total price decline, and a 50% average loss per mortgage, the losses for lenders and investors would be about $1 trillion. Assuming a 30% price decline, the losses would be over $2 trillion.

Not every upside down homeowner will use jingle mail, but if prices drop 30%, the losses for the lenders and investors might well be over $1 trillion (far in excess of the $70 to $80 billion in losses reported so far).

There's a huge social component to personal ethics--much larger than we usually suppose.  Is walking away from your mortgage bad behavior?  Well, what if not only makes financial sense, but many people are doing it?  What if it were recommended?  Shame depends on the visibility of certain personal behavior in the eyes of a public, and there seems to be much less shame associated with cutting one's mortgage losses.  The big lesson (apart from the shame I hope the banks are feeling) is that personal character is developed in symbiosis with social conditions, not in spite of them.

The economists have no clothes

Over at The Atlantic, Gregory Clark admits, rather refreshingly, that academic economists have no clothes.

The current recession has revealed the weaknesses in the structures of modern capitalism. But it also revealed as useless the mathematical contortions of academic economics. There is no totemic power.

As a discipline, economics proposes models, which are by definition incomplete. That is, they exclude some details and highlight others. To think that economic theories actually describe reality--as opposed to offer an image of reality that is useful for some purposes--is to mistake the map for the world.

Ceci n'est pas le monde.

Further, the dismal science has all too often provided models whose validity is impossible to ascertain, since it has often built its theories on the basis of premises that are false prima facie. The point here is that, logically speaking, false premises do not yield false conclusions; rather, false premises render the truth values of an argument's conclusions indeterminate. It isn't that economic models are false, but rather that the falseness of their premises means that can know nothing with certainty about their conclusions. We can't say whether economic models are true, false, or some determinate mix of the two. Logically speaking, they're mere speculation, with the same logical status as wishful thinking.

You mean we came all this way and we don't even know if we're wrong?

For example, the theories of classical economics generally accept as axioms (i.e., they accept as true without argument) the following:

1. All economic actors are rational.
2. All economic actors have perfect information about the markets in which they act.
3. All resources are scarce.

These are bad axioms, since they're obviously not true. As in, there's no doubt at all that these are false. Of course, not all branches of modern economics still accept these premises without qualification, but historically speaking these assumptions lie at the foundation of all economic thought. This is precisely the main reason I never studied economics in college. Who can take seriously a discipline that, wherever it ends up, begins with nonsense? While there's no doubt that the phenomena we think of as economic are intrinsically interesting, I remain skeptical that the formal discipline of economics has a great deal to offer beyond the obvious. As Clark notes:

The debate about the bank bailout, and the stimulus package, has all revolved around issues that are entirely at the level of Econ 1. What is the multiplier from government spending? Does government spending crowd out private spending? How quickly can you increase government spending? If you got a A in college in Econ 1 you are an expert in this debate: fully an equal of Summers and Geithner.

Common sense cloaked in jargon and equations. Even the economists' invisible clothes look rather shabby these days.

18 inspirations for educators and social entrepreneurs

Some people collect stamps. Others collect curiosities. I collect (among other things) pedagogical models, theories of learning, writings on education, and great educators. Someday I'll boil it all down and give you just the bullion, just the essence. But I need more time. My collection is far from a complete 7-course chowdown; heck, it won't do anything more than whet your appetite... but at least that means I've probably gotten to hors d'oeuvre status.

"My! You have such an interesting collection of... um... what are these, exactly?"

Model Institutions, Organizations, Etc.

1. Danish Folkeuniversitetet ("Folk High Schools"). The keystone of Danish national and democratic identity. One of the great triumphs of modern liberalism (in the strict sense of the term).
2. Hampshire College. The Un-Ivy League. Classes, but no core curriculum. Written evaluations, but no grades. Books, but no teacher's dirty looks.
   
3. The Nueva Escuela ("New School"). A program aimed at the developing world which supports schools as agents of positive social change. Focuses on education which is "active, participatory, cooperative, child-centered, and life-relevant." The story is that the founder asked every Nobel laureate she could get her hands on what kind of school they wished they had attended.
   
4. The KaosPilots (of course). A new kind of business school, aimed at at the fourth sector.
5. The Acton MBA (of course). Business school on steroids, which aims to produce entrepreneurs rather than managers.
6. Y Combinator. Although it claims to be a new kind of venture capital firm, it's really an intense education in how to be a world-class tech entrepreneur.
7. Gever Tully's Tinkering School. Let your kids do dangerous things, otherwise they'll never learn how to handle dangerous things. When I put it that way, it's obvious, right?

Writings Worth Reading

1. "On Education." Ralph Waldo Emerson's seminal essay on the subject, in which he argues that "the secret of education lies in respecting the pupil."
2. "Talks with Teachers." Brilliant lectures on teaching by eminent 19th century American psychologist and philosopher William James.
   
3. "Complicity." Online journal on complexity (read: chaos theory) and education. Be warned: this journal has a rather pointy head.
4. Infinite Thinking Machine. A blog providing coverage of innovation in education.

Models, Movements, and Technologies

1. Ignatius of Loyola's Spiritual Exercises, by which I mean more than simply the book by the same name. The exercises are a masterfully conceived and carefully refined ethical technique (read: a practice by which one acquires a particular character).
2. Unschooling. Let the child set the educational agenda; teaching consists principally in encouraging and enabling.
3. Moodle. A widely used open source course course management system.

Educators to Emulate

1. Socrates. The gadfly of great Athens.
2. Johan Amos Comenius, the Czech (Moravian, to be precise) "Copernicus of education."
3. Nikolai Frederik Severin Grundtvig, founder of the Danish Folk High School.
4. Amos Bronson Alcott, the original Transcendentalist, and the greatest teacher [.pdf] in U.S. history.

Disorganize the schools!

The NYT covers the--gasp!--new trend of tutoring students (mostly boys) who seem to be having trouble in school. OK, OK, it's not the tutoring itself which is interesting. We've known for some time that tutoring is among the most successful of teaching methods. It's the fact that the tutors aren't teaching subjects, they're teaching habits. In other words, ethical tutoring.

If you want to get 'em educated, you first gotta' get 'em organized.
(Photo by Jim Wilson for the New York Times)

As per their standard operating procedure, the NYT adds zero content to and only a confused, watery viewpoint on the conversation. (When will they stop "reporting" and start giving us the story?) We've known for some time that girls outperform boys in almost every subject until puberty hits, at which point boys edge ahead in math and science. But why? And what to do about it?

The NYT frames the problem as one of organizational habits--which is curious because it focuses not on the problem, but on the (stopgap) solution. Providing boys with better organizational skills will undoubtedly help them do better in school. But doesn't this beg the question of why schools demand that children be "well-organized" in order to receive an education? Why should high-school boys need to develop bureaucratic skills and habits in order to learn? After all, the world itself wasn't color-coded the last time I checked.

A classic case of mistaking your map of the world for the world itself.

Too, the culture's perception of schooling has changed. I believe that parents used to be more focused on the education itself--what the child was learning, how s/he was doing in class, etc. There was a sense that the learning itself was the primary propellant provided by schools to children aimed at moving up in the world. Nowadays there's a great deal more focus on getting the certification at the end. It's the paper that matters--not the process. Especially with No Child Left Behind [free registration required], our focus become fixed on making the grade, and the means seem to matter little.

On top of our intense focus on the finish line, we still teach using methods which we know (and have known for years) don't work all that well. Is it any surprise that energetic, independent students should rapidly come to the conclusion that school isn't worth their time? Why not simply cheat, or cram for the test? And why worry at all, since that silly certificate isn't worth much any more unless you've got the right parents in any case?

Ultimately, it isn't boys who are less organized, it's our pedagogy (and indeed every institutional activity in our culture) which has become more rigidly organized. Turning in your not-very-interesting and not-at-all-important homework on time isn't equivalent to responsibility. It's just punching in. People who focus intensely on thing they themselves find trivial and meaningless are usually pretty unhappy. And no surprise there either.

The myth of "passive income"

A friend of mine, JD, who used to work as a developer in New England, tells me that there's a new board game which is "sweeping the country." The game: Cashflow 101. The object of the game: become wealthy by mastering the art of investing. The game's designer (or perhaps just endorser): Robert Kiyosaki of Rich Dad, Poor Dad fame.

After reading his Yahoo! Finance column a few times, I've come to conclusion that Kiyosaki is a financial charlatan (which means that I refuse to drive traffic his way by linking to his stuff directly). In a nutshell, Kiyosaki's financial advice boils down to "Choose to be wealthy." I'm not kidding. His is the worst kind of quasi-libertarian snowjob, since if you pay for any of his motivational products or services, but don't get rich, why, it must be that you just haven't "really committed yourself" to being wealthy. If you're poor, it's your fault. You just haven't really, in your heart of hearts, chosen to be rich.

"As you can see, my heart of hearts loves poverty more than I do."

While it's true that the acquisition of wealth can be a very subtle art, it's an open secret that (in the US, at least) the most simple, most direct, and by far most common strategy for getting rich is to have wealthy parents. But this is all really an aside. What I really want to discuss is the folly underlying Kiyosaki's game and the worldview it reflects.

In Cashflow 101, each player begins with a randomly selected income-expense profile--a job and a bunch of expenses. After that,

There are two stages to the game. In the first, "the rat race", the player aims to raise his or her character's passive income level to where it exceeds the character's expenses. The winner is determined in the second stage, "the fast track". To win, a player must get his or her character to buy their "dream" or accumulate an additional $50,000 in monthly cash flow.

The whole thing revolves around this mysterious concept of passive income.

He just followed me home. Seriously. So... can I keep him?

Aaron Maxwell has written a pretty good beginner's guide to Cashflow 101, which explains that

[p]assive income is income that comes in with little or no additional effort on your part. If you have royalties from a book, income from a rental property you own, or stock that pays dividends each quarter, you have passive income.

Maxwell immediately goes on the qualify that definition:

Sometimes you'll have to do SOME work - if that rental house develops a leaky roof, you'd better have it fixed if you want to continue collecting rent! The difference is that for a "normal" job, you have to invest your time continually to keep receiving income, and if you work half as much, your income immediately goes down by half or more. With passive income, after you do some initial work up front, you have an income stream that continues with little or no time on your part to maintain it.

And there's the rub. Passive income isn't genuinely passive in the sense that it requires no effort. It's simply that compensation isn't immediately correlated to effort. Passive income doesn't require endless, futile labor to sustain it. Rather passive income represents one flow within a relationship of ownership--and in the opposite direction flows responsibility. We receive passive income from assets for whose condition and behavior we are liable.

Calling the income passive is misleading, because it implies that such income arrives not simply without--or with minimal--effort, but with minimal worry as well. But ask any landlord--you're essentially paid to worry about stuff. Whatever the gods of pop music claim to the contrary, tenants do not call Ghostbusters first. Especially when the heat goes out. First, they call the landlord. Then, they call their lawyers.

I ain't afraid o' no tenant.

Responsibility implies liability. Although rental property income provides the most stark example, other kinds of passive income also admit of analogous forms of responsibility. In exchange for book royalties, the author remains responsible for what he's written. In exchange for stock dividends, the owner becomes responsible for the behavior of the company whose shares she owns. (Warren Buffett famously advocates treating the purchase of stock as equivalent to the purchase of the entire company.)

The point here is that wealth, because it depends upon ownership, entails responsibility and liability in direct proportion. There's no such thing as truly passive income, and anyone who thinks she wants to be rich should be warned that Easy Street is the main thoroughfare in Neverland. Wealth is a sacred social trust, not a ticket to heedless self-indulgence. It is most certainly possible to enjoys the fruits of responsibility, but only for so long as and to the degree that one proves willing and able to bear its weight.

We have a word for those who take the lazy way to easy street, and it ain't flattering.

Knowing what you know

When I found Langdon Morris's book on innovation which boasts an epigram from Aristotle's Nicomachean Ethics, I was understandably excited. "Which passage from Aristotle did he choose?" you ask. Well, he chose:

Excellence is an art won by training and habituation. We are what we repeatedly do. Excellence, then, is not an act but a habit.

Which is an awesome quote, except that it doesn't belong to Aristotle. As a one-time teacher of the Nicomachean Ethics, I can vouch that this quote accurately sums up Aristotle's position on excellence. But when I went looking for the precise provenance of the quote, I discovered that (according to Wikiquote, at least) while the meaning does indeed belong to Aristotle, the specific words flowed from another's pen. Apparently, the above quote is Will Durant's summation of Aristotle's position in Book I of the Nicomachean Ethics. Since the quote remains a clear, concise, accurate summation--in fact, it's probably better than anything Aristotle wrote himself--we'll keep it.

I expect that Mr. Langdon's ethically sensitive parsing of the innovation process will yield a number of worthwhile insights, but for now I just want to cover one. His definition of knowledge and its implied definition of learning. Definitions appeal to my inner philosopher, and smart definitions are what make the world make sense. Too, the subject is, I think, central to the whole constellation of fields covered by this blog; loyal readers will recall that this blog was launched with a post on knowledge and learning.

Langdon's subtle and sophisticated definition of knowledge (found on p. 61 of the .pdf), boils down to the following:

Knowledge is concerned with "how," with the capacity to do useful things. Such capacity, in turn, comes about as a result of the integration of three other elements, information, theory, and experience. Information is the "what," the basic description [the "facts" or "data"]; theory is the conceptual framework that explains how the world functions [the "context"], and experience is the immersive and multidimensional process of doing and having done [the "practice"].

The subtle shift in emphasis from knowledge-as-what to knowledge-as-how turns our entire educational system on its head. Knowledge isn't something that you have--it's something that you exercise. It isn't an amalgam of friable and discrete facts--it's a layered, nested, and embodied concatenation of practices. It isn't a two-dimensional map of bounded domains--it's a multi-dimensional narrative.

Academic education as internal phrenology.

On Langdon's definition of knowledge learning becomes the subjective fusion of information, theory, and experience. The student generates knowledge for himself by bringing information, theory, and experience into relation with one another. It isn't enough simply to have data; nor is it enough to see contextual possibilities; nor is it enough simply to have one or several experiences. All three must fuse within a single self-awareness, and the resulting knowledge possesses the breadth and depth only of the most limited of the three factors.

And perhaps most importantly for me, as an educator, on Langdon's definition of knowledge teaching becomes a creative attempt to stimulate and/or guide the student to meld the three ingredients of knowledge into practicable know-how. Successful teaching doesn't mean providing students with more or better information; it has to do with process only tangentially. Successful teaching means that students are, after being taught, measurably more effective in doing things. They get more done of what they want to do. It's hard to imagine students wanting anything else from their teachers--which may in itself be the strongest single argument for Langdon's definition.

Letters to a Young Teacher

Salon's Mathew Fishbane interviews Jonathan Kozol, author of the recently published Letters to a Young Teacher, in which Mr. Kozol advises school teachers to adopt an "attitude of irreverence." Thank goodness at least one person who testifies before the U.S. Congress is saying it.

The MBA: new, improved, or simply on steroids?

In Austin, Texas, a bunch of teachers at the Acton MBA program have uncovered the secret of American greatness (such as it is):

We believe that thoughtful, principled entrepreneurs are the secret to America's success, and her scarcest resource.

Anyone who doubts whether or not Acton's founders are correct in this surmise should stop and think about the meaning of the word entrepreneur. I hardly think it unfair to qualify Jefferson, Madison, Lincoln, and King as entrepreneurs. It's just that their domain was politics rather than commerce. The US owes all of its greatness (again, such as it is) to its most entrepreneurial members. Better US entrepreneurs can only mean a brighter future for the US.

But setting aside for the moment the whole question of social entrepreneurship, Acton claims as its goal

to educate a new kind of MBA: one who is equipped to add value from day one, build successful businesses, raise a healthy family, and give back to his or her community.

Having considered business school in the past, and having cheered from the sidelines as a spouse paid her two years of dues, this sounds great. Your average garden-variety MBA program makes it a rule to thwart whatever entrepreneurial impulses its students may bring to its doors. So maybe Acton really does offer something different. At the very least, it has proven itself capable of convincing already successful entrepreneurs that it offers something worthwhile:

Acton is the only MBA program in the country that offers every student a $35,000 Acton Fellowship to cover the full cost of tuition, fees, and materials.

Seems like a hell of deal, if the curriculum is any good. And the curriculum looks pretty damn good to me. They use the the case method, but with a focus on entrepreneurial issues rather than managerial ones. They include hands-on experience in sales, complex simulations, and site visits as part of the package. And one of their core curricular segments is entitled "Life of Meaning," suggesting that they're not merely about enabling corporate greed. And to top it all off, it's all taught by seasoned entrepreneurs, not by researchers. It looks like a fantastic curriculum, and I'd endorse it wholeheartedly except for a few little details which set my nose to twitching.

(A) First off, the workload is 80-90+ hours per week. Now, it's only a one-year program, and traditional MBA programs seem to work their little serfs 50-70 hours per week for two years, so perhaps it's not so bad by comparison. It's just that that kind of workload sends several important messages:

1. it suggests, by sealing people hermetically into their program so that they barely even see their spouses, that success in business depends upon sacrificing everything else (from the FAQ: "We offer several sessions throughout the year in which students and their significant others get together with the Life of Meaning teacher to discuss the contributions and sacrifices each has to make throughout the year-long program");
2. it teaches the phony lesson that working harder is more important than working smarter;
   
3. and because it lasts an entire year, it creates habits of dissociation (an addiction to work really is a spiritual disease) which can reappear at any time.

(B) Second, it looks like the school is staffed by only (or almost only) white males. Lord knows that a lot of diversity can exist beneath identical skin colors and genders, but it's nevertheless hard to believe that this kind of homogeneity doesn't reflect a certain homogeneity of outlook. Driving forward relentlessly has been a very successful strategy for white males, but I can't help but wonder whether or not there may be other strategies.

(C) Third, and most importantly, it's still a curriculum taught by faculty at a school where students come and sit in classrooms to "learn at the feet of the master." Acton notes that "traditional MBA faculty see themselves, not their students, as the customers," thereby suggesting that at Acton, students are the customers. That is to say, the students are the boss. But while "clear contracts and a competitive grading system" probably do provide for quite a bit of the pressure experienced by students, I fail to see how they "encourage... perspective, discipline and accountability." Perspective comes from broad understanding--not from narrow focus; discipline arises as a result of self-knowledge--not from external standards; and accountability arises from a sense of connectedness to other persons and things--not from abstract contracts, however clear.

From its website, Acton appears to be a smarter, leaner, and perhaps meaner MBA, but it's still an MBA. In many ways it returns to original intent of the MBA, which was to provide to rising managers (who already had some real-world experience) a suite of tools to help them manage more effectively. And in several ways it has outgrown its roots: its focus on entrepreneurship is welcome; its penchant for hands-on teaching is laudable; and its ability to support its students financially is breathtaking.

Without visiting the campus and conversing, face-to-face, with its students and teachers, I don't think it would be possible to render a more complete judgment. (I despair of the possibility of any student giving me any time for conversation.) It's an extremely exciting project, but I think it's still mostly a large step in the direction of faster and more, and only a small step in the direction of better.