Meaningful Measurement

Business leaders in the U.S. challenge the usefulness of a college degree, the media reports that high school graduates are opting to move to the city and begin work rather than attend college, entrepreneurial capitalists make significant investments in education, and reformers debate competing visions of higher education’s purpose. The year is 1889.

As tempting as it is to view our era as ahistorical, the educational climate of the late 19th century was, in important ways, similar to the one in which we find ourselves. Andrew Carnegie’s recommendation that “future captain[s] of industry” choose the “school of experience,” over a college education is echoed today by the likes of billionaire Facebook investor Peter Thiel, who pays college age “fellows” to drop out of school.

An hour of classroom or ‘seat’ time per week plus two hours of homework, times 15 weeks, equals one credit

Following the Civil War, American colleges and universities responded to changing attitudes regarding society, religion, and learning to pursue aims historian Laurence Veysey describes in his history of the American university as utilitarian (vocational, civic), research focused, or liberal cultural. These competing claims on the core purpose of education remain rivals in various stages of reconciliation.

By the government’s reckoning, according to its new College Scorecard, there are today roughly 7,000 institutions of higher learning in the U.S.—from community colleges to liberal arts colleges, from research institutions to for-profits. Their differences in mission and approach are vast, yet the Scorecard invites students and families to use the same, necessarily blunt metrics: graduation rate, student debt load, alumni earnings, and the like.

What nearly all of these institutions have in common is an unarguably superficial system of measuring a student’s progress—itself a vestige of Andrew Carnegie’s day. While a few have left it behind, nearly all schools use the credit hour as a proxy for learning. An hour of classroom or “seat” time per week plus two hours of homework, times 15 weeks, equals one credit.

Moving beyond the credit hour is an invitation to recognize learning that happens outside of the classroom

Originally conceived at the turn of the 20th century not as a measure of college-level learning but as a means of calculating faculty workload and qualification for pensions, the credit hour proved so convenient a standard that it gradually achieved its present power and presumptive meaning in higher education. Credits are the standard that state and federal governments use to award student grants and school funding; faculty are often compensated per credit hour taught; and families pay tuition and students achieve degrees on this basis.

We tend to assume that a third-year student is more advanced than her second-year counterpart. And wonder about the fifth-year student who hasn’t achieved her diploma. Should we?

The credit hour is surely as poor a measure of educational value or meaning as the time card, by itself, is a pale record of work performance. Some institutions are seeking a more meaningful alternative.

“Competency- or capacity-based education [CBE],” a growing trend in education, “flips that on its head and says it’s not about how many hours you spend in the classroom. It’s not about how much homework you do. It’s about what you learn. There are ways to demonstrate that learning but how you get there is rather secondary to actually getting there,” says Zeke Bernstein, dean of research, planning, and assessment at Bennington.

MEASURING MEANING

Bernstein and educators like him are interested in the potential for colleges and universities to re-emphasize the core purpose of education by re-thinking what they measure. Moving beyond the credit hour is an invitation to recognize learning that happens outside of the classroom and to encourage areas of a student’s development that exceed course content and academics.

“Students develop a lot of capacities outside the classroom in their independent work in ways that are very apparent to faculty. They could have an experience over a summer that transforms their motivation, their ability to work with a team, and so on. You would want that to be reflected in a way that’s much more dimensional than a credit or a grade. You could think about it as a complement to the narrative evaluation—something that provides students with an even more nuanced view of their strengths and weaknesses,” says Bennington President Mariko Silver.

In 2013, the Obama administration began to provisionally recognize and allow funding for CBE programs that “organize [course] content according to competencies—what a student knows and can do—rather than using a traditional scheme.”

As many as 600 U.S. institutions are currently exploring capacity-based learning for a variety of reasons.

MEASURING SKILL

“The motives [for exploring CBE] are sometimes economic or sometimes geared toward trying to accommodate an increasingly diverse student body,” says Michael Rose, American education scholar and professor of Social Research Methodology in the UCLA Graduate School of Education and Information Studies.

Organizations such as the New America Foundation argue the injustice of the idea that time in school is necessarily more valuable than time spent working. As Amy Laitinen writes in a policy paper for New America, “While some students earn credits for little more than sitting in class, millions of professionals who have acquired college-level learning on the job have no way to get credit for their learning.”

“If we’re looking at a nontraditional student population, there can be real merit for them [in a CBE program]. If you get someone who has been a tool and die maker for 20 years and is coming back into a mid-level technical program, that could make some difference in how long he has to be in school,” says Rose.

Rose is referring to a species of CBE sometimes called direct assessment, whereby students’ prior learning, perhaps through work experience, is assigned college credit, thus shortening their time in the classroom.

Many well-intentioned efforts to quantify the value of higher education run the risk of defining success by what is most easily measured, rather than by what is most meaningful

These and other credentialing initiatives, such as those spearheaded by the Gates and Lumina Foundations, generally see “capacities” through the lens of job training, which has implications far beyond how the term is defined.

“In some people’s mouths, ‘capacities’ is another way to say skills. But the idea of skills in the higher ed conversation has become fairly narrow and flat to mean vocational skills,” says President Silver. “The hope is that by talking about capacities we are reopening, in a sense, the idea of what skills are.”

THE BROAD DEFINITION

Several institutions address the idea of what skills or capacities are in broader and more interesting ways. It is in these examples that some of the most exciting innovations in higher education today are being tested.

Historian of mathematics and former Bennington faculty member Glen Van Brummelen helped to found Quest University, Canada’s first private liberal arts and sciences university, in British Columbia in 2007.

Like Bennington, Quest’s inquiry-based approach to learning asks students, a number that has grown from 74 eight years ago to 700 today, to identify a question that directs their learning in their last two years.

This and other features of the education such as month-long intensive “block” courses, which students take one at a time, and experiential learning are designed to produce creative graduates who are prepared to innovate. Van Brummelen asserts that developing soft skills like collaboration and communication, acquired both in and out of the classroom, is at least as valuable as mastering course content.

“At Quest as at Bennington, we don’t believe that classroom learning is sufficient to prepare students to be much more than professors. It only makes sense that students engage with possible careers as part of their selection of their life paths in college, and it’s baffling that so many universities have thought otherwise.”  

Quest students spend as much as a semester on experiential learning to understand how collaboration and compromise work in real settings. Van Brummelen believes this allows students to operate more effectively in their work but also in other areas of their lives. These experiences often determine students to change their educational focus.

“Imagine the career prospects lost to students who devote their energies, say, to preparing to be a teacher, and then find out too late that it’s not for them.”

Students don’t become leaders, Van Brummelen says, by sitting at desks or taking tests but by engaging in collaborative work both in and out of the classroom, by leading groups, presenting, posing questions, and implementing their solutions at some local level. “In other words, [by] learning to do exactly what they’ll need to do to change the world when they graduate.”

Mark Somerville, professor of electrical engineering and physics, is a founding faculty member at Olin College of Engineering in Needham, Massachusetts, a school that seeks to “radically change engineering education and fuel innovation.”

His book, A Whole New Engineer, co-written with Professor Emeritus of the University of Illinois at Urbana-Champaign David Goldberg, chronicles how engineering, once the pioneering and visionary profession that produced the Ferris wheel and electric illumination came, over time, to be narrowly defined by technical expertise and argues for the need for engineers with imagination, intuition, and emotional intelligence as well as technological skill.

The capacities required for engineers to transform from technicians and problem solvers to true innovators include a broad array of capacities. Somerville and Goldberg refer to them as “minds”—analytical mind, design mind, and people mind, among others.

Teaching the whole person, he explains, is superior to taking a solely cognitive approach to grow engineers’ ability to empathize, to recognize what others’ needs are, and to come up with creative solutions to these problems.