Morse Code: Inside the College Rankings

The Wait for the National Research Council Rankings Continues

July 9, 2009 RSS Feed Print
  • Comment (16)

If you are one those in waiting for the National Research Council (NRC) to release its new rankings on U.S. doctoral programs, you will have to be patient a lot longer. The NRC doctoral ranking project, which began in 2003, just released A Guide to the Methodology of the National Research Council Assessment of Doctorate Programs. The guide offers a sophisticated, 191-page explanation of the methodology that the NRC will use when it does publish the rankings, which will cover doctoral programs in 61 doctoral fields at 222 institutions.

The NRC makes it very clear that it is not setting a date for the release of the rankings. Why, after all this time, is the NRC unable to set a firm date for when the new rankings will be published? The NRC's website says:

"With the publication of the Methodology Guide, we have completed a major milestone. The NRC and its committee feel an enormous obligation to produce data and rankings that are of the highest quality possible. Striving for this objective requires careful review of the data and rankings for over 5000 programs. This has already taken considerable time and is nearing completion. The committee must also finish summarizing the most important findings from the data, as well as discuss the strengths and shortcomings of the methodology for incorporation in the final report. The last step of the process is for the final report to undergo the Academy's rigorous review. We are working to complete all this work as expeditiously as possible."

When the rankings finally are published, they will be produced in ranges and not as a single number. Each Ph.D. program will be assessed overall, as well as in depth in three areas: research activity, student support and outcomes, and student and faculty diversity.

Some questions to ponder while we all continue to wait for the new NRC rankings:

Are the data that will be used in the rankings losing their analytical validity since they will be from the 2005-2006 academic year?

Why wasn't the NRC able to produce its rankings more quickly, using more up-to-date information?

How many faculty members have switched institutions and departments since the NRC first started collecting data in fall 2006? This is very important because faculty data are a key part of the NRC's analysis.

Is the NRC's methodology too complicated for the typical Ph.D. student and faculty member to understand? Will the fact that the methodology is very complex make the NRC's rankings less accessible to prospective doctoral students and others in academia?

U.S. News produces the annual America's Best Graduate Schools rankings. In the same period that the NRC has been working on its yet-to-be-completed rankings, U.S. News has published seven rankings using the most up-to-date school data. Since the last NRC rankings were published in 1995, U.S. News has published 14 annual America's Best Graduate Schools rankings. As a result, it should not be a surprise that the U.S. News rankings have become an important source of information for anyone looking to go to a U.S. graduate school.

Tags:
graduate schools,
rankings

Reader Comments Read all comments (16)

Add Your Thoughts
Your comment will be posted immediately, unless it is spam or contains profanity. For more information, please see our Comments FAQ.

I think that the NRC report is producing something fundamentally different from U.S. News and World Report’s rankings. It is giving an in-depth qualitative evaluation of graduate programs and doing this with respect to graduate students and professor opinion. In contrast, U.S. News and World Report is taking figures and producing a numerical output that may not correspond with the actual value a graduate program. Within many disciplines, there may be more unperceived characteristics of a graduate program of interest to students than U.S. News and World rankings may be sensitive too. This may be why NRC rankings showed Harvard to be somewhere lower than what its endowment would have one believe, many of its research programmes are stagnant and not influential, a characteristic U.S. News staff may be unqualified to assess.

Ricardo Lezama of CA 6:13AM December 08, 2010

U.S. News should expand the fields that you rank in your Graduate Schools report, so that you would in effect do a yearly comprehensive NRC-type ranking. And consider the methodology NRC used to see whether you can improve yours.

Greg Mantell of CA 8:25PM October 25, 2010

The NRC was to have had its data available in 2007, but they kept putting it off, revising, and apparently making up their methods on the fly. Information can become so sophisticated and outdated as to be irrelevant. I suspect that in trying to control how their report will be used by other ranking agencies, they've exceeded their ability to produce an objective survey. Conversion of their 1995 data into mathematically significant output showed Harvard University ranking in the twenties.

james andrew of FL 1:54PM August 03, 2010

Morse Code: Inside the College Rankings

Robert Morse is director of data research for U.S.News & World Report and has worked at the company since 1976. He develops the methodologies and surveys for the Best Colleges and Best Graduate Schools annual rankings, keeping an eye on higher-education trends to make sure the rankings offer prospective students the best analysis available. Morse Code provides deeper insights into the methodologies and is a forum for commentary and analysis of college, grad, and other rankings.

advertisement

College Search

Within miles of Advanced Search

Knowledge Centers

Looking at colleges? Find out what you need to know.

advertisement