Monday, November 23, 2009

Education

Morse Code: Inside the College Rankings

Does Being at the Top of the Rankings Help Colleges?

July 16, 2009 05:42 PM ET | Robert Morse | Permanent Link | Print

Is there an impact on a college's admissions indicators as a result of its position in the U.S. News America's Best Colleges rankings? Is the influence of the rankings different depending on whether the school is a large research university or a smaller liberal arts college? How big could these effects be, and are they statistically significant?

In "Getting on the Front Page: Organizational Reputation, Status Signals, and the Impact of U.S. News and World Report on Student Decisions," recently published in Research in Higher Education, Nicholas A. Bowman of the University of Notre Dame and Michael N. Bastedo of the University of Michigan-Ann Arbor analyzed the U.S. News college rankings to try to answer those questions for top college administrators. Their article joins a rapidly expanding body of literature on college rankings and the impact the rankings might have on colleges and universities.

Their article's three key points are:

"First, moving onto the front page (the Top 50) of the U.S. News and World Report rankings results in a substantial improvement in admissions indicators in the following year, and these effects are apparent for both national universities and liberal arts colleges.

Second, once institutions have reached the top tier, moving up in the rankings provides noteworthy benefits for institutions in the top 25 and among national universities, but this impact is weaker or non-existent among liberal arts colleges and the bottom half of the top tier. Consumers of liberal arts colleges may not share the general perceptions of the overall population. One hypothesis is that these families are far more knowledgeable about higher education than are general consumers of higher education and therefore less sensitive to magazine rankings.

Third, tuition costs and instructional expenditures also serve as markers of institutional quality and prestige that yield improvements in subsequent admissions outcomes. These markers are influential primarily among liberal arts colleges and the lower half of the top tier. Consistent with the notion that potential consumers of liberal arts colleges are savvier in their decision-making, liberal arts colleges are the only type of institution in which admissions indicators are responsive to a proxy for institutional quality: expenditures on student instruction."

What is the nature of these benefits to colleges, and are they significant? According to the paper, appearing on the "front page" decreases a school's acceptance rate by 3.6 percentage points and results in a 2.3 percentage point increase in the proportion of students in the top 10 percent of their high school class. The "front page" effect was not significant for the average SAT scores, amounting to a 1.2 percentage point increase. From our end, all these changes are very small and would not have any impact on a school's standing in the Best Colleges rankings. I do wonder about the reliability of a statistical analysis that says it can accurately take into account all the factors that affect year-to-year admissions and can isolate the effect of the Best Colleges rankings.

The paper's conclusion that liberal arts colleges are not benefiting from their top-tier rankings and that prospective students and their parents are more influenced by factors other than the rankings is 100 percent counter to the statements of the presidents and admission deans from some liberal arts colleges. They have criticized the U.S. News college rankings as too influential in admissions decisions. I hope they read this paper and reconsider their criticism.

Tags: University of Notre Dame | University of Michigan | rankings

Tools: Share | | Comments (7) | Print

Reader Comments

College Admissions Consulting

Has anyone here used a college admissions consulting company? Someone recommended www.TheAdmissionsExperts.com to me. Has anyone else used their services? Thanks

Rankings ARE less important than other factors, and should be

Really? 100% counter to what presidents and deans say? I know that there are a coalition of liberal arts colleges that concede that the rankings are not as important, and I'd wager to say that after working with college-bound seniors as a tutor for a while, they ARE more influenced by other factors besides the rankings.

I always tell my students to use the rankings in conjunction with other factors. Harvard can be #1 all it wants but if you can't afford to attend, don't want to spend 4 years in Boston, or hate the atmosphere it doesn't matter, does it?

College rankings

Data is not good or bad. Ranking are not good or bad if the methodology is transparent. Parents and students need to understand that you can not boil a college down to a single number any more than I could take all the students in the country and rank them.

You need to time and energy to evaluate colleges and consider where you want to spend the next 4 plus years of your life and $100K to $200K. I have seen parents spend more time buying a car than a college and students be more concerned about the prom. Be an informed consumer; focus on the quality of the student that graduates. Look at how you fit in with the student body. Harvard & MIT are both good schools, adjacent to each other. But the student populations are very different. People hire college admission consultants for the same reason they have financial planners or realtors. They know what they don’t know.

Larry Dannenberg, CEO College Solutions

Add your thoughts

Your comment will be posted immediately, unless it is spam or contains profanity. For more information, please see our Comments FAQ.

advertisement

About this Blog

Robert Morse is director of data research for U.S. News & World Report and has worked at the magazine since 1976. He develops the methodologies and surveys for the America's Best Colleges and America's Best Graduate Schools annual rankings, keeping an eye on higher-education trends to make sure the rankings offer prospective students the best analysis available. Morse Code provides deeper insights into the methodologies and is a forum for commentary and analysis of college, grad and other rankings.

advertisement

NEWSLETTER

Sign up today for the latest headlines from U.S. News & World Report delivered to you free.

RSS FEEDS

Personalize your U.S. News with our feeds of blogs and breaking news headlines.

U.S. NEWS MOBILE

U.S. News daily briefings are also available on your mobile device.

Use of this Web site constitutes acceptance of our Terms and Conditions of Use and Privacy Policy.
Make USNews.com your home page.