<img height="1" width="1" style="display:none" src="https://q.quora.com/_/ad/bdd9d941ae754c498fe2d2326d029ffa/pixel?tag=ViewContent&amp;noscript=1">

How Reliable Are College Ranking Systems?

Featured Stories

Filter By Categories

If you’re involved in the college applications process, you know how powerful college ranking systems are. Universities pursue high rankings to cultivate prestige and desirability; students seek admission to highly ranked schools as a sound investment for their future. While we’ve previously gone over the methodology behind some of the more popular college ranking systems in the United States, we didn’t delve into how powerful rankings can be in shaping people’s perceptions of institutional prestige.


A 2010 Bastedo and Bowman study, for example, found that future peer assessments of a college’s reputation were significantly influenced by early college rankings, even when they controlled for changes in organizational quality and performance. In other words, schools have a lot to gain (and lose) from college rankings. College rankings help determine their reputations. In the world of higher education: Where prestige often acts as academic currency, this can incentivize schools to game the college ranking system, manipulating or misreporting their data to make sure they are ranked higher than their peer institutions. So before you put too much trust in college ranking systems, take a look at some of their strategies that may have already influenced your perception.


College Rankings: Acceptance Rate Reliability


Many college ranking systems use measures of student selectivity to generate their results. Student selectivity is often determined by a school’s acceptance rate, as well as the SAT scores and class ranks of its enrolled students. Schools like Harvard and Yale, with their respective acceptance rates of 5.2 percent and 6.9 percent are considered highly selective and are at the top of most college rankings. The problem with acceptance rates, however, is that they are fairly easy to manipulate. By recruiting more applicants, a school can easily lower its acceptance rate, thereby moving up a few spots in rankings without making any improvements to the quality of education it offers.


Colleges and universities have caught on to this loophole and integrate it into recruiting practices. According to a 2014 Hanover Research report, colleges are spending more on recruitment than ever. “One of the most notable trends in higher education branding and marketing is that institutions are dedicating far more attention to these functions than in previous years.” This trend is indicative of a larger corporatization of higher education. In fact, “many universities have hired marketing professionals from the corporate world,” spending a significant amount of resources on creating and strengthening their brands.


It’s not by chance that colleges are acting increasingly like corporations, as ranking systems actively encourage this corporate mentality. Frank Bruni from the New York Times explains this phenomenon well when explaining that by pitting colleges against one another, ranking systems “[foster] the idea that schools are brands in competition with one another.” When schools are hierarchized based on student selectivity, they are incentivized to recruit as many students as possible—even those who are unlikely to be accepted.


College Rankings: Test Score Reliability


The SAT and ACT scores of enrolled students are another common measure of student selectivity. For this reason, colleges have employed creative strategies to exaggerate their students’ high test scores. Northeastern University, for example, has made the news for its dramatic advancement in national ranking, going from #162 to #49 over the course of 17 years. The school’s success is attributed to its strategic focus on U.S. News and World Report’s undergraduate rankings. One of its strategies was to stop requiring SAT scores from students attending international high schools. Because international applicants tend to score lower on the SAT, this approach allowed Northeastern to encourage applications from abroad, thereby lowering its acceptance rate without jeopardizing its test scores. Northeastern is one example of schools manipulating their data without being overtly dishonest about it.

Other schools, however, have blatantly lied about their admissions statistics. Claremont McKenna College, Bucknell University, Emory University, and George Washington University have all made headlines for admitting to the submission of incorrect data to U.S. Newsarguably the most influential college ranking system in the United States. These scandals raise an important concern regarding college rankings: Many rely significantly on data submitted by the colleges and universities themselves, which are far from being disinterested third parties. Although ranking systems often verify or supplement this data from other sources (U.S. News obtains missing data from the Council for Aid to Education and the U.S. Department of Education’s National Center for Education Statistics for example), much of their data still comes from schools who have significant stakes in the outcomes.


To make matters worse, rankings are highly ambitious projects. U.S. News, for example, ranked 1,388 colleges and universities in 2018. The sheer amount of data that is collected each year for these rankings makes it unlikely that they are being fact-checked to anyone’s satisfaction.


How Can You Determine the Overall Reliability of College Rankings?


It’s impossible to keep up with every higher education scandal. And despite their controversy, you might decide that college ranking systems are still a useful starting point in your college search. So how can students and parents determine reliability? One quick and easy way is to examine exactly what is being measured by a particular ranking system, and which data sets are of particular interest to you. Student selectivity, for example, reveals almost nothing about what a school provides for its students. Rather, it reveals what the students are doing for the school. Measures of input such as acceptance rates, test scores, and class ranks tell you little about the quality of education that a college offers and only reinforce existing institutional reputations.


Focus on measures of output (e.g., graduation rates, postgraduate salary, ability to repay student debt) or school resources (e.g., the quality of faculty, the faculty-to-student ratio), which tend to be better indicators of a school’s value. Finally, avoid ranking systems which are largely based on a school’s reputation. For U.S. News, undergraduate academic reputation comprises 22.5 percent of a school’s total score. This metric ignores the fact that reputation is an extremely subjective and roundabout way of measuring a school’s value. What people think about a school is less important than actual statistics about the school itself. If you choose to be a consumer of college rankings, make sure you’re a smart and informed one by being aware of the various ways in which schools can game college ranking systems.

Edmit's advice helps you to be better off after graduation.

  • Merit and financial aid estimates based on your student profile
  • Earnings estimates and financial scores for your college and major
  • Recommendations to save thousands on college

Sign up for updates

Popular Tags

Financial Aid and Scholarships* Cost of College* paying for college financial aid FAFSA Student Loans* grants and scholarships federal student loans Saving for College* Salary and Career* college tuition 529 plan cost of attendance expected family contribution private student loans college financial planning financial aid award taxes career college savings plan room and board on-campus housing merit scholarships budgeting for college college expenses federal financial aid merit-based financial aid private universities public universities edmit hidden gems edmit team college costs parent PLUS loan college applications living expenses CSS profile education expenses financial need income application fees career fit choosing a major financial aid appeal off-campus housing choosing a college college majors loan forgiveness affordable college degree programs loan repayment repayment plans researching careers student loan assistance student loan debt work-study application fee waivers career exploration college search coronavirus edmit scholarship institutional aid net price private scholarships SAT career goals college visits in-state tuition prepaid tuition plans ACT budget free tuition international students internships need-based financial aid need-blind colleges qualified higher education expenses retirement savings school-based scholarships southern colleges standardized testing tuition discount tuition guarantee tuition payment plans 401k UGMA UTMA applying to college college financial health college ranking systems college spending college transfers credit score discretionary income distance learning education savings accounts fees financial literacy full ride scholarship gap year grants health insurance options investment ivy league schools liberal arts degree meal plans midwestern colleges need-aware colleges out-of-state tuition saving state aid tuition increases western colleges 568 presidents group Inversant MEFA asset protection allowance best price campus life college advisor college credits college deposit college viability community college concurrent enrollment cost by region cost by state crowdfunding dorms early decision educational expenses esports fee waivers financial wellness for-profit universities fraternities and sororities full tuition graduate school home equity loan income share agreements job applications line of credit lists medical expenses medical school military benefits net price calculators new england colleges non-profit universities online learning online tuition out-of-state students percent need met private college consultant remote learning self-assessment siblings small business state schools student bank accounts student organizations subsidized loans title IV schools travel expenses tuition decreases tuition insurance tuition reciprocity undocumented students unsubsidized loans work-based learning