How much would you estimate schools spend to lobby or market to improve their rankings?

The ranking system is sort of lobby-proof. Talking to US News isn’t going to improve your ranking because they’re based on quantitative numbers, a formula, but certainly schools send out brochures, try to raise their profile among other presidents and deans because of the academic survey. I think it’s more subtle how they’re spending money to improve in the rankings. With Washington University or UNC, they may be spending money to improve student services so they get a higher graduation rate. The way to improve in the rankings is through the institution itself, not by lobbying US News, which is actually a good thing because students benefit from that.

How has your formula changed over the last ten to fifteen years?

At the beginning they were 100% reputation, and today they’re 25% reputation and 75% quantitative data, so that’s certainly one change. We’ve de-emphasized admissions data to some degree. We’ve switched the weight to output like graduation and retention rates. We’ve also dropped “yield.” At one point we had yield in the model, but now we don’t.

Which colleges, in your opinion, will be making a jump in the rankings?

Rochester has been falling recently. For the next few years, the rankings are going to be impacted by the recession. States have been cutting the budgets of the some of the major public schools. It’ll be interesting to see whether the UCal schools can maintain their position. It’s unclear whether the tuition increase is going to be enough to cover the budget cuts. They may start taking more out-of-state students. The UCals take almost no out-of-state students, so there’s talk that they’re going to take a greater percent of out-of-state students because their tuition is so much higher. It’s going to be harder for in-state students to get into the publics from their own state as those schools accept or enroll a greater proportion from out of state as a revenue enhancer.

If the UC schools drop in the rankings, who comes up?

Some of the privates who’ve been managed [constructively] may be able to maintain their budgets. Some of the privates’ endowments have really fallen. The way these rules work, you have to average your endowment spending over x number of years, so that will have an impact on their budgets. There are rules: you have to spend 4 or 5% of your endowment each year, so if your endowment is shrinking, that’s why schools like Harvard have to cut back. The point is, it’s hard to know how all these cutbacks and trends are going to impact the rankings because it’s happening in both publics and privates in different ways.

I know that schools have tried to emphasize their alumni giving. That’s how schools game the rankings, by boosting their alumni giving rate. We’re not counting the average contribution; we’re counting the average portion of alumni that are giving – not the amounts. But it’s not a heavily weighted factor.

How do you see the ranking system changing over the next few years?

Using the web, we can create a use-your-own-ranking. Students can develop their own ranking, so if they think the student-faculty ratio is more important than U.S. News does, they can weight our factors using their own weights to come up with where they stand. We’re going to build more interactive features on our website, trying to take advantage of what the internet offers to students.

I think maybe within a few years there will be more outcome measures, more ways of viewing the student experience: student engagement or student learning. That’s what’s missing from the rankings: some indicator of what’s going on in the classroom, or how much students have learned.

Do you think that U.S. News would benefit from factoring in what students do after graduation?

Definitely. But [right now] it’s only spotty data. We measure what happens after graduation in our MBA rankings and our law rankings because we have placement data, career outcomes for the most recent class, but there’s nothing like that available at the undergraduate level. Yes, if there were data like that, it would be pretty powerful.

Have any notable schools called or emailed to contest their rankings?

Schools call and contest their rankings all the time. The schools don’t really lobby us … schools call about their rankings. A couple years ago we had something about UC Davis saying that they’d misreported some data, and they called up all upset about it. What you find, the very top schools – the Harvard, Yale, and Princeton’s – they will try to stay above the fray. They don’t send out press releases and they’re not going to be in contact with us on the rankings.

A lot of it is, Why [do] they rank the way they do, or, Explain how the rankings work, or, Where’d you get that data – because in some cases if they’ve assigned filling out the surveys to some other office, then when the rankings come out, a senior person in the president’s office says, Well that can’t be right. Of course we can prove that we got it from the school. Sometimes you can call up two or three offices at the same school and get slightly different answers to the same questions. So we face that when we collect data from schools.

This concludes Top Test Prep’s in-depth interview with Bob Morse of U.S. News & World Report. Stay tuned for some more great interviews with college admissions experts.

Amary Wiggin is an academic tutor and blogger for Top Test Prep. She graduated from Harvard in 2009.

Tags: Admissions Advice, Admissions Data, College Rankings, Colleges // Add Comment »

Have you seen any questionable practices put in place just so a college can increase its ranking?

There was an event in the summer that came to light, even though I think it was debunked: that the president of Clemson … they were not voting honestly on the peer assessment survey … but we have safeguards to prevent strategic voting.

Some schools have put in ways to boost their application count. They may have a one or two or three part application, and reject a student on the second part. They may not have had any intent to seriously consider the student.

When they report their data, some schools leave out minorities or certain types of students … they’ll have left out special cases who are beneath their SAT or ACT profile, so they may look like their scores are higher than they are. It’s unclear why they actually do that, because they may be inhibiting people from applying. I haven’t seen any specific names.

How does a college break into the top rankings?

It’s very difficult. It’s relatively easy, if you’re right beneath the top half, to break into the top half, or to move up somewhat if you’re in the middle of the pack. If you’re in the middle of the pack, it’s easy to move up somewhat, and college presidents  have a reputation doing that, like Clemson or Northeastern. There are many schools – Arizona State, University of Arkansas, to name some – who haven’t been that highly ranked, but because their profile isn’t that high, they’ve moved up into the bottom of the top half.

It’s very crowded at the top. It’s really hard to change your academic profile – to become another Harvard, Yale, or Princeton – for a number of reasons. It’s not impossible, but it’s difficult. It’s probably easier now in some ways than it used to be, because schools are becoming more international. There is a much bigger population in the US or the world, so the top 1 or 2% of SAT scores is bigger. Places like Stanford don’t have enough spaces for the top 1 or 2% of students. You can tell by their rejection rates. They’re rejecting people with a 1600, they’re rejecting valedictorians, they’re rejecting … the saddest part of the whole process is high school students who’ve played by all the rules … they’ve created the perfect application packet, and they can get rejected, whereas 20 years ago the odds of you getting into those top schools was greater. There’s a pool of these students who have to go somewhere. That’s why Duke and MIT and Washington University and USC … their academic profile is much higher than it used to be – their admission profile. In some cases they’ve used scholarships, but in other cases there’s just more people out there.

What are some of the major trends you’ve noticed in the rankings?

When we first started doing the rankings, they were ignored in some ways by college presidents. Now it’s become an acceptable thing among some college presidents to have as a goal: improving in the college rankings. This is at places such as Northeastern and Arizona State and Clemson, so the acceptance of the rankings as an academic benchmark, that’s certainly been one trend.

Another trend along the same lines is that many schools brand themselves by how well they do in our rankings or other rankings. When the rankings first came out, they wouldn’t consider doing that. It’s not that we were asking them to do it, but that speaks to the school’s needs of having an external force telling the public they’re good.

Another trend: the schools have gotten way more sophisticated in understanding the rankings and how they work. I think the public has benefitted because there didn’t used to be a lot of higher education data out there. [With] the amount of higher ed data that exists, schools have gotten much better at producing information on themselves, so they’ve responded to the consumer’s need for comparative higher educational data.

Have some schools rebelled against the rankings?

Reed, Oregon, St. John’s in Annapolis and its cousin schools – those are some of the … biggest rebels.  They refuse to turn over their statistical data, or they refuse to fill out certain parts of the survey, so they’re taking this supposedly principled stance. They think that being against the establishment is going to be appealing to their particular applicant pool. I think that’s the main reason they do it.

It’s fine if they don’t want to do that, but what the schools have to realize is that there’s so much public, available data. They have to turn in essentially the same data to the government, so we’re able to get the same information from other sources. There’s been a movement among certain liberal arts colleges to not participate in the peer surveys. Amherst, Swarthmore, Reed, Oberlin. Lloyd Thacker has a movement called “college unranked.”

How should students use the rankings?

Nobody, a student or a parent, should ever use the rankings as the sole basis for deciding to go to one school. It should not be the most important factor.

The UCLA freshman survey asks freshmen to choose what factors have been very important in choosing to go to [their] school. The rankings themselves are not a top factor, but certainly they’re more important among minority groups or international students. For people who are going to more selective schools, the rankings are more important. I understand why: if you’re coming from overseas, you want to go to a brand name, because that’s going to be important when you come back to the country. To some parents, when you’re paying, as the price of college has gone up, people want to know if they’re getting their money’s worth, trying to analyze the best value, so that’s another factor in why the rankings have become a more powerful source.

I think it’s a minority who uses the rankings as a primary factor, but some do. Admissions counselors or high school counselors have told stories about parents who come in and are effectively saying, “I only want my Johnny or Jane to go to a school above this line,” or “The schools you’ve recommended aren’t too highly ranked by U.S. News.” We’re not the best friend of counselors who feel it’s offering a simplistic answer to a complex problem.

More to come …

Amary Wiggin is an academic tutor and blogger for Top Test Prep. She graduated from Harvard in 2009.

Tags: Admissions Advice, College Applications, College Rankings, Colleges // Add Comment »

Meet the man behind the single most influential list in college admissions. Bob Morse is the Director of Data Research at U.S. News & World Report, the head of its revered college ranking system. As the force behind a series of annual publications that have achieved unanticipated fame within higher education, Bob Morse has helped to create the college ranking system as it exists today. He was nice enough to sit down with Top Test Prep and answer some questions.

Start by telling us a little bit about yourself.

I’ve been at U.S. News since 1976. I have a BA in economics and an MBA in finance, so I have a research and quantitative background. Doing the rankings is a research and quantitative analysis project. It’s not journalism in the sense that even though I do have a blog, the rankings themselves aren’t reporting … they’re creating information, while typical journalism is reporting on an event or analyzing an event or giving context to something that’s happened.

You have a blog?

I write the blog once or twice a week – Morse Code: Inside the College Rankings. Prior to the blog, U.S. News wouldn’t really write about rankings except at the time that we published the college and grad rankings, so the blog gives us the ability to … make announcements.

How did you get connected to U.S. News & World Report?

I worked on Wall Street briefly, at a company called E.F. Hutton. A lot of them don’t exist anymore – they merged away – but I used to work there in the mid-70’s. I was at U.S. News, but in another department. It doesn’t exist anymore … a research department called the economic unit.

U.S. News was moving from doing the rankings just based on reputation only – in the very beginning, before I was involved, they were done very simplistically, in ’83 and ’85. They wanted to make them more sophisticated.

How did the rankings come about?

At the beginning … we didn’t have the thick guidebook and we didn’t have the web, so it was just something that appeared in the weekly magazine in a very limited sense, sort of a top ten list. It was not some guerilla force in admissions or higher ed – it was just information for consumers and our readers. Nobody thought that it was going to evolve into anything but an occasional feature or cover story. In ’87 I was put in charge. We were going to make it more sophisticated, a combination of reputation and quantitative data, and we were going to start doing this annual guidebook. I got involved in it because they wanted someone with a quantitative research background.

How do you assess a school’s reputation?

It’s become one of the more controversial parts of the rankings … controversial among people in the higher education establishment. The rankings themselves aren’t controversial to the public. The public, obviously, uses them and is attracted to them to a significant degree – otherwise we wouldn’t keep doing them.

We give college presidents and admissions deans and provosts a list of schools and we ask them to rate which ones are excellent and good, so it’s a subjective judgment about the relative standing of schools based on their academic reputations. The academic establishment doesn’t like that – or some of them don’t. Maybe liberal arts schools don’t. I think research universities do.

What’s most interesting to you about the rankings?

A couple things. One, how it’s become this force in higher education. Some colleges are trying publicly to do better in the rankings and … make educational decisions to improve in the rankings. I think that’s pretty interesting.

I think that we’ve filled an informational gap. There’s been a decrease in high school counseling – not at private schools, but at public schools – high school counseling has been diminished by budget cuts, and the public is really searching for tools to help them decide what’s the best school for them. So they’re forced to make decisions on their own and fend for themselves. It’s been satisfying that we’ve been able to fill this informational void. People are becoming more quantitative in judging the best schools.

Another interesting thing is that we’ve been part of this accountability movement. Schools are being held accountable for how they spend money, and whether they’re succeeding in educating students: how well are they doing at what they’re supposed to be doing. So it’s been interesting to be part of all these trends.

Which colleges have seen their rankings improve the most over the last two or three years?

The rankings are more stable than people think. Typically over a two- or three-year period, the rankings don’t move that much, but I think two schools … Universtiy of Southern California and Washington University in St. Louis … have over the last decade or so made a strategic – they have a strategy to improve themselves, and their strategy is across-the-board improvement, step-by-step. They take small steps each year institution-wide, and that’s the formula to improve in the rankings.

What kind of “small steps” are colleges taking?

They’re not small in the sense that they’re little things. They just do them a little bit each year. For example, [a college] would raise the SAT average, so maybe one year it was 1200, the next year it was 1225, the next year it was 1250 … but they wouldn’t go from 1100 to 1300 in one year; they would do it over a ten-year period. Or they would increase the freshman retention rate. They’d put money into increasing freshman retention. The graduation rate would be another one, or faculty salaries. They might put more emphasis on small classes and reduce the number of large classes. They’ll do this a little bit each year, focusing on many factors of the academic environment.

To be continued …

Amary Wiggin is an academic tutor and blogger for Top Test Prep. She graduated from Harvard in 2009.

Tags: Admissions Advice, Admissions Data, College Counseling, College Rankings, Colleges // Add Comment »

Ross Blankenship (Admissions Expert and College Consultant) Addresses the US News and World Report Rankings.

The current college ranking systems provide an easy way for prospective students to see how one institution ranks against another. This can make for a simple way to see which colleges will provide the best education. At least that is what the ranking system is supposed to do. In recent years though there has been some criticism regarding the methodologies used to rank colleges.

In this article we will talk about the current system of college rankings. We will cover what the current ranking system is, and talk a little about the criticisms of the methodologies used for admissions rankings.

What Are Admissions Rankings Generally

Before we talk about what is good about the current system and what is not, it is important to understand how colleges are currently ranked in the United States. It is also important to know that there is more than one ranking system available such as Webometrics.

The methodology that most of us are familiar with is the ratings that are given by the US News. This system has been around since 1983, and each year the ratings for colleges change. The US News ranks scores each institution with a score between 1 and 100, with 100 being the best, and they separate the schools into 4 tiers. The “best schools” are listed as tier 1.

The ratings are based on gathered data that take into account the following factors:

Peer Assessment – Reputation of the school based on a survey of presidents, provosts, and deans from other institutions.

Retention – The graduation rate over a 6-year period, and the retention rate of first year students.

Student Selectivity – A combination of data based on: test scores of students, the percentage of top percentile students admitted, and the student acceptance rate as a whole.

Faculty Resources – Data that includes the student-faculty ratio, the average salary of faculty members, and the education level of the faculty.

Financial Resources – Average tuition rates per-student.

Graduation Rate Performance – The difference between what the expected rate of graduation was and what the actual graduation rate turned out to be.

Alumni Giving Rate – The amount of money received from donations by alumni.

The first four elements on the list account for 80% of the total score. Peer assessment alone makes 25% of the rating, and that is where most of the criticism of the US News ranking system comes in to play.

The Good and the Bad of U.S. News Rankings

In recent years there has been some criticism of the current rating system. It has been said that with the weighting given to peer assessment, student selectivity, and faculty resources that it becomes easy to pick which schools will come out on top. The largest schools and the richest schools will win out over the smaller colleges every time, regardless of the actual education that a student can expect to receive from the institution.

Looking at the historical data, these statements are true to a certain degree. Schools like Harvard, Yale, and Princeton always end up on top of the list along with several Ivies like Cornell and Penn. Some suggest that, to get a true measure of school performance, the ratings should give a larger weighting to factors related to graduation rates, salaries after graduation, and student performance in the long run.

Even with the criticisms, the current college ranking system does provide a method for students to see how their chosen (or prospective) institution ranks against similar colleges in the country. It provides a simple method to see where they can expect a top-rated education, and where they will be getting a second tier education.

It is likely that prospective students should still talk to an admissions consultant, or a college counselor, before making their final decisions. But, with the US News and their admissions rankings, those students do have a simple place to start when looking for the best schools in the country.

This was written by Ross Blankenship, an admissions expert and college consultant. For inquiries, please call (800) 501-PREP.

Top Test Prep provides private tutoring and admissions consulting to students and parents across America.

Tags: College Rankings, Colleges // Add Comment »

We’ve had many students ask us what colleges are the best engineering and computer science schools. Using a weighted average of faculty resources, technology grants, class size, and student ratings, we have developed the following list to help guide students and parents in the admissions process. The list provides a concise summary of these top engineering and tech programs. For more information, contact us directly.

(1) California Institute of Technology, Pasadena, CA
“Cal Tech” is the top ranked tech savvy college. The school is packed with great professors and has a niche in the California technology industry, including Google and Yahoo. Cal Tech is highly recommended if you’re interested in entering Silicon Valley and have a knack for inventing new technologies. Their undergraduate program is one of the best for students interested in individual research projects with professors and Cal Tech is a key part of NASA’s Jet Propulsion Laboratory.

Some key specialties: Natural Sciences, Biotechnology, Space Sciences
Famous alumni: Gordon E. Moore, co-founder of Intel Corporation; Charles Francis Richter, creator of the Richter Magnitude Scale;
SAT range for incoming students: 2200-2350
Acceptance rate: 17%

(2) Massachusetts Institute of Technology, Cambridge, MA
MIT is a great school with unique resources for its students. If you’re interested in graduating with the famed “MIT” degree, and want to be immersed in high quality education, every day, then this is a great place to be. With more Nobel prizes than one could count in an hour, they define excellence in engineering. Their high alumni giving suggest generations of families are happy with their educational choice. MIT probably has the highest name recognition worldwide amongst scholars and students.

Some key specialties: Artificial Intelligence, Aerospace Engineering
Famous alumni: Col. Buzz Aldrin, NASA Astronaut; IM Pei, world-renowned designer and architect; Robert Metcalfe, inventor of Ethernet and founder, 3COM;
SAT range for incoming students: 2070-2340
Acceptance rate: 13%

(3) Cornell University, Ithaca, NY
Cornell is one of the few colleges with engineering research programs that allow students to work directly under renowned professors. With faculty like Bill Nye (the science guy) and Steven Squyres of the NASA Mars Rover program, you will have the opportunity to learn from the best. Be prepared to work harder at Cornell than you would at most colleges. Cornell’s unique engineering science facilities include newly built Duffield Hall, which represents the university’s next high-tech step.

Some key specialties: Engineering Physics, Nanotechnology, Biomedical Sciences
Famous alumni: Steven Squyres, principal science investigator for the Mars rovers; William F. Friedman, founder of the study of cybernetics;
SAT range for incoming students: 1940-2240
Acceptance rate: 24%

(4) Carnegie Mellon University, Pittsburgh, PA

Founded originally as “Carnegie Technical Schools” in 1900 by industrialist Andrew Carnegie, the school is primarily known for its science and research. Carnegie Mellon hosts the Software Engineering Institute (SEI), a federally funded research and development center sponsored by the U.S. Department of Defense and operated by Carnegie Mellon University. In addition, they host the Robotics Institute (RI), a division of the School of Computer Science. Overall, its solid reputation amongst scholars and education journals is a reason why students should look to this school.

Some key specialties: Computer Science, Software Engineering
Famous alumni: James Gosling, creator of the Java programming language; Andy Bechtolsheim, co-founder of Sun Microsystems; Vinod Khosla, billionaire venture capitalist and co-founder of Sun Microsystems;
SAT range for incoming students: 1940-2235
Acceptance rate: 34%

(5) University of Texas, Austin, TX

Considered to be one of the “Public Ivies” in America, the University of Texas has fantastic resources for their students. As a public university, it spends almost 50 percent of their engineering budget on sponsored research. UT’s Cockrell School of Engineering enrolled 67 new National Merit Scholars in 2006-2007, the university’s largest proportion of new National Merit Scholars. UT Austin enrolls the third highest National merit scholars nationally. Plus, Texas is a great state with awesome weather and friendly people. Definitely keep UT-Austin in mind when applying to college.

Some key specialties: Petroleum Engineering, Computer Engineering
Famous alumni: Michael Dell, Founder and CEO of Dell Computers; Rex Tillerson, Exxon Mobil Corp. chairman and CEO.
SAT range for incoming students: 1680-2055
Acceptance rate: 49%*

*Note that this admissions rate will be affected by Texas’ top ten percent law, which guarantees graduating Texas high school seniors in the top 10% of their class admission to any public Texas university

Brought to you by Top Test Prep
Test Prep and Admissions

And the writers of…
Education Blog

Tags: Admissions Advice, Admissions Data, College Rankings // Add Comment »

We have had a lot of questions about the new college rankings, particularly what sort of methodology was used to assess hundreds of schools throughout the country. Although there’s an entire school of thought on the efficacy of the rankings themselves, what we believe is that the criteria should at the very least be modified. One of the key criteria we believe should be factored into these rankings is post-graduation statistics, namely what students are doing from these prestigious colleges after they graduate.

We believe that much information could be gleaned by adding an additional category on post-graduation employment and/or statistics on graduate school entry. Adding an additional category would reflect a college’s ultimate purpose, i.e. providing employment opportunities and/or graduate program opportunities.

There are two reasons why adding this criteria into the rankings would be helpful: (1) this information would show the public exactly what the graduates do after college, and (2) it would create an incentive for colleges to improve their career services and graduate program counseling. If a parent were comparing two top schools, let’s say Cornell University and Washington University in St. Louis (both ranked 12th respectively), would it not serve the public well to know which school provides its graduates better career opportunities and/or graduate program opportunities? Further, colleges have for generations been adjusting their core curriculum and admissions based on the U.S. News rankings. Whether this is a good or bad thing could be debated for just as long. However, if parents are going to spend 40 to 50 thousand dollars per year on their son or daughter’s education, it would be helpful to know what exactly their son or daughter will do after graduation.

The U.S. News Rankings do provide valuable information on colleges, both public, private, as well as liberal arts and graduate schools. But the methodology could be improved with additional criteria like graduation statistics specific to employment and further education pursued by students. This addition would create major incentives to improve student resources, would give valuable information to parents and students and lastly, would provide a greater ability for parents to differentiate these schools.

-Ross Blankenship, Co-Founder, Top Test Prep

Test Prep and Admissions

Tags: Admissions Office, College Rankings // Add Comment »