I hinted at this in my earlier post, but I ranking "makes sense" if it actually reflects what most people would actually do if given a choice between schools. If I were admitted to every school on the planet, I'd probably go to Stanford. Others might say Harvard. It "makes sense" that these schools would be ranked at the top. So, if I look at a ranking and see a whole bunch of schools ranked in a way that makes no sense at all, I discount the entire ranking.
I don't really care about the ranking methodology, but there are some things that shouldn't matter when judging whether a ranking "makes sense".
1. Throw out your personal biases. If you really really want to work in Alabama, and really really want want to go to school in the state because of personal reasons, you should still understand that the business school at Alabama (not picking on any school in particular) is no Harvard. And it's not Michigan, NYU or Kellogg either. Certainly, there are people who favor certain places, but leave those out of the rankings. People can look at a set of rankings, then apply their own personal biases when making their decisions; there's no reason to include such biases in the ranking.
2. Salary should be only a minor consideration. There are just too many variances with regards to salary. Industry & region are obviously huge factors, but again, a lot of these preferences are personal. A poster above stated that he/she would be happy in Cleveland at a far lower salary than in NY. Well, from a cost of living perspective that might make sense, but there's a damn good reason why cost of living is so different. You couldn't pay some people (a lot of people) enough to live in Cleveland. I would much rather make 100k and live in San Francisco than make twice as much to live in Cleveland. Ahh, the horror! I'll argue my quality of life will be better in SF because of the great weather, accessibility to world class restaurants, proximity to Napa Valley, etc.; while someone else will argue that it's self-evident that a better quality of life can be had in Cleveland (I just don't see how that could be possible in Cleveland
) But, that's my personal preference.
I think it's important to distinguish between schools as far as accessibility to jobs and regions. For example, we know that for major MBA destinations, IB and MC are generally the most selective. Now, do a lot of students from a particular school avoid these destinations because they choose to (I think Stanford might be like this), or is it because students at the school are not competitive for such roles (most schools outside the elites). That's an important distinction. The actual percentages and the salaries that they generate is less important. I think about location in the same way. Salaries will be naturally higher in NY, SF, LA, etc and lower to much lower elsewhere. The key question is, do students at a particular school avoid NY and SF (the two biggest destinations for MBAs if I recall) because they choose to, or because they simply aren't competitive.
3. Rankings need to stop trying to rank student quality and faculty quality. I like to look at the average GPA and GMAT as much as the next person, but some rankings are just silly in the ways that they try to quantify student and faculty quality. As far as I'm concerned, the only real way to judge faculty is to sit down in their classes and see if they deliver. Forget publication volume and stuff like that. Even prior education doesn't really matter. For a student, it's all about how good the professor is in the classroom, and how available they are outside of class. As far a student quality, I think GPA is only useful in relation to the prior school. Taking GPA separately from prior academic institution makes no sense to me. I think a B average from Princeton is as impressive or more so than a #1 ranking at a small, non-competitive school. Simply put, the person at Princeton already beat out pretty much everyone else in the country (more or less) to get in. So, some b-schools pile up students from blue chip schools. That's impressive. Certainly, not all people get a chance to go to such schools, so a very high GPA from another competitive school is impressive as well, but you can't just look at GPA separately from where it was earned. It just makes no sense.
I guess when it comes down to it, I just like to ask the question, would the average person really attend School A (ranked higher) over School B. If that's more or less true for the schools I am familiar with, the ranking has some value to me. If not, it goes out with the rest of the garbage.