U.S News & World Report Professional Ratings Explained
The United States News and World Report, which is more commonly known as USNWR is a trusted and well-respected resource that provides everything from attorney and doctor rankings to college rankings. Since the late 1980s, there have been all types of ranking lists released by the media outlet.
There seems to be virtually no way to determine just how persuasive these rankings are. No results are found when the quotations below are searched on Google.
- “United States News and World report ranking impact.”
- “United States news and world report impact.”
- “Who reads United States news and world report.”
- “United States News ranking impact.”
If you fail to use quotations in the search, it will only result in USNWR news that relates to colleges that have lost or jumped rankings in USNWR in recent times. This by itself is an indication of the amount of influence this business has. When the rankings impact of USNWR is researched, a specific venture of ranking becomes the focus.
The USNWR college rankings impact that is most commonly researched pertains to those that are trying to locate potential colleges. The criterion in recent years that is used by USNWR to decide its rankings is being questioned. While USNWR states objective data is used to obtain their rankings, it seems that flawed and subjective data is the basis for rankings.
The college rankings of USNWR seem to be the publications that are investigated most often. For example, from an ethical standpoint, it will supply a way to comprehend the operation of the company. In 2008 a Journal was released by the American Board Association Journal which reveals flaws in some of the USNWR criteria used to determine ranks of colleges. As an example, misrepresented by the USNWR and law schools was the criterion selectivity.
The results that are obtained by law schools when students’ potential is reviewed is what selectivity is based on. Undergraduate GPAs, students’ median LSAT scores, and the acceptance rate of law schools is the basis for 20% of USNWR ranking. The Association of American Law Schools found that many law schools were advising students to put their application in at their schools, even though their chance of being accepted was non-existent.
This process was instigated by law schools to bump up their acceptance rates, which would, in turn, bump up their rank in USNWR as well. This seems to be another hint of the influence USNWR holds on people. In addition to this, though the GPA of undergraduates appears to be objective, they are subjective.
When it comes to the difficulty level, grading scale, and required materials, there is a difference in all the undergraduate courses that are taught. The difficulty level and the classes are different, even though it may be a requirement for course criteria of the same subject material. While it is not considered as part of the ranking process of USNWR, the student’s GPA is the obvious effect.
So, the question arises, when it comes to ranking lawyers, what is the part of USNWR. In September of 2010, a joint venture of USNWR and Best Attorneys for the ranking of “Best Law Firms” was presented to the media. The most respected and oldest publication of legal profession peer-reviews is Best Lawyers, as alleged on their website.
It is claimed that it’s considered to be a huge honor by legal professionals and clients alike when an attorney is listed on Best Lawyers and discussed by their peers. Best Lawyers would like to make some factors clear to attorneys that plan to inform clients of their listing on the Best Lawyers’ site, even with the status it may carry to be listed on the site.
- While it is fine for attorneys to include in ads that they are listed in ‘The Best Lawyers in America,’ ‘Best Lawyers,’ or in ‘The Best Lawyers in Canada,’ they are not permitted to actually claim they are ‘best lawyers,’ or to make suggestions that listings can guarantee clients the results they desire, or the listing deems them more experienced than attorneys that do not have listings in the publication.
Just like USNWR, a similar process is used for businesses to rank attorneys on Best Lawyers. The rankings methodology behind the joint venture, according to the website of USNWRs Best Law Firms, involved surveying clients of numerous law firms, marketing, associates, and recruiting officers, and the managers and attorneys of leading law firms. Each of them was asked about the elements they deemed vital for clients looking to hire attorney firms, attorneys looking for employment, and attorneys selecting an appropriate firm to refer work to.
According to USNWR, questions on the survey were mainly related to reputation information. Then, six different studies were formed and sent to test subjects of the law industry. However, the answer to a relevant and fundamental question was not released, which was ‘how were these test subjects selected.’
Below are the six different surveys conducted, along with who were sent the surveys, and related questions the USNWR website left unanswered under the ‘methodology’ section.
- 52,480 clients received client surveys.
- What was the process these clients were selected?
- Were any selected clients practicing law?
- Forty-three thousand nine hundred attorneys received attorney surveys, which included all the lawyers listed in Best Lawyers located in the United States.
- What was the process of selecting attorneys not listed on the site Best Lawyers?
- The report was released from Best Lawyers along with USNWR. When a survey is sent to each attorney listed on the site, who benefit from being placed on the Best Lawyers site, how does this not pose a conflict of interest?
- Two thousand three hundred fourteen marketing officers and 2,322 recruiting officers received a survey.
- How is the way an attorney is ranked related to recruiting and marketing officers?
- Law firms hire each of these officers. Again, how does this not pose a conflict of interest?
- The specific group other surveys were sent was specified. What is the reason each of these surveys is not categorized?
- Eight thousand five hundred ninety-seven firms that had no contact with recruiting or marketing offices received surveys.
- What was the process in which these firms were selected?
- What is the reason these surveys were not categorized?
- One thousand seven hundred seventy-five summer associates and 2,322 firm associates received surveys.
- Again, how does this not pose a contact of interest? Associates have a direct benefit, both regarding the success of their careers and financially from being employed by a firm that is thought to be great, and seemingly, they hold the responsibility of deciding which attorney firms are considered to be great.
It is obvious that just five survey types have been posted on their site. It brings to question if there was a 6th survey. If so, what kind was it, who received it, and what information did it hold?
The process for deciding the rank of law firms’ was:
- Ask “prominent” (whoever this might suggest) citizens located in the law community what they believe the criteria of a good lawyer should be.
- Based on the responses received, generate and send surveys that are specific to certain groups in the law community. The determination of these particular groups is not stated. Also not reported is the fact that there is an apparent conflict of interest with most of the people surveyed. There is also no suggestion to show the very same groups and individuals that decided the criteria did not then receive the actual survey they had a part in making.
- Use a combination of the following to rank attorneys:
a. Data from surveys that are completed.
b. Information Best Lawyers provided
iii. As stated by USNWR website Best Law Firms, on top of data gathered from the studies, the rankings include evaluations from 39,372 well-known attorneys which added up to 3.1 million and Best Lawyers collected the information from their latest yearly survey.
Subjective and quantitative factors are the basis for USNWRs rankings. While their information is misrepresented as objective, personal information is not the issue. It appears that ranking an attorney without taking citizens law-related experiences into account is impossible.
For example, a factor some people consider might be ethics, when they are deciding if an attorney is likable and competent. Ethics cannot be objectively scaled, just because it is subjective. In regards to the method USNWR articulates its rankings, it is clear that subjectivity is not what’s disputable.
What is disputable? USNWR decides the process rankings.
- What is the process used by USNWR to decide who will receive a preliminary and secondary survey?
- What makes the opinion of these people more relevant than the people not surveyed?
- Why are people with a clear invested interest in portraying their firm to appear right, and possibly even better than they are the ones receiving a survey?
- When one of two parties that are distributing the rankings uses information obtained as data when it was received and understood in the precise flawed method used in spreading the USNWR rankings, how does it not pose a conflict of interest?