How to calculate a universitie's "Peer Assessment" score

<p>

</p>

<p>That would be a logical conclusion, but Cal, UMich, and UWisc, to name those earlier in this thread, have plenty of sub-600 scorers and that doesn’t seem to dampen the interests of bright young profs from accepting positions at those state Unis. Heck, Glenn Seaborg (he of the Periodic Table) used to relish in teaching the sub-600 kids. :)</p>

<p>btw: don’t forget, that SAT scores are also heavily influenced by native language, as well as parental education.</p>

<p>It would be really intersting to see how identical twins separated at birth and raised in very different families score on their PSATs, then SATs. I agree that the CR part of the SAT is much easier for students who have learned english syntax and vocabulary from native english speaking, college graduate parents. Exactly how much would be interesting to know with a split twin study.</p>

<p>Hey Collegehelp,</p>

<p>First, very interesting model.</p>

<p>Now – my primary problem with USNWR is that I don’t agree with the weights of various aspects. Can you re-calculate ranks, based on my preferences? I would myself, but you clearly have the data in a statistics/ spreadsheet program already, so it should be fairly easy for you to recalculate (you also seem more proficient than I). These are my suggested weights – using data US News gives
25% Student Selectivity
25% Peer Assessment Score
20% Faculty Resources
20% NRC Mean for Physics, English, and Psychology
10% Financial Resources</p>

<p>(So you would just weight and add, and order them)</p>

<p>If that isn’t possible (b/c they rely on ranks):
25% Peer Assessment Score
20% NRC Mean for Physics, English, and Psychology
10% High school class standing—top 10%
9% Financial Resources
8% Acceptance Rate
8% Student/faculty ratio
7.5% SAT 75th percentile
7.5% SAT 25th percentile
5% Class size, 1-19 students
(I actually prefer the second one, but it is likely more work for you.)</p>

<p>I would really, really appreciate it if you could do that :slight_smile: THANKS!</p>

<p>To others – yes, my weights are hardly correct either. They are just my personal preferences. Feel free to suggest better ones.</p>

<p>with luck…</p>

<p>bump</p>

<p>please</p>

<p>reply to brownflavors</p>

<p>ranking based on following weights:
25% Student Selectivity
25% Peer Assessment Score
20% Faculty Resources
20% NRC Mean for Physics, English, and Psychology
10% Financial Resources</p>

<p>I first standardized the scores so they were all on the same scale. That is, for example, SAT scores and NRC rankings were both placed on a scale that basically ranged from -3 to +3. Then I applied the weights.</p>

<p>1 Massachusetts Institute of Tec 106.924
2 Harvard University (MA) 101.670
3 Yale University (CT) 93.941
4 Stanford University (CA) 93.363
5 Princeton University (NJ) 92.413
6 Cal Institute of Technology 80.834
7 Cal Berkeley 79.979
8 Columbia University (NY) 71.055
9 U Chicago (IL) 67.569
10 Cornell University (NY) 66.336
11 U Pennsylvania 62.049
12 Michigan—Ann Arbor 61.968
13 Texas Austin 58.623
14 Brown University (RI) 56.961
15 Johns Hopkins University (MD) 53.940
16 Duke University (NC) 52.435
17 Maryland College Park 48.207
18 Virginia 45.952
19 Cal Los Angeles 40.196
20 Illinois Urbana - Champaign 36.861
21 Carnegie Mellon University (PA 35.483
22 Northwestern University (IL) 34.895
23 Indiana University Bloomington 34.772
24 Wisconsin Madison 33.672
25 Pennsylvania State University 32.495
26 Cal San Diego 26.321
27 Southern Cal 25.848
28 North Carolina Chapel Hill 25.688
29 Washington 25.491
30 Dartmouth College (NH) 23.871
31 Washington University in St. L 23.745
32 Rice University (TX) 23.636
33 SUNY Binghamton 22.348
34 Texas A&M University College S 22.278
35 Florida 20.620
36 Michigan State University 20.568
37 Minnesota Twin Cities 19.199
38 Virginia Tech 18.685
39 Emory University (GA) 15.771
40 Ohio State University Columbus 14.957
41 Marquette University (WI) 13.925
42 Miami University Oxford (OH) 13.633
43 College of William and Mary (V 11.724
44 Vanderbilt University (TN) 11.627
45 Georgetown University (DC) 10.989
46 Notre Dame (IN) 9.988
47 Georgia Institute of Technolog 9.218
48 New York University 6.977
49 Oregon 5.116
50 Rensselaer Polytechnic Institu 2.314</p>

<p>By the way, I did a little more work on my peer assessment formula and was able to increase the R-square to .973 and the Multiple R to .986. So, the US News Peer Assessment scores are valid.</p>

<p>

</p>

<p>Since there are a number of peer groups, the validity of peer assessment for the most widely known schools may not carry over to other peer groups, such as LACs, or the regionals. Each peer group needs to be validated. This is especially true of the national LACs where a number of schools have been moved from regional lists into the national LACs in the past two years. URichmond is one such school. Is their PA affected by bias or ignorance when being evaluated by a new group of peers? If so, how long does it take for the peer group to get it right?</p>

<p>Thanks!!! That was very helpful.</p>

<p>Dartmouth College should really be treated as a LAC.</p>

<p>I’m enjoying how Wash U. precipitously falls under brownflavors’ preferred rating scheme. This is great work.</p>

<p>

Interesting that no matter how you shake the rankings up, HYPSM is on top…</p>

<p>What if we assign 50% PA and 50% NRC? ;)</p>

<p>weighted 50% Peer Assessment and 50% NRC average</p>

<p>1 Massachusetts Institute of Tec 4.04456
2 Harvard University (MA) 3.86365
3 Stanford University (CA) 3.78384
4 Cal—Berkeley 3.62630
5 Yale University (CT) 3.51057
6 Princeton University (NJ) 3.46908
7 Cornell University (NY) 3.07873
8 U Chicago (IL) 2.95378
9 Columbia University (NY) 2.84594
10 U Pennsylvania 2.75724
11 Cal Institute of Technology 2.67969
12 Michigan—Ann Arbor 2.61801
13 Johns Hopkins University (MD) 2.37644
14 Cal—Los Angeles 2.27288
15 Duke University (NC) 2.05166
16 Virginia 2.01227
17 Brown University (RI) 1.93089
18 Illinois—Urbana - Champaign 1.83233
19 Texas—Austin 1.71158
20 Northwestern University (IL) 1.54695
21 Wisconsin—Madison 1.53498
22 Carnegie Mellon University (PA 1.47934
23 Washington 1.40403
24 North Carolina—Chapel Hill 1.34460
25 Cal—San Diego 1.13636
26 Southern Cal 0.95990
27 Minnesota—Twin Cities 0.92394
28 Emory University (GA) 0.88391
29 Vanderbilt University (TN) 0.80313
30 Indiana University—Bloomington 0.78929
31 New York University 0.74266
32 Ohio State University—Columbus 0.72336
33 Washington University in St. L 0.70375
34 Cal—Irvine 0.64467
35 Rice University (TX) 0.53528
36 Purdue University—West Lafayet 0.52751
37 Pennsylvania State University— 0.49363
38 Rutgers- the State New Jersey 0.43580
39 Dartmouth College (NH) 0.38697
40 Cal—Santa Barbara 0.36302
41 Maryland—College Park 0.34169
42 Cal—Davis 0.26177
43 Florida 0.23876
44 Georgia Institute of Technolog 0.17498
45 Colorado—Boulder 0.11672
46 Notre Dame (IN) 0.08244
47 Iowa 0.00820
48 Rochester (NY) 0.00724
49 Arizona -0.00570
50 Rensselaer Polytechnic Institu -0.01636</p>

<p>Hard to believe Michigan isn’t higher under those assumptions.</p>

<p>I analyzed the US News data for 124 National Liberal Arts Colleges. Their Peer Assessment scores can be predicted quite well by a combination of:
student faculty ratio
SAT 25th percentile
acceptance rate
financial resources rank
percent of classes under 20
percent of full time faculty
alumni giving rate</p>

<p>The r-squared was .84. The Multiple R was .92.</p>

<p>Peer Assessment scores for the Liberal Arts Colleges can be predicted very accurately by quantitative data but not as accurately as National Universities.</p>

<p>Hey, how would these made-up rankings look if you substitute biology for physics ?</p>

<p>Betcha that Washu looks a lot better and Dartmouth still falls precipitously.</p>

<p>For liberal arts colleges, peer assessment scores calculated from quantitative data are generally quite close to the actual US News Peer Assessment ratings:</p>

<p>predicted rank, school, predicted peer assessment score, actual peer assessment rating</p>

<p>1 Amherst College 4.57 4.7
2 Carleton College 4.47 4.4
3 Williams College 4.46 4.7
4 Harvey Mudd 4.41 4.1
5 Pomona College 4.37 4.2
6 Bowdoin College 4.28 4.3
7 Swarthmo College 4.27 4.6
8 Middlebu College 4.26 4.2
9 Wesleyan Universi 4.25 4.2
10 Washingt Lee 4.20 3.9
11 Vassar College 4.15 4.1
12 Wellesle College 4.15 4.5
13 Haverfor College 4.13 4.1
14 US Naval 4.09 4.0
15 Davidson College 4.03 4.2
16 Colgate Universi 4.00 4.0
17 Claremon McKenna 4.00 4.0
18 Bates College 4.00 4.0
19 Grinnell College 3.96 4.3
20 Colby College 3.96 4.0
21 Oberlin College 3.90 4.2
22 Bryn Mawr 3.84 4.1
23 Hamilton College 3.83 3.7
24 Colorado College 3.80 3.8
25 Holy Cross 3.80 3.6
26 Kenyon College 3.79 3.8
27 Bucknell Universi 3.78 3.8
28 Trinity College 3.75 3.6
29 Barnard College 3.74 3.9
30 Mount Holyoke 3.73 4.0
31 Franklin Marshall 3.72 3.5
32 Macalest College 3.71 4.1
33 Lafayett College 3.71 3.4
34 Scripps College 3.70 3.7
35 Connecti College 3.70 3.5
36 Bard College 3.68 3.4
37 Denison Universi 3.68 3.4
38 Universi Richmond 3.66 3.6
39 Centre College 3.62 3.4
40 Occident College 3.61 3.7
41 US Military 3.61 4.0
42 Smith College 3.60 4.3
43 Furman Universi 3.56 3.5
44 Skidmore College 3.55 3.4
45 Lawrence Universi 3.51 3.3
46 Gettysbu College 3.48 3.3
47 Whitman College 3.46 3.3
48 Dickinso College 3.46 3.4
49 Pitzer College 3.44 3.5
50 New College 3.44 2.8
51 Reed College 3.43 3.9
52 Union College 3.42 3.3
53 Wheaton College 3.40 3.2
54 Wabash College 3.39 3.3
55 Wheaton College 3.36 3.3
56 Agnes Scott 3.34 3.3
57 Rhodes College 3.30 3.5
58 DePauw Universi 3.30 3.4
59 Sewanee Univ 3.29 3.6
60 St. Lawrence 3.28 3.2
61 Kalamazo College 3.28 3.2
62 Illinois Wesleyan 3.25 3.1
63 Wofford College 3.24 2.9
64 Hobart College 3.17 3.2
65 Berea College 3.16 3.3
66 Puget Sound 3.15 3.1
67 Lyon College 3.12 2.6
68 Lewis Clark 3.10 3.2
69 Earlham College 3.09 3.5
70 Muhlenbe College 3.08 2.8
71 Spelman College 3.08 3.4
72 St. Olaf 3.08 3.6
73 Hampden- College 3.07 2.8
74 Southwes Universi 3.04 3.1
75 Hampshir College 3.02 2.8
76 Cornell College 3.02 2.9
77 Hendrix College 3.02 3.2
78 Westmont College 3.01 2.4
79 Drew Universi 3.00 3.2
80 Ohio Wesleyan 2.99 3.0
81 Willamet Universi 2.99 3.1
82 St.Mary’ College 2.98 2.6
83 St. John’s 2.98 3.1
84 Birmingh Southern 2.98 3.0
85 Beloit College 2.96 3.2
86 Ursinus College 2.96 2.9
87 Alleghen College 2.95 3.0
88 Hillsdal College 2.94 2.3
89 Benningt College 2.93 2.9
90 Austin College 2.93 3.0
91 College Wooster 2.92 3.3
92 Juniata College 2.91 2.7
93 Knox College 2.91 3.0
94 St.Mary’ Coll 2.91 2.8
95 Wash Jeff 2.90 2.8
96 Millsaps College 2.90 2.9
97 Stonehil College 2.87 2.7
98 Transylv Universi 2.87 2.8
99 Virginia Military 2.86 3.0
100 Berry College 2.85 2.8
101 Randolph College 2.83 2.7
102 Hanover College 2.83 2.7
103 Lake Forest 2.83 2.9
104 Calvin College 2.82 2.9
105 Wells College 2.81 2.6
106 Albion College 2.76 2.8
107 Wittenbe Univ 2.76 2.8
108 College St.Bened 2.76 2.7
109 Augustan College 2.76 2.8
110 StMichae Coll 2.74 2.6</p>

<p>collegehelp,</p>

<p>Can you post the weights for the LAC’s?</p>

<p>for national liberal arts colleges</p>

<p>predicted peer assessment score =
2.35271 intercept
+(-.06529 X student faculty ratio numerator) e.g. 11/1 = 11
+(.00183 X SAT 25th percentile)
+(-.00706 X acceptance rate)
+(-.00283 X financial resources rank)
+(-.000000968038 X percent of classes under 20 cubed)
+(.000000475884 X percent of full time faculty cubed)
+(.00000150 X alumni giving rate cubed)</p>

<p>test this on one of the schools I listed above to see if I copied the formula correctly</p>

<p>college help is Washington on your list above the U of Washington?</p>

<p>There is a Washington and Lee and a Washington and Jefferson. Both are in the list.</p>

<p>is university of washington on your university list?</p>