USA Today and NSSE: project to release benchmark data

<p>The NSSE-USA Today Initiative promises another way for parents and students to navigate that often rocky road to greater transparency and accountability in higher education:</p>

<p>

</p>

<p>Here is a link to the FAQ page of the NSSE-USA initiative:</p>

<p><a href=“http://nsse.iub.edu/html/USAT_initiative.cfm#anchor_4[/url]”>http://nsse.iub.edu/html/USAT_initiative.cfm#anchor_4&lt;/a&gt;&lt;/p&gt;

<p>It’s hard to argue with making more information available, and NSSE has a lot going for it, but I wonder about the dangers of a list that boils down the results of a large, wide-ranging survey into just a few scores. These benchmark scores, as I understand them, lump together results from only some of the NSSE questions into 5 categories:</p>

<pre><code>* Level of Academic Challenge

  • Active and Collaborative Learning
  • Student-Faculty Interactions
  • Enriching Educational Experiences
  • Supportive Environment
    </code></pre>

<p>Laudably, the USA Today list would make very clear that this is not a ranking system. (Of course someone will post the results sorted high-to-low by benchmark scores on CC within 45 minutes USA Today’s publishing the data :wink: )</p>

<p>U. S. News has already made available fuller NSSE data for a number of colleges who have released it. If a school in which you are interested is available, I would recommend having a look at these, which give the full results for many of the survey questions. It can be really illuminating; one school, for example, fell in D’s list because the NSSE showed that students there spent the least times doing academic work per week, and hardly had to write any papers, despite the fact that it ranked fairly high in the USNews rankings. </p>

<p><a href=“http://www.usnews.com/usnews/edu/college/rankings/ranknsse.php[/url]”>http://www.usnews.com/usnews/edu/college/rankings/ranknsse.php&lt;/a&gt;&lt;/p&gt;

<p>Now schools will start “gaming” the NSSE telling students how important a good rating is to the school’s future and the value of their degree.</p>

<p>Seems like a good partnership to me despite the potential pitfall that colleges will use USA Today as a vehicle to boost interest, drum up a larger application pool, or feature NSSE data on their website to garner publicity - that, after all, is built into the whole admissions game cycle- colleges need to get the word out and in as neat, quick, and easily digested format as possible in order reach as many up and coming prospective parents and students (consumers) as they can - keeping in mind that just as there are savvy players out there, many are new to this game. Up until now, I find the USA Today education section has put out some fine pieces - the “Cracking the Code of College Admissions” series is a fine example. I would hope USA Today would be able to produce more of this type of article and other accurate and informative feature articles on specific colleges - that said, in the effort toward greater accountability and transparency, parents and students need to know that if a feature article does appear in USA Today in this context it is precisely because that college has agreed to participate in this partnership and has released its data to the USA Today-NSSE joint venture.</p>

<p><a href=“http://www.usatoday.com/news/education/2006-11-08-college-acceptance-usat_x.htm[/url]”>http://www.usatoday.com/news/education/2006-11-08-college-acceptance-usat_x.htm&lt;/a&gt;&lt;/p&gt;

<p>asteriskea,
Many thanks for your continued attention to this topic and the links that you have provided. Very helpful and informative as this student survey gets broader distribution and play among the nation’s media. Student voices have been neglected for too long and can often give useful insights on the quality of the experience that undergraduates will experience when they get to colleges. This information is highly useful and relevant for college-seeking high school students.</p>

<p>Remember when looking for NSSE results that it’s unusual for schools to participate every year. NSSE itself recommends a 3-year cycle to its participants. Therefore, if you follow MarathonMan’s link and are looking for a particular institution, you may have look through multiple years before finding an institution’s data.</p>

<p>Updates on the NSSE-USA Today project:</p>

<p>“Searching for Signs of Engagement: How to make NSSE scores work for you”</p>

<p>[How</a> to make NSSE scores work for you - USATODAY.com](<a href=“http://www.usatoday.com/news/education/2007-11-04-nsse-how-to_N.htm]How”>http://www.usatoday.com/news/education/2007-11-04-nsse-how-to_N.htm)</p>

<p>[How</a> to make NSSE scores work for you - USATODAY.com](<a href=“http://www.usatoday.com/news/education/2007-11-04-nsse-how-to_N.htm]How”>http://www.usatoday.com/news/education/2007-11-04-nsse-how-to_N.htm)</p>

<p>and</p>

<p>“A Small Step Toward Transparency”</p>

<p>

</p>

<p>[Jobs</a>, News and Views for All of Higher Education - Inside Higher Ed :: A Small Step Toward Transparency](<a href=“http://www.insidehighered.com/news/2007/11/07/nsse]Jobs”>http://www.insidehighered.com/news/2007/11/07/nsse)</p>

<p>“Resources for the college search”</p>

<p>[Resources</a> for the college search - USATODAY.com](<a href=“http://www.usatoday.com/news/education/college-resources.htm]Resources”>http://www.usatoday.com/news/education/college-resources.htm)</p>

<p>The article “Risky Business:Promises and Pitfalls of Institutional Transparency” by George Kuh, that appeared in Change Magazine, is well worth the read for those interested in the thorny issues related to the use of common templates to create readily accessible, “consumer friendly” data bases in the public interest and transparency:</p>

<p>

</p>

<p><a href=“http://nsse.iub.edu/pdf/Kuh%20Risky%20Business%20Change%202007.pdf[/url]”>http://nsse.iub.edu/pdf/Kuh%20Risky%20Business%20Change%202007.pdf&lt;/a&gt;&lt;/p&gt;

<p>This quote from the Kuh article that asteriskea quoted above says it all:</p>

<p>

</p>

<p>When you collapse all the NSSE questions down into 5 benchmark categories, it flattens out any meaningful distinctions, making it hard to draw any conclusions except in the very rare cases where a college is a real outlier. Almost all institutions are within a couple of percentage points of the average for their institution type on all of the measures, and the scores for schools that you’d consider peer institutions cluster even more tightly. </p>

<p>To their credit, the USA Today article is careful to warn that the differences of a couple of points are not meaningful, and suggests a 5-point difference as a good indicator of real disparity. (If only USNews were as honest about the limits of its methodology :wink: ) It’s hard to find that sort of difference between two colleges that you’d think of in the same sentence.</p>

<p>I can’t get the search feature to work on this site – the link to the searchable database appears to be broken – anyone else have problems?</p>

<p>A short followup to this older thread: it looks like the US News site has been updated recently with collated data from 2007 NSSE reports (data from 2006). These reports are the source for the USA today benchmark figures (see the link in in post #7). Few selective colleges release NSSE figures, but this year’s reports include Emory, Middlebury, and Harvey Mudd, among others. </p>

<p>[USNews.com:</a> America’s Best Colleges 2008: National Survey of Student Engagement](<a href=“http://www.usnews.com/usnews/edu/college/rankings/ranknsse.php]USNews.com:”>http://www.usnews.com/usnews/edu/college/rankings/ranknsse.php)</p>

<p>A must-read if any schools of interest appear on this year’s list.</p>

<p>These survey results of student engagement are at best suggestive, but not measures of anything. They have the usual problem of all voluntary response surveys: it’s not valid to say that they necessarily reflect reality. </p>

<p>One professor of statistics, who is a co-author of a highly regarded AP statistics textbook, has tried to popularize the phrase that “voluntary response data are worthless” to go along with the phrase “correlation does not imply causation.” Other statistics teachers are gradually picking up this phrase.</p>

<p>

</p>

<p>[Math</a> Forum Discussions](<a href=“Classroom Resources - National Council of Teachers of Mathematics”>Classroom Resources - National Council of Teachers of Mathematics)</p>