College Confidential
» CC HOME » FORUM HOME

  College Confidential > Professional & Graduate School > Graduate School
New User

Welcome to College Confidential!
The leading college-bound community on the web
Join for FREE now, and start talking with other members, weighing in on community polls, and more.

Also, by registering and logging in you'll see fewer ads and pesky welcome messages (like this one)!
Discussion Menu
»Discussion Home
»Help & Rules
»Latest Posts
»NEW! CampusVibe™
»Stats Profiles
Top Forums
»College Chances
»College Search
»College Admissions
»Financial Aid
»SAT/ACT
»Parents
»Colleges
»Ivy League
Main CC Site
»College Confidential
»College Search
»College Admissions
»Paying for College
Sponsors
SuperMatch - The Future of College Search!
CampusVibe - Almost As Good As A Campus Visit!
Reply
 
Thread Tools
Old 06-05-2011, 04:01 AM   #1
Senior Member
 
Join Date: Aug 2004
Posts: 14,488
"The amount of redundant, inconsequential, and outright poor research has swelled..."

"...While brilliant and progressive research continues apace here and there, the amount of redundant, inconsequential, and outright poor research has swelled in recent decades, filling countless pages in journals and monographs. Consider this tally from Science two decades ago: Only 45 percent of the articles published in the 4,500 top scientific journals were cited within the first five years after publication. In recent years, the figure seems to have dropped further. In a 2009 article in Online Information Review, Péter Jacsó found that 40.6 percent of the articles published in the top science and social-science journals (the figures do not include the humanities) were cited in the period 2002 to 2006.

As a result, instead of contributing to knowledge in various disciplines, the increasing number of low-cited publications only adds to the bulk of words and numbers to be reviewed. Even if read, many articles that are not cited by anyone would seem to contain little useful information. The avalanche of ignored research has a profoundly damaging effect on the enterprise as a whole. Not only does the uncited work itself require years of field and library or laboratory research. It also requires colleagues to read it and provide feedback, as well as reviewers to evaluate it formally for publication. Then, once it is published, it joins the multitudes of other, related publications that researchers must read and evaluate for relevance to their own work. Reviewer time and energy requirements multiply by the year. The impact strikes at the heart of academe.

...The amount of material one must read to conduct a reasonable review of a topic keeps growing. Younger scholars can't ignore any of it—they never know when a reviewer or an interviewer might have written something disregarded—and so they waste precious months reviewing a pool of articles that may lead nowhere.

Experts asked to evaluate manuscripts, results, and promotion files give them less-careful scrutiny or pass the burden along to other, less-competent peers. We all know busy professors who ask Ph.D. students to do their reviewing for them. Questionable work finds its way more easily through the review process and enters into the domain of knowledge. Because of the accelerated pace, the impression spreads that anything more than a few years old is obsolete. Older literature isn't properly appreciated, or is needlessly rehashed in a newer, publishable version. Aspiring researchers are turned into publish-or-perish entrepreneurs, often becoming more or less cynical about the higher ideals of the pursuit of knowledge. They fashion pathways to speedier publication, cutting corners on methodology and turning to politicking and fawning strategies for acceptance.

...Only if the system of rewards is changed will the avalanche stop. We need policy makers and grant makers to focus not on money for current levels of publication, but rather on finding ways to increase high-quality work and curtail publication of low-quality work. If only some forward-looking university administrators initiated changes in hiring and promotion criteria and ordered their libraries to stop paying for low-cited journals, they would perform a national service. We need to get rid of administrators who reward faculty members on printed pages and downloads alone, deans and provosts "who can't read but can count," as the saying goes. Most of all, we need to understand that there is such a thing as overpublication, and that pushing thousands of researchers to issue mediocre, forgettable arguments and findings is a terrible misuse of human, as well as fiscal, capital.

..but what we surely need is a change in the academic culture that has given rise to the oversupply of journals. For the fact is that one article with a high citation rating should count more than 10 articles with negligible ratings. Moving to the model that Nature and Science use would have far-reaching and enormously beneficial effects..."

We Must Stop the Avalanche of Low-Quality Research - Commentary - The Chronicle of Higher Education
sakky is offline   Reply   
Old 06-06-2011, 12:06 PM   #2
Senior Member
 
Join Date: Jan 2008
Location: California
Posts: 5,346
Pretty much what I hear most of us saying daily in the lab. The majority of papers in my field are total junk. I've read a ton of papers whose work likely didn't take more than an afternoon to perform, since instead of doing the research the proper way, the groups will instead find a "quick and dirty" solution so they can simply be the first to publish.

I'll also be quite willing to say there's a disproportionate number of these papers coming from China. Heck, I remember seeing a series of papers where they quite literally cut and pasted whole sections of their paper from one to the next. They were performing the same experiment on slightly different systems every year. It was, generally, one or two experiments which would only take a day at most. It almost felt like one person did all the measurements in a month and then decided to slowly let them trickle out over the next few years.
RacinReaver is offline   Reply   
Old 06-06-2011, 01:34 PM   #3
Junior Member
 
Join Date: Sep 2009
Posts: 110
I didn't read in depth, but did they really look at the top 4,500 journals? If so, I'm actually surprised that >40% of all articles are cited within five years. For me, there are around 10-15 journals that I check every issue, ranging from cognitive psychology to cellular neuroscience. I sporadically search for specific topics or authors and so occasionally read other journals, too. That still leaves out a ton of neuroscience-related, lower impact, less interesting journals that I literally have never looked at. I'd be more interested if they looked at the top X impact factor journals and see how the citations break down; even though impact factor isn't perfect, it should help capture the fact that tiny, obscure journals obviously aren't going to get articles cited very frequently.

Also, I have consistently heard that frequent publications in no-name journals is a detriment for hiring and promotion decisions, not a benefit. Again, in neuroscience, if you can't get a single article in Journal of Neuroscience or Journal of Neurophysiology (good but not spectacular journals, impact factors of 8 and 4 or thereabouts), but have a ton of publications in journals no one has ever heard of, people will seriously question the quality of your work. You will not get hired or promoted. That's not to say smaller specialty journals are terrible, but the idea is that consistently producing quality work should land you some publications in larger journals, even if your work is on a relatively niche interest. Maybe other fields don't see this is as much, but over-publication of under-quality articles is certainly not a positive in my experience.
NeuroGrad is offline   Reply   
Old 06-06-2011, 03:58 PM   #4
Senior Member
 
Join Date: Aug 2006
Location: Silicon Valley
Posts: 8,730
Quote:
I didn't read in depth, but did they really look at the top 4,500 journals? If so, I'm actually surprised that >40% of all articles are cited within five years.
Authors citing their own work?
b@r!um is offline   Reply   
Old 06-06-2011, 04:47 PM   #5
Junior Member
 
Join Date: Sep 2009
Posts: 110
I suppose so. I guess I was more surprised because to me, 4,500 journals seems like they're really scraping the bottle of the barrel and looking at journals that no one ever reads. Maybe that isn't the case, I'm not sure. Self-citation is a good way to get some of those kinds of papers cited, I guess!
NeuroGrad is offline   Reply   
Old 06-06-2011, 09:44 PM   #6
Senior Member
 
Join Date: Oct 2004
Posts: 7,189
Thank you for posting that, Sakky.
TheDad is offline   Reply   
Old 06-06-2011, 11:19 PM   #7
Member
 
Join Date: Mar 2008
Posts: 722
Interesting article.
chaospaladin is offline   Reply   
Old 06-07-2011, 12:43 AM   #8
Senior Member
 
Join Date: Feb 2008
Location: Atlanta, GA
Posts: 1,771
That's truly remarkable that an article can go five years without being cited. I have cited in the past articles just to refute points in them
gthopeful is offline   Reply   
Old 10-07-2012, 10:27 AM   #9
Junior Member
 
Join Date: Feb 2012
Posts: 207
Why aren't more people from the general public more interested in read such scholarship?

I find them to be highbrow and challenging reads.
ThereseR is online now   Reply   
Old 10-07-2012, 11:52 AM   #10
Member
 
Join Date: Apr 2012
Posts: 542
Therese, you clearly didn't read the article, and you already have a thread on this topic. Don't revive year-old threads.
TitoMorito is offline   Reply   
Reply

Bookmarks

Thread Tools



All times are GMT -4. The time now is 11:43 AM.




Copyright 2001-2011, Hobsons, Inc., All Rights Reserved