So as soon as CDS data from the test optional era started coming out, people started speculatingâwith good reasonâthat at least at the more selective colleges, submitting test scores seemed to be helping at least in some cases.
As an aside, I do think that is the better way to put it. When you are talking about a college with a 25%, 10%, 5%, or whatever acceptance rate, the presumptive answer is ânoâ. So if in some cases, submitting a high test score could get the applicant from ânoâ to âyesâ, then that is not so much âpenalizingâ applicants without high test scores as just a high test score helping in such cases.
And this is not just a technical observation. My understanding is if you were looking instead at, say, a college with a 75% acceptance rate, there was likely to be much less evidence of a big gap between test optional and submitting. Meaning going test optional was rarely turning a presumptive âyesâ into a ânoâ, which I think is what it would take to really call it a âpenaltyâ.
Anyway, the problem with this level of analysis is CDS data is simply not cross-tabbed in ways we would need to really understand what was happening. And to my knowledge, the best single source we have gotten to date on this issue is the Dartmouth white paper explaining why they went back to test required:
It is pretty interesting overall, but I think Figure 6 (on Page 14) is really the most useful single thing I have yet seen on this subject:
And basically, what it is showing is that for more advantaged students, submitting tests made very little difference in outcomes at Dartmouth. Higher, lower, no real significant gaps in outcomes.
This may be surprising at first, but it confirms a theory people have long had (and was expressed above), namely that more advantaged applicants typically have a bunch of other ways of showing their academic qualifications to colleges like Dartmouth. This can be a lot of things, but perhaps the simplest example is just going to a highly-resourced, competitive, college-prep high school which Dartmouth and the like are very familiar with, such that they feel like they can trust the transcripts, the grades, the recommenders, and so on to tell them which applicants are truly the sorts of top performing, highly prepared students they are looking for.
So on the one hand, if you were an advantaged applicant and had that other stuff, Dartmouth and the like may not have particularly cared about you being test optional. And on the other, if you were an advantaged applicant and DIDNâT have that other stuff, Dartmouth might not particular care if you submitted a high test score. Because they are really trusting that other stuff to tell them what they want to know.
OK, but what if you were not an advantaged applicant? And to continue the example, what if you did not go to a high school like that?
Well, Dartmouthâs data suggests that somewhere in the 1400s or so, it would start actually being seriously helpful for a relatively disadvantaged applicant to have a test score to submit. Again, it is not so much they are penalizing the kids without that test score. It is that such a high test score is helping those kids who have it, and these particular kids may need that help at colleges like Dartmouth because they donât necessarily have all those other trusted academic indicators the advantaged applicants have.
OK, so that white paper is the best single thing I have seen, but I note Yale, Brown, and others have said in words the same thing that Dartmouth illustrated in these charts. Like here is Brown talking about its latest ED round, and it discusses their decision to go back to test required:
The class of 2029 is the first to apply with the reinstated mandatory test scores policy and the second to apply under the Supreme Courtâs outlaw of race-based affirmative action. Brown reinstated the test requirement in part because âsome students from less advantaged backgrounds are choosing not to submit scores under the test-optional policy, when doing so would actually increase their chances of being admitted,â according to an advisory committee on admissions practices.
With that Dartmouth paper in mind, you can pretty easily imagine what Brown was seeing as well.
OK, so does submitting high test scores help sometimes at test optional colleges? Yes, particularly if you are talking about the most selective colleges.
But at such colleges does submitting high test scores do a lot to help relatively advantaged students who go to well-known college prep high schools? In most cases, probably not.
But at such colleges can it help relatively disadvantaged applicants who may be lacking in a lot of other trusted academic indicators to submit a high test score? Absolutely, it may help them a lot.
And in fact, it may help those particular applicants even if their scores are below the normal CDS range for the college, but still quite high for applicants of their type. Which is why in fact Dartmouth and Brown and so on are going back to test required.