Stanford, Harvard, Dartmouth, Yale, Penn, Brown, CalTech, JHU, and UT-Austin to Require Standardized Testing for Admissions

At the end of the day, the more selective the school is, the more information the AOs will want in order to curate the class that best satisfies the college’s institutional priorities. Whether the information comes from optional art portfolio, supplemental essays, optional videos / Interviews, SAT/ACT/APs, a coach or the development office. All are hooks with a different weight, but hooks nevertheless.

One can therefore expect the most selective schools to increasingly revert back to mandatory test results.

3 Likes

I thought this said they got the applications from these disadvantaged kids who submitted TO and rejected them. They realized afterwards that they might not have with the score.

Part of the issue here is that it is not only that the SAT/ACT that ties to SES – it’s the whole application. And not even just ECs. AOs have to be taught to read essays differently – for any number of reasons.

It seems like Dartmouth realized that in spite of wanting these kids, their biases got in their way and that this move might help a bit.

3 Likes

I’m sure that there were some students that were overlooked because of lack of tests - but how many was that really? Given the paucity of students in that category to begin with, coupled with the fact that the likelihood of their having applied to Dartmouth in the first place isn’t great, I can’t imagine it was too many. As I mentioned in my above comment, I am not questioning Dartmouth’s decision, just the idea that it will result in finding more diamonds in the rough. And, to be blunt, Dartmouth has been admitting recruited athletes for years who come in with much lower than typical SAT scores and this wasn’t seen as an impediment to their success. Cynically, I imagine that is because many of these athletes come from prep schools or wealthy suburban publics so Dartmouth could be certain they would be fine academically because their preparation was good.

1 Like

Hmm, what do you have in mind, because I have seen the opposite. For example:

https://admissions.dartmouth.edu/follow/admissions-beat-podcast/admissions-beat-s3e15-transcript

Back to the question, we are using AI to a degree, so, guilty. We are starting to sort the preliminary pool in some ways, because we have to figure out, what’s the first wave? What’s the second wave? Which students are structurally more challenged by their academic elements, and they move into a faster track

Q: So, you know, I have to ask, what, what data are we talking about here? Is this GPA testing?

A: So we, yeah, so we’re using academics. So we’re using 64 different combinations of academic data, depending on what’s available in a school. And we weight it accordingly. So, you know, things like the obvious things like is or gpa, is it weighted or not? Is is there a way of assessing the rigor of curriculum in the high school? Is there class rank? Is there testing? What kind? And the combinations of those elements around academic achievement give us a way of taking a big pool and starting to sort it and say, okay, let’s start at the top and work our way through it.

And as opposed to reading them one by one without any intentionality. And, you know, you may be reading the wrong ones first. And so we’ve, we’ve kind of, you asked a question about, you know, volume and how we’ve had to rethink the way we do our work. This is an example of that where we’ve had to pivot a little bit from the old fashioned way of starting and just documenting and reading everything to say, okay, let’s, let’s be clear at the beginning about where to begin.

Q: Do you take any institutional history into consideration? Like some schools, when they have a track record of a lot of students from a school, they’ve, you know. . . . In first year class from this school, any of that kind of stuff?

A: No. So we’re, we’re not doing anything historical. We are context comes into it. So we are adding contextual elements from the school. So when there’s profile data that we can plug into one of the logic trees to say X percent go to a four year college, here’s the mean SAT against the student submitted score. We’re taking pre-populated information and we’re putting it through an algorithm that helps us sort the pool upfront. And it saved us, this year was the first year we did it, it saved us about three weeks of work. . . . And let us get into the reading process much sooner than we were able to do in other years when we were manually going one by one through all those files with admission people doing it. And also it just made it less open to misinterpretation by various admission officers. We were, you know, the, the, an admission officer could override the algorithm, but that was rare.

Q: Did did you come up with the 64 criteria by like brainstorming as an admission office? . . . Was this the work of consultants that, you know, you outsourced? How did you contact with that?

A: No, we, no, we insourced it. This was our senior admission officers last summer, had a retreat and I had a working group that kind of plotted through it and said like, what is available to us on the secondary school report on a transcript and testing through the college board landscape, like what’s out there that we could glean from the documents submitted, populate our database, and then the logic tree kicks in and says, okay, you know, these elements are present. This is algorithm 27, whoop. And it came up with an academic assessment for us.

Q: As you network with other peers at other schools. How common is this Lee? How many, you know . . .

A: I think I’m a pioneer.

Q: Yeah. 'cause I am not hearing this. Yeah. So I’m like, I’m much out of the loop on this. I mean, I’m . . .

A: No, no, I, I was sharing this with some fellow deans recently and they were like, wow. And I, I just, you know, it was a giggle because I’m, I was a humanities student, but I, you know, the data is there for us to use if we can. And what, in this example I’m sharing is me trying to think creatively about what do I know, how can I have the technology we have help tee up the work, not do the work. This isn’t a chat GPT version of reading a file, but help prep it so that the admission officer can go in and more elegantly use the information that’s been submitted and spend time where we need to spend time.

Q: Well, anything that saves three weeks. Yeah. I have a feeling you’re gonna have some other schools reaching out to you and asking for some Tips.

A: Yeah, yeah, yeah.

Q: This is where you tell Dartmouth, Hey let, let me get some consulting money on the side.

A: Yeah. Really. Let’s do a, let’s do a patent. No, but it was, you know, all of it is, you know, none of it was invented. It’s all there in the secondary school report. It’s, you know, being able to just load it into your computer and have the power of technology help map it for us.

Q: I do think it’s important for us to let our listers know though, that you are not just making decisions off of this. You’re still doing a full holistic read with the human element. Bringing in aspects of nuance that cannot be captured by landscape or, you know, secondary.

A: No, we don’t do this school profiles. No, no, no. What I’m describing doesn’t touch an essay. Yeah. Or a recommendation or an interview. It’s, you know, it’s, it’s taking what was the first step in our reading process, which is the academic review and automating it to a degree that lets the admission officer then go in and say, okay, this has been calculated for me. Does it seem accurate? If not, why? Or, oh, there’s a new piece of information, I’m gonna plug it in. And the, it’s adaptive. So the score adjusted as we added new, you know, when we see Julia’s letter saying if we ranked, she would be number three. You can plug that in and that changes the algorithm.

1 Like

Yes - what D is saying it wants to achieve&their purported rationale for it, and what they will achieve may well be quite different.

I’m not sure why under resourced CA public schools, for instance, would invest any resource into registering and preparing students for a standardized test. So basically D is shutting out entire school districts.

1 Like

Let’s see if I can back-of-the-envelope this.

It looks like disadvantaged students were about 14.3% of their applicant pool. Then it looks like about 5/16th of those would fit into the 1400-1490 sort of range, which is about 4.5%. It looks like around 40% of those did not submit scores, so 1.8%.

Of course possibly this policy will induce more such people to apply, but still even then I would guess you are looking on the order of about 2% of their applicant pool.

And then the admissions odds were being multiplied, but still only being increased by a small amount gross–maybe around 4% for the whole of that range on average. So the marginal effect in terms of new admits would be something like 0.08% of the application pool. Application pool of say 28000, you are talking on the order of 20-25 different admits they are looking to get, around 1.2% of their admit pool.

Obviously this is a crude estimate, but hopefully that’s not a bad guesstimate for our purposes. Meaningful of course for those people, probably at least somewhat helping Dartmouth achieve its socioeconomic diversity goals, but not likely to completely change the composition of Dartmouth.

1 Like

Yes, some California counselors I know say exactly that. And for their high achievers…Columbia U is permanently TO, Harvard TO thru 2026, etc. etc…so no shortage of meet full need schools for these kids to potentially apply to. California is the second largest state in terms of sending students to D, probably many are from private schools though.

And I’m with thorsmom…I don’t think the cohort of FGLI and/or URMs with 1300-1400 is all that large. Couple that with some proportion of counselors who will be reticent to advise their students to apply to D with test scores below the 25%ile even with this messaging, and I don’t know how things will go for D wrt this population (which is the same population 100 colleges want). I do respect that D believes that requiring tests is right for them.

1 Like

I was on one of those FB pages.

I believe those counselors cared about their students and doing their job well. But there was an almost religious anti-testing fervor there. Their views about testing no doubt serves many of their students well (it’s one less thing for the students to worry about), but I believe it serves some of their students very poorly.

5 Likes

So, did they not admit 20-25 kids from their pool of under represented students or did they just admit a different group of 20-25 - one they fear won’t perform as well.

Yes, there is some proportion of counselors in this group. There are more who don’t value testing but don’t necessarily have an anti-testing fervor.

I am not sure of D’s real intent behind their policy and words. They can choose whatever class they want. With that said, IMO they have always been lacking in enrolling disadvantaged students…during all of their test required years through 2020 and for the last several cycles when they were test optional. So I expect reverting back to test required will change nothing with regard to their class composition.

3 Likes

Even though I am in favor of standardized testing, I have previously written that, because some bright students don’t test well, it’s great to have test-optional colleges that can dig further into an application and verify that the student has the academic strength to thrive without a standardized test.

In other words, test-required and test-optional complement each other. And a number of liberal arts colleges have done well with this approach.

With most of the college landscape now test-optional, having a set of test-required colleges is also complementary. While the number of low-income and high test score students is small in percentage terms, in terms of actual numbers there are plenty to fill the desired number of seats at Dartmouth, MIT, and other colleges that now require tests.

How many do you think that is though? And how many does Dartmouth want to enroll? Frankly, I think there are things that work against Dartmouth, apart from any testing policy, that make attracting and enrolling kids from under represented groups more challenging than it is at other Ivies. They are more remote, smaller and whiter than any other Ivy League school and I think that hurts.

2 Likes

Among the non-white students I know, those are not characteristics that make them attractive. Predominantly white, rural, etc. Low income students have the same worries, even if they’re white.

But if the schools don’t really make an effort, how will it change? I think it’s particularly tough for the kids at the forefront of these demographic shifts at any school, but to not try because of the headwinds isn’t going to change anything.

2 Likes

I agree 100% and I think it is important for these type of schools (and Dartmouth is far from alone in this challenge) to make good faith efforts to attract and enroll students from outside its traditional demographic. I am just uncertain, that given what I know of testing among lower SES students (low rates/small % of high scorers), that this particular approach is likely to bear much fruit. I am not anti testing or anti Dartmouth (an excellent school and one of S24’s top choices - if he is admitted) but I am just a little skeptical.

2 Likes

IMO changing doesn’t mean D needs to require tests. The fact that their peers, who are also trying to change supports that. Having peers that are TO seems to put D at a disadvantage in attracting these students they say they want…did they consider that?

I do also wonder if D thought about or knew that some counselors who work with the students they want would not be receptive to them requiring tests. I expect some of their AOs are on some of the same FB pages and in professional orgs like NACAC that the counselors are in…they should have known this.

2 Likes

Using a marked-up Jon Boeckenstedt chart that I posted on the SAT thread, I estimated that about 20% of all 27+ ACT test scores were from families with below median income (about $60K at the time). That was was good enough for Berkeley’s 25th percentile (Dartmouth’s 25th percentile is likely higher, but these would be the students that Dartmouth would consider for the bottom 25th percentile), and translates to 1280+ on the SAT.

A 27 ACT is at the 85th percentile, so 15% above that. If my estimate of 20% of that pool being below median income is accurate, Dartmouth has a potential pool of about 3% of all test takers. So still substantial.

The numbers I saw were that Dartmouth was about 17% Pell Grant eligible. With a class size of 1200, that translates to around 200 students. So small numbers relative to the potential pool.

On this part, I agree completely.

3 Likes

@Mwfan1921 , I hear everything you are saying. But Dartmouth is representing that their blinders have been a problem in a TO world. Even if they get the applications, they don’t accept them. These seem to have been kids who had tested, btw, just chose not to submit.

The CCs I know – including ones who work with FGLI (although often as scholarship students at BS)-- encourage all kids to test. They then decide where to submit. Guessing that someone now needs to make the call on whether Dartmouth should make the list for them.

3 Likes

CCs definitely encourage all the BS students to test. I bet (just speculating here) that a not insignificant proportion of D’s FGLIs and URMs are coming from BSs, so on that measure they might be able to keep getting the students they have been getting, but growing that might be challenging. Time will tell.

1 Like

This is a slightly different topic, maybe worth its own post, but I’m actually very interested in someone (like Jeff Selingo) getting real access and writing an article about what it actually means to use AI in these admissions offices. I’ve looked at some of the major software vendors to admissions offices (like Embark) and I don’t see them obviously offering a product here; admissions offices don’t have budgets to build their own things, and aren’t going to trust a student project; and most importantly, this just feels like waving an AI magic wand around to solve your problems.

There are many kinds of problems that new and complex AI models are right to solve, but I am not convinced that this is one of them:

  • the data sets are much too small and sparse to act as real training data (even if you aggregate with “peer” schools)
  • the “black box” nature of AI systems, where you can’t easily reverse-engineer how they made their decision, is both risky and non-optimal for AOs and their management teams - if you can’t explain why Sally Rockefeller is in the reject bucket, boy howdy
  • you can do most of what you’d want to do with a simple rules-based engine (e.g. “if SAT is >100 lower than school average, put in reject pile”)

I don’t really see how you get to AI as a real assist here. I think it’s just talk.

I see talk of algorithms to speed things up, not AI.