As SLO was mentioned above, just pointing out this is similar - super cute town but SLO is 3.5-4 hours drive from LAX or SFO. (Or you can hop on a small connecting plane to the small local airport.)
Not sure how much ease of getting to the university is an issue, but as it’s only going to be probably once or twice a year maybe it’s not a dealbreaker?