Holding aside whether you will be admitted and whether it would be affordable, that really could not be more of a fitting description of Case Western.
As others are suggesting, it would make sense to also look into Rochester–not technically Midwestern, but since it is in the Great Lakes region of New York it is in some sense more akin to other Great Lakes areas culturally.
Other schools in the Midwest fitting your description would include Chicago and Northwestern, which of course are extremely hard to get into. Washington University in St Louis also has an interesting Physics department, but again not easy to get into. Finally again some people would say Pittsburgh is pretty close to Midwestern, and CMU would be an option, but again reachy.
Most of the other well-known Physics departments in the Midwest are at flagship public universities, so bigger than you were asking, and also might not make budget as OOS publics are stingy on aid.
If you were interested in possibly smaller, though, both Carleton and St Olaf are good for Physics. Carleton is reachier with no merit, but St Olaf is less reachy with merit.