Again - school dependent.
Define selective - that means different things to everyone - and check with that school recommends.
I didn’t say you are running away - I said you don’t want to be seen as running away. One can’t know for sure what others will think.
Harvard may, likely will look at rigor differently than say, Denver. Many would consider both “selective” - that’s a word that means different things to different people. Harvard may want you to pursue the strongest path in each core area while a Villanova may give more leeway, etc.
Think of a tennis player who runs around the backhand to hit a forehand. They may (or may not) see you like that.
That said, you can go to law from anywhere - Harvard is represented by 147 schools - schools like Montclair State, U of Kansas, The College of NJ, Drake, etc. - so you’ll have options to attend a top rated law school regardless of where you go.
I think - if you truly don’t want to keep on the math track, that your plan works fine - and you’ll have great opportunities - I just don’t know if they’ll be the ones you want (as I don’t know what those are and anything about you). As long as you develop a well rounded list, you’ll be fine.
Best of luck.