There does not appear to be any clear answer because you have concerns which are not readily available for posters to research such as counseling services for specific characteristics & number of piano players in the community with whom you will form a meaningful connection.
Harvard versus Wharton typically comes down to one’s specific career goals. Since your career goals are unclear, you probably should base your decision on comfort.
Sorry that I cannot offer more definite advice, but both of your options should lead to outstanding opportunities professionally & with respect to graduate school.