You might also look into Harvey Mudd, which offers a similar institutional focus to that of Caltech, and which, with respect to your interest in math, appears in a Princeton Review sampling, “Great Schools for Mathematics Majors.” Rice could also suit you.
As a side note, you seem to have an interest in inorganic chemistry. This can be refreshing to see, since so many OP’s who express an interest in chemistry indicate an interest in studying CHNOPS.