Based on academic interests (geoscience, teaching cert) and being from Maine, I would not suggest rejecting Colby out of hand. It may ultimately not be what OP wants, but there are lots of kids who may feel more like OP’s people there. Waterville is, however, about half the size of Lewiston, so that should be a consideration.
I am sorry your are unhappy, OP. I hope that pursuing a transfer is lifting the burden a bit.