In America, 1580 is a fantastic score. Not submitting it is weakening your app.
A perfect 1600 is not going to get you in. Not to Colby or Harvard. It’s going to be the other stuff.
So you applied test optional because you thought 1580 was a strike against you? It isn’t. You should submit it.