To Transfer or Not to Transfer? That is the Question