I think it has a different impact on the brain. I suspect someone just raised on audio books wouldn’t do as well on the SAT English section (just saying, since we spend a lot of time on that topic out here ?).
I’ve listened to books sometimes on long car trips. But in general, it is hard to kept my attention on them. And there are already so many podcasts on my phone, no time. ?