Should I pursue a biomedical engineering degree?

Not ridiculous at all. However, you should be aware that the kind of things you want to do in BME will probably require a graduate degree. There are not too many jobs for BS graduates in BME.