I suspect you will be fine if you have a diploma from your high school. The bigger problem seems to be non-U.S. Schools that want the IBD as the degree. Those are usually explicit about the acceptance being conditioned on being awarded the IBD.
If your acceptance letter didn’t have any wording like that, I wouldn’t worry.