Is the difficulty of software development overrated?

That is generally correct. A lot of more complex tasks utilize the higher level math. Linear algebra is very important to graphics work and some special algorithms. Calculus is probably more generally used but is still rare. Discrete math is very used, but not usually considered an advanced math.

Mathematical skills also apply to computer science skills. It’s like requiring a creative writing class for a journalism major. No, it’s not their everyday task, but it still can have a subtle impact on their daily work.