I had all kinds of problems, mostly stemming from my fear of driving. I find it's mostly the pressure and nerves that make it difficult.
This reminds me of a funny story when I was getting my license a few months ago. I was standing in the tag agency, leaning against a table, when a student driver rammed a car into the wall behind me. She got the brake and acceleration pedal mixed up. She knocked the wall of the foundation, and I got hit in the butt pretty hard. She was so embarrassed, I felt bad for her. It was an interesting experience so I thought I'd mention it.