If you are in VA all of those should do fine. Basil needs some protection but it’s an annual anyway. Look for winter hardy rosemary varieties, but that is what they should be selling by you anyway.
If you’re anywhere near Dulles Airport, this is the best, the BEST place to go for basil, tomatoes and peppers. I used to make a pilgrimage every year, sigh…
I am in zone 5A, we grow cilantro in the ground. It comes back each year
Herbs are generally pretty easy to grow - much easier than fruits and vegetables. I find mine survive all my misbehavior, forgetting to water, too much shade… Some things die off after a few years - my sage has gotten stuff that seemed to attack its roots which is why its in a new location. It survived the winter and looks happy in the relatively sunny and dry spot I stuck it. I usually bring in rosemary in the winter and then kill it by forgetting to water it.
I don’t think we get enough sun as we live in the woods and even have two deciduous trees close to the deck. Phooey. Well, I think it would be a good idea for me to have a rolling cart where I could move them to sunny patches as much as possible.
We grow herbs in pots. We use medium to larger pots, with one kind of herb or flower per pot. The grouping of larger pots in various styles and heights looks pretty. We use the basil, and mint, but everything else is because I think it’s pretty.
Chives and mints are perfect for patio growing in individual pots. They come back every year, and the containers prevent them from taking over the garden. I also have basil, thyme, and rosemary in containers on the deck. Dill, parsley, and coriander (cilantro) do well in containers, too, but I have enough garden space for them, so that’s where they go.
VaBluebird you can’t possibly have less sun than me! While the herbs will grow faster and bigger in the sun, most will take what they can get.