Speaking as someone who took Geometry during my middle school years…
It means you’re normal and probably had more limited opportunities at your previous school. Some kids will have taken Geometry previously, or have studied it on their own time and passed the placement test into Algebra 2. Geometry isn’t a course you want to just skip over. It’s pretty challenging, and I took it at a public high school, which is on a much lower level than Milton.
Try the course for a week or two. If you feel it’s too easy, see if you can swap out. There’s no rush, and don’t worry about what other people are doing. You have your own path, and that’ll be different from others. It’s better to be safe than sorry, after all!