Do I need to worry about AP if the school I am going to didn’t offer any AP or offer only a few AP?

No. What is important is to take as rigorous a schedule as your school offers. Colleges look for academic rigor, not AP classes. In some schools, AP classes are that. In others, like my son’s school, they have AP level classes, not taught to the test, and higher. In some schools, they may have only few or no, AP level classes.