“brick and mortar” are actual buildings, like a local university or community college.
There is a comma after non for-profit, so it means any private or public, online or physical school allowed.
If you have questions, ask the HR person, they should be there to help you to understand your benefits.