No they shouldn't be banned. You don't want to line in one? Fine don't live there. No one is forcing you to buy there. Let those who want to live there, well... Leave them alone if that's what they want. What does it matter to anyone else?
Please note I'm not trying to attack the op. My comments are meant for anyone trying to ban them.
For those that live in an hoa and have a bad board, go run for office and get the idiots voted out. Either that or move. Probably cheaper to run for office and then fix the problems.