Activists on both sides rally around town