Council agrees woman must remove fence