Neighbors say Worthington ignored concerns about moving house to lot