Five buildings must be removed to make room for new public library