Rufus Spencer, 1792-1866