Chestnut Grove, Virginia, British America