In 1805, the first settlers of Grafton Square bought property when there were no cabins, no roads, and no blazed trees.
Oliver and Esther Richardson hired Calvin Tiffany to build a cabin for their family of 10. When occasion arose, travelers were welcomed to stop over.
In 1806, Capt. Stephen Douglas became the Richardson family's neighbor. That same year Capt. Douglas opened the first school in the 20th town, seven years before the organization of public schools.
The name Grafton Square is said to have derived from the extensive business of tree grafting carried on by one of its residents.