In 1859, part of the town was used to form the towns of Montezuma and Throop.
There are a number of people who can trace their roots back to Port Byron or who settled here for a while. Before he was a leader of the Mormon faith, Brigham Young lived here in the early 1830s. He was a painter and builder. One of the early buildings he lived in still exists on Pine Street.