Although surveyed in 1772, the town of Dexter was still unsettled until 1880, when Ebeneezer Small arrived, moving his wife to the area. Located in Penobscot County, Dexter is named after Samuel Dexter, who had served as Secretary of War, Treasury and State in various United States cabinets.