The building, constructed in 1903 with a $23,000 grant from the Carnegie Foundation, served as the town’s public library until 1969.