“It’s far faster to get a demolition permit than it is to designate a building as historic, which can take months.”