Facing harassment from passersby, some construction workers have reduced their hours or opted out of work altogether.