Restaurant owners, residents and visitors alike were surprised by the relative lack of notable faces in the Hamptons this Fourth of July weekend.