The Hamptons most charming and laid back town might be Sag Harbor. This former whaling port has held on to its historic past and attracts more laid-back visitors. Read on for the top things to do in Sag Harbor, New York.