Bermuda

I hear its to cold to swim except for the hottest pert of the summer?

stayed at The Reefs and enjoyed it. has its own small private beach and a couple of restaurants, really close to all the best public beaches which you will want to hit.

Have also stayed at the fairmont in Hamilton which is nice but not on the beach, but on the bay with a marina filled with nice yachts (depending on when you go)

Things to do:

fish (challenger, mako, es mucho are good charters tell them you know Kyle Weaver)
crystal caves
underwater exploration museum
drink (swizzle inn, henry VIII)
rent a scooter and drive from one end of the island to the other
dockyards
america's cup festivities depending on timing
rented paddleboards at from blue hole water sports at grotto bay, there is a cave nearby that you can swim in.
beach hopping

I also stayed at the Fairmount. As noted, it's my on the beach but it's like a five min shuttle to a great little beach. Property has a golf course and a nice easy hike to a lighthouse. Tennis as well. And I think kid activities.

Above poster summed it up well. Only thing I would add is golf. Lots of good courses on the island.

We didn't do the crystal caves but heard very good reports.

I'd planned to rent a scooter. After seeing the roads (narrow, winding, and lined by shelled walls), the amount of traffic on the roads, and the style of driving, I decided not to do it. Particularly given that they drive on the left which took me some real getting used to even as a passenger. And no way I'd recommend it to a novice.

Good catch. I was at the Fairmount Southhampton. Great views. Easy shuttle to the beach.