There's a hot spring right on the sea, easy access to cool off in the cold water. The pool is quite nice too, and there are hot showers and a changing room.
This spot was funded by the singer Björk and her "Water Friends". There are a couple of guesthouses across the street, a really nice place to spend the night.