The downtown area is pretty well covered in open wifi. Many bars and cafes offer wifi for free.
It´s fun to go the rent a car and drive around the country, called the cirlce. I have to recomend Gullfoss, one of the most beautiful fosses in the world. Blue lagoon is also pretty nice.