A lot of sights are too far away from Reykjavik like the ice caves and glaziers, but it's the 'golden circle' you want to look into , it takes in various attractions hot springs, parks, waterfalls etc.
we used these guys for everything http://www.superjeep.is
and used the for the northern lights which was amazing, but if the weather is ok I'd hire a car and do it yourself.