Colorado Mountain Towns

I'm heading to Colorado in July with a few friends from college (all in our mid-30s, no kids, no wives). This is our second consecutive summer trip there - last year was a blast, but I'm all ears for anything fun to do that might fly a bit under the radar.

Last year we were there for 4 days, stayed in Dillon - we did a few hikes, whitewater rafted in Buena Vista, spent a day in Denver, hung out a bit in Frisco and Breckenridge.

This year we're staying for a week in Fairplay. We're not planning on spending any time in Denver. We're definitely hiking, whitewater rafting (probably twice - Numbers and Royal Gorge). We're also probably heading towards Colorado Springs for Pikes Peak and/or Garden of the Gods. Appreciate any additional recs for fun stuff in that area for our demographic.