As far as I can tell, very few east coasters hanging around here. They have their own play grounds.
http://www.cogeyed.com/forum
http://www.pedaltrout.com/forum.html
I left 4 years ago, can't think of a place that rented bikes, but ask on the forums above. I wouldn't be surprised if someone offered a bike and a guided tour.
A few good places to ride just outside of town (at least they were when I left). You can ride to them all.
Whopper
Wrandees
Fight trail
Directions should be on trail reviews. Maps might on the sites above. But I suggest finding a guide, should be some good east coast hospitality.
The citadel is a great to see (during the day!).
Maritime museum/Pier 21
Keiths brewery tour
A stroll through point pleasant park and or public gardens. Or just generally along the waterfront
Day trip, rent a car an drive around, peggy's cove, just along the coast line, very nice (even better, if you can find a road bike, pop off 100 km)
Pubs, pubs and more pubs, with a dash of local music