Are you specifically looking for a 5" travel bike?
It will be overkill for just general XC riding. It will be comfy, but sluggish, and slower steering. Just my opinion, from owning both a 5" and 4" bike.
If I were you, I would be looking at the Giant Anthem X1 W. They have a XS. It's 4" of travel, so it will still be plush, but the geometry is a little racier. It will probably feel very comfortable to you, since you are used to a road bike geometry. I highly recommend you, at least, give one a spin.
I downsized from a Stumpjumper (=Safire) to a Anthem X2. It was a great decision for me, and my usual trails. The Ax steers quicker, climbs better, and (to me so far) is just as plush going down, and over rocks and roots. I haven't had the Ax long enough to say for sure, but it very well could be the best riding bike, I have ever owned.
***I think the Maestro (giant) suspension, is better than the FSR (spec.)***
I've never ridden a Pivot, so can't comment on it.