If the arm has been ridden while loose, often times the splines get distorted and as a result the arm will no longer stay tight. This sounds like what happened in you case. Basically, you'll need at least a new crank arm, and maybe a new crank.
A forum community dedicated to Mountain Bike owners and enthusiasts. Come join the discussion about bike parts, components, deals, performance, modifications, classifieds, trails, troubleshooting, maintenance, and more!