couple things.dissonance said:
The slight rubbing is the pad in contact with the rotor that is obvious. What happens is that when you take the front wheel off and reinstall it it is hard to get the tension in the quick release just right every time. The trick is to set the brakes up with the quick release as tight as you can get it. That way it will never be any tighter thus throwing the calipers off.
I would reset the brakes with the tip I just said using Avids set-up instructions. Try to get the inboard pad (right pad when you a standing on the bike) as close to the rotor without rubbing. That will give you the most power from the brakes.
I bet this will solve your problem.