This is a popular modification. I think it's kind of silly.
Suppose you ditch your granny ring. The only weight savings you get is the weight of the 22t chainring itself. Which isn't all that heavy. You still have a front derailleur and left shifter, and you still have a crank spider that's got support for a granny ring. If you don't swap out your front derailleur, you also still have the bottom-most step in the derailleur cage, which is there to facilitate shifting into the granny ring. Which it will, whether there's a chainring there or not.
So you don't use the granny ring. Good for you. Count your cadence. Learn to pedal 90 rpm, at least as a tool if not as a way to ride full-time, and re-evaluate whether or not you want those bottom few gear ratios. If you decide you don't want your granny and you're trying to save weight, get a double-specific crank, with only one set of bolt-holes. Give a little thought to 1x9 as well. Do you really need higher gears than 32/11? What about higher than 34/11? Etc.
I feel like people often rush into throwing parts at their bikes. It's not like someone's holding a gun to your head and making you change things. And I really don't think that granny ring is harming you by being there. So you have time to try some things.
Actually, here's an experiment. Use your limit screws to lock out your granny ring. If you don't miss it, including when you're practicing high-cadence on those long, boring fire road climbs, awesome. Get rid of the old girl.