...An oath taken during the military is not binding when you are no longer in the military. I have no authority on base, can't even shop at the PX.
An oath has nothing to do with exercising military privileges. You do, however, still have VA benefits, don't you? Again, an oath has nothing to do with benefits.
You are free to disregard your oath. Many have done it before. You aren't the first and you certainly won't be the last. Just know that there are those who are saddened by the disregard people have for themselves when they break an oath.