How do you remove an old post anchor?

Dig around the cement base with a shovel. If your pole doesn't have a cement base, dig around the pole until you're able to lean against the pole, working it loose. You can then remove the pole. If you have a cement base, proceed to the next step.