Sounds like mostly guilt to me.
Anyways I congratulate you on your restraint on not doing anything which would GUARANTEE you would be barred from that church for the rest of your natural life.
I agree with you... there's no point in going to church if you're already dead set against the religion anyways. You'll filter out anything you hear out of sheer stubbornness of being forced to go.
And the people asking you why you don't come to church more often are just concerned for your immortal soul, is all. Don't take it too personally.
I also should remind you that the entire holiday is BUILT on this religious crap as you put it. Even Santa Claus (the legend, not the appearance) has roots in Christianity (According to legend a Saint Nicholas climbed down the chimney of a particularly poor family and put food in their stockings, hung to dry).