How should I politely decline someone's request to go to their church?

Back in December of 2024, I went to ShopRite to purchase a pumpkin pie for Christmas. I exit my car and two men walk up to me, inform me about their church and ask me if I intend to go to their church. I say that I just realized I was supposed to be somewhere, that I have no time to waste and that I am in such a hurry that I do not even have time to explain why I am in a hurry. I then get back in my car and drive away.

I do this, because I do not know how to decline their request politely.

I am just glad I was only their to buy a pie and not their to get something I need.

By the way, I am not interested in going to a church, synagogue, mosque or any house of worship, because I am not religious.

The next time someone walks up to me and asks me if I want to go to their church, how do I decline their request in a way that sounds polite and does not invite too many questions?