I hear this from time to time, from Christians in general.
They are merely playing with words.
If they are serious about the topic they brought up, then a better line would be:
"America is not founded on Christian basis".
Then we will have something to discuss.
"All countries are founded on some aspect of Christian values"
Again, playing with words, no serious discussion needed.