Religious Name or no?

When I mentioned the name "Isaac" to my husband he IMMEDIATELY had a religious association with it. But I'm wondering if that is what the general public would think... we're not religious at all so it feels wrong to take a name overwhelmingly tied to religion just because I like the sound 😅