We don't. We wear slippers or socks indoors and leave our shoes at the entryway. I don't know any family that wears shoes indoors. Everyone who visits us automatically takes their shoes off when they come in without us asking.
I'm told this is a regional thing and that in other places everyone wears their shoes indoors. We live in the northeast.