Why can't I hear my husband?

2 controllers. 2 headsets. 1 xbox.

When were in the lobby we can hear everybody but eachother? Is that normal or no?

New to xbox so idk what's really going on lol