why does hermes keep intercepting my divination??

im just starting to use divination after setting up an altar for aphrodite and id like to talk to athena through a seperate candle i have (i dont have enough room for 2 altars). i’m using die to communicate and i keep getting fours and no’s when i ask if it’s athena and yes’s when i ask if it’s hermes 😭 why is this happening