Being quiet is taken as attitude?

Why is it when you’re quiet at work it’s taken as you have an attitude? I can admit typically I am more talkative at work but it’s never because I genuinely want to talk to people. I’d rather NOT engage in meaningless conversation but hey it makes the time go by faster.. but the one time I don’t fake it and only speak when spoken to it’s “ I have an attitude”. Is this a universal experience for black woman working in spaces where they are the only black person?