Is Bunad only for 'ethnically Norwegians'?

When I had a drink with my colleagues after work, one of them insisted that only ethnically Norwegian people should wear bunad. This conversation started from our discussion about cultural appropriation, and I said I'm totally fine if someone wears a traditional dress from my county with respect and in a good context. Then I continued I'd like to wear bunad if there is an opportunity or if I had a Norwegian partner. Then this colleague, a (white) Norwegian man in his late 30s, said, 'You should never wear bunad because you're not Norwegian.'

At this table, there were two other Norwegians and me having this convo. They seemed surprised and asked why he thought so, and he answered because bunad is traditional through family in Norway etc (don't remember exactly). I asked what if he had a partner from another country, say Sweden, and his answer was she should not wear. Also no for Norwegians who have immigrant backgrounds. Another Norwegian colleague at the table argued and said bunad does not have a long history as some people would think, and everyone should have an opportunity to wear it if it's appropriate. The atmosphere got awkward and we changed the topic.

I've been in Norway for 3 years and working in tech in Oslo, so never met someone with that conventional view. I've been thinking if my colleague's view is still common among some people?