A Poor Sport

My team was in league tonight and there was a player on the other team who kept yelling loudly when my teammates and I were bowling. It was definitely on purpose. I called him out for it in the middle of our second game. He was all up in arms after I said something. Was I in the wrong to say something to him?