How to avoid lumps in rolags?

Recently got a blending board and it’s tons of fun but I’m finding I get some little tangled up lumps of wool in them sometimes.

Is there a way to avoid this?