Rolling with bigger people

How do you guys feel about rolling with people significantly bigger than you? It depends on the person but a lot of times I feel like it turns into a smash fest and I’m basically spending 7 minutes trying to survive. I know people say technique and cardio are what matters most but if those are both equal, then I feel the extra 30, 40 or 50 pounds provides a huge advantage. I know there are the Marcelo Garcia’s of the world but for someone who is a hobbyist, I just don’t feel like I benefit as much from rolling with guys that much bigger who I’ll never cross paths with in competition. Am I wrong?