Attachment relation to recoil

I notices when i add grip, change stock, laser, etc. i saw my recoil pattern (bottom right) changing inconsistently. Sometimes it got smaller, sometimes it got bigger, even when using the same attachment. Does it really matter when i use different attachment? Is the graph has no correlation with recoil? or else?