Should I let my cat torture mice?

Scenario: My cat catches a mouse in my house. Do I let him have his way with it?

I do not want mice in my house, I'm glad he's helping. Davey's joy seems to match the mouse's suffering. Suggestions?