If Calvin Johnson and Matthew Stafford were so good, why did the Lions not win more with them?

They set records together, but they never made to the Superbowl. What held the team back those years they were together?