Wall way out of plumb, what to do?

The face of this wall is way out of plumb, the idea was to have the door face line up with the drywall. But I’m looking at almost 1/2 inch or 3/4 inch out of plumb.

Is my only option to take the drywall off and plumb the wall a bit, then re-drywall and put in the cabinet? Or what else can I do? The worse is the bottom close to the sil plate.

Thanks