Physics crisis 😭

I’m junior (16) currently in chemistry honors. My chemistry teacher who is also the Physics/AP teacher says he doesn’t see me taking any physics class at all next year. I could override his recommendation but I feel as if I would fail the class after not being recommended in the first place. What should I do? I am taking the pre-med route to become a doctor.