Airpods Max connects but sound still plays through iPhone or Ipad speakers

Ive recently gotten an issue with mine. It started when the airpods suddenly disconnects from my device so I take it off and put it back on again but when its on my head, it no longer makes the sound when its "Bleep" (idk how to describe the sound) when i put it back on. When I play audio, it just goes through the device's speakers. It gets fixed every time I reset the headphones (pushing the scroll wheel and noise reduction button for 15 sec until amber light) but after a few hours of listening, the issue creeps up again. Is this a sign that i should have it replaced? My warranty expires on June of this year.