(PC)Tracking issues that typically start after 30 minutes plus of use

Anyone have issues where the headset works completely fine tracking for a while (sometimes I can go a few hours fine… rarely though) then out of nowhere you start to get tracking issues?

I sim race/drift primarily (got the headset for gt7 at first, and now mainly run Assetto and Iracing) and often it will happen when I leave a lobby and reconnect, sometimes it just happens mid lobby. But it seems my headset loses its ability to track the play area. My room is fully lit, and I think the usb slot is fine. Plus I cover my tv to prevent reflections.

Any recommendations?