Any ideas?

My lights will dim everytime I roll my windows up. Does this just mean I need a new battery? Should I get it looked at