What drugs impact your memory the worst?

I've been doing all kinds of drugs and I have had worse and worse time to remember stuff. I'm still hooked on drugs and I will keep exploring, but I'm thinking of excluding some/combos which are really bad on the memory. Do you have any recommendations on specifics or does all drugs have negative affect on your memory?