Bf complaining about driving 20 mins to see me

I (24 female) has been dating this guy (23 male) for about 1 month. He lives 20 minutes away from me and I don’t have a car at the moment. I took the train couple of times but it got bit sketchy on the station lately I decided to stop taking the trains to see him ( I had multiple incidents where a homeless person followed me + a guy trying to talk to me when I said please don’t talk to me). The train only runs during the week and early in the morning. This makes us see each other only once a week during the weekend when he doesn’t work. I told him I can’t take the trains anymore because its dangerous and asked him if he can drive more to see me. He didn’t take it too well and said “I drive 20-30 mins every weekend to see you, you only took the train few times”. I honestly felt heartbroken after he said that. Is it too much to ask for him to drive here?