Are weeks 0-6 really the hardest?

I’ve seen this a lot of places and we’re almost to 4 weeks and it feels like there’s a lot of room for it to get worse.