Its been a roller-coaster

So I am in love with somebody and we are only friends (yet) and I feel like its been a roller-coaster (we only know each other for about 4 days). Yesterday he was mad but not at me or because of me and I still felt like he is mad because of me. He responded later but I was sleeping so I saw them today and he said that he is sorry that he didn't respond. I feel like I love him but hate him the same time. I'm scared to text him cus i always say to myself "what if I'm annoying him?" And stuff like that. How can I help myself in this situation?