How do you start?

I want to start a little shop that ideally sells fun boutique things and serves coffee/snacks, but I am confused about what that even entails. How do I lease a place? What forms do I need? What permits do I need? Is there someone to talk to? How do I do business taxes?

The barrier to entry makes my little dream seem daunting.