Tips on dealing with wedding disappointment

My fiance and I are getting married in May, our RSVPs were due yesterday and a lot of people ended up declining. We are getting married in a different state than we live and his family lives. Due to costs and the uncertainty of some friend’s life events it’s going to mostly be family and older folks. No big deal. But we had envisioned this big party of dancing all night. Now we are both worried that our wedding will be… lame… has anyone else felt this way? Can someone give me hope that all is not lost and it will still be a fun time? (Yes yes I know it’s about getting to marry my partner, but I also put a lot of energy into my vision of our reception)