Mouse in apartment caught, could there be more?

Me and my roommate have both seen a small grey mouse in our apartment for a month now. It finally got caught in a trap. Should we be worried there may be more?

EDIT: me and my roommate have removed all food because we found the mice were in our bread, and kept our sticky traps and ordering more. Also have an exterminator coming to plug any holes.