What’s the real difference between M4 and M4 Pro chips?

Speaking about the processor only, is it just that the Pro has more CPU and GPU cores? So we would expect single core operations to be equally fast, while multi core ones would make a difference? Or am I missing something here?