I don’t understand the concept of ta’veren

The books say that the Wheel weaves the Pattern around taveren. If everyone else is subject to the Wheel or fate, are they the only ones with free will and agency in this world?